SpiderTool

最简单的万能爬虫器

Stars
38

  • url

1.
    ImageResult(name='142847_16a48_236.jpg', url='http://i.meizitu.net/thumbs/2018/07/142847_16a48_236.jpg', desc=' ', extendOne='')
    ImageResult(name='146379_12c46_236.jpg', url='http://i.meizitu.net/thumbs/2018/08/146379_12c46_236.jpg', desc='! ', extendOne='')
    ImageResult(name='144268_27c28_236.jpg', url='http://i.meizitu.net/thumbs/2018/07/144268_27c28_236.jpg', desc=' ', extendOne='')
    ImageResult(name='137510_05b45_236.jpg', url='http://i.meizitu.net/thumbs/2018/06/137510_05b45_236.jpg', desc=' ', extendOne='')
    ImageResult(name='147468_20f29_236.jpg', url='http://i.meizitu.net/thumbs/2018/08/147468_20f29_236.jpg', desc='', extendOne='')
    ImageResult(name='150001_07b63_236.jpg', url='http://i.meizitu.net/thumbs/2018/09/150001_07b63_236.jpg', desc=' ', extendOne='')
    ImageResult(name='140752_29b05_236.jpg', url='http://i.meizitu.net/thumbs/2018/07/140752_29b05_236.jpg', desc=' ', extendOne='')
    ImageResult(name='147534_20e07_236.jpg', url='http://i.meizitu.net/thumbs/2018/08/147534_20e07_236.jpg', desc=' ', extendOne='')

2.img"data-original", "alt"
    [http://i.meizitu.net/thumbs/2018/08/148211_26b29_236.jpg, ]
    [http://i.meizitu.net/thumbs/2018/06/140460_28c43_236.jpg,  ]
    [http://i.meizitu.net/thumbs/2018/06/138976_16y03_236.jpg,  ]
    [http://i.meizitu.net/thumbs/2018/06/140116_25c19_236.jpg, ]
    [http://i.meizitu.net/thumbs/2018/08/145201_02a09_236.jpg, baby]

1. Add it in your root build.gradle at the end of repositories:
allprojects {
		repositories {
			...
			maven { url 'https://jitpack.io' }
		}
	}
2. Add the dependency
dependencies {
	        implementation 'com.github.pengMaster:SpiderTool:1.0.0'
	}
3. Add use to activity

          
           //Url
           val url = "http://www.mzitu.com/tag/ugirls/"
           //kotlin 
           SpiderUtil.getImageByUrl(url, object : ImageResultListener {
                override fun result(imageList: HashSet<ImageResult>) {
                    mTvContent.text = imageList.toString()
                    imageList.forEach {
                        Log.e("getImageByUrl", it.toString())
                    }

                }
            })
           //java 
            SpiderUtil.Companion.getImageByUrl(url, new ImageResultListener() {
                @Override
                public void result(@NotNull HashSet<ImageResult> imageList) {

                }
            });
           img"data-original", "alt"
            //
            val tag = "img"
            //
            val attributeList = listOf<String>("data-original", "alt")
            SpiderUtil.getAttributeByTag(url, tag, attributeList, object : ResultListener {
                override fun result(list: HashSet<ArrayList<String>>) {
                    mTvContent.text = list.toString()
                    list.forEach {
                        Log.e("getAttributeByTag", it.toString())
                    }
                }
            })

4. add permission to your menifest
    <!---->
    <uses-permission android:name="android.permission.INTERNET" />

1.url
2.
<img width='236' height='354' class='lazy' alt=' ' src='http://i.meizitu.net/pfiles/img/lazy.png' data-original='http://i.meizitu.net/thumbs/2018/09/150833_14c39_236.jpg' />
img  alt  src 
tag = img
list = ("alt",  "src")

  1. Fork
  2. Feat_xxx
  3. Pull Request

github