秀人集爬虫

 功能:支持全站爬取,搜索爬取。想下载什么内容自己定制,目前版本不支持独立页面下载,后续可能会考虑支持,目前我的目标是为了爬取整个网站,所以单页面下载功能不一定会做,即使做了也不一定什么时候会上。 参数说明:

xiurenji.exe 可执行文件名称
帮助:
-h 显示帮助说明
必选参数:
-a 整站爬取
-q 搜索爬取,针对关键字搜索之后对于搜索结果页进行爬取
可选参数:
-p 制定下载目录,默认下载路径为当前exe所在目录下的images文件夹

效果:

C:\Users\obaby>F:\Pycharm_Projects\meitulu-spider\dist\xiurenji\xiurenji.exe -q 丝袜
****************************************************************************************************
       _           _             ____
  ___ | |__   __ _| |__  _   _  / __ \ _ __ ___   __ _ _ __ ___
 / _ \| '_ \ / _` | '_ \| | | |/ / _` | '_ ` _ \ / _` | '__/ __|
| (_) | |_) | (_| | |_) | |_| | | (_| | | | | | | (_| | |  \__ \
 \___/|_.__/ \__,_|_.__/ \__, |\ \__,_|_| |_| |_|\__,_|_|  |___/
                         |___/  \____/

秀人集爬虫
Verson: 21.6.21
Blog: http://www.h4ck.org.cn
****************************************************************************************************
****************************************************************************************************
[*] 2021-06-21 20:59:36 QRY: 丝袜 开始搜索......
****************************************************************************************************
[*] 2021-06-21 20:59:38 QRY: 搜索完成,一共 50页。
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=1
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=2
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=3
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=4
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=5
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=6
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=7
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=8
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=9
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=10
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=11
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=12
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=13
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=14
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=15
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=16
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=17
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=18
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=19
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=20
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=21
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=22
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=23
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=24
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=25
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=26
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=27
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=28
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=29
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=30
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=31
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=32
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=33
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=34
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=35
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=36
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=37
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=38
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=39
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=40
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=41
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=42
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=43
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=44
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=45
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=46
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=47
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=48
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=49
[*] 2021-06-21 20:59:38 QRY: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=50
[*] 2021-06-21 20:59:38 QRY: 搜索完成,准备下载。
****************************************************************************************************
****************************************************************************************************
[*] 2021-06-21 20:59:39 PAGE: 开始分析页面链接
[*] 2021-06-21 20:59:39 PAGE: https://www.xiurenji.cc/plus/search/index.asp?keyword=%CB%BF%CD%E0&searchtype=titlekeywords&p=1
[*] 2021-06-21 20:59:39 DOWNLOAD: 开始下载:[YouMi尤蜜荟]Vol.651_嫩模蓝夏Akasha私房低胸吊裙配肉丝裤袜秀翘臀诱惑写真42P
[*] 2021-06-21 20:59:39 DOWNLOAD: http://www.xiurenji.cc/YouMi/8493.html
[*] 2021-06-21 20:59:39 DOWNLOAD: 下载目录:[YouMi尤蜜荟]Vol.651_嫩模蓝夏Akasha私房低胸吊裙配肉丝裤袜秀翘臀诱惑写真42P
[*] 2021-06-21 20:59:40 IMG: 正在下载:http://www.xiurenji.cc/uploadfile/202106/21/7516653888.jpg
[*] 2021-06-21 20:59:40 IMG: 图片保存路径:F:\Pycharm_Projects\meitulu-spider\dist\xiurenji\images/[YouMi尤蜜荟]Vol.651_嫩模蓝夏Akasha私房低胸吊裙配肉丝裤袜秀翘臀诱惑写真42P\67ea4b8c9babc3539a65c22749e40cc3.jpg

下载效果: 1hr下载量: 下载连接:

温馨提示: 此处隐藏内容需要发表评论,并且审核通过后才能查看。
(发表评论请勾选 在此浏览器中保存我的显示名称、邮箱地址和网站地址,以便下次评论时使用。
(请仔细检查自己的昵称和评论内容,以免被识别为垃圾评论而导致无法正常审核。)

文件哈希:

名称: xiurenji.rar
大小: 8039801 字节 (7851 KiB)
SHA256: 781AE36CA75D678974E152194BE0C61EE7B9EBF2E62E2DED2FA7BDA38F6CC28F
☆版权☆

* 网站名称:obaby@mars
* 网址:https://obaby.org.cn/
* 个性:https://oba.by/
* 本文标题: 《秀人集爬虫》
* 本文链接:https://obaby.org.cn/2021/06/8353
* 短链接:https://oba.by/?p=8353
* 转载文章请标明文章来源,原文标题以及原文链接。请遵从 《署名-非商业性使用-相同方式共享 2.5 中国大陆 (CC BY-NC-SA 2.5 CN) 》许可协议。


You may also like

108 comments

  1. Level 2
    Microsoft Edge 128 Microsoft Edge 128 Windows 10 Windows 10 cn中国–四川–成都 电信

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
    File “urllib3\connectionpool.py”, line 699, in urlopen
    File “urllib3\connectionpool.py”, line 382, in _make_request
    File “urllib3\connectionpool.py”, line 1010, in _validate_conn
    File “urllib3\connection.py”, line 353, in connect
    File “urllib3\connection.py”, line 181, in _new_conn
    urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没有反应,连接尝试失败。

    这是因为什么呢

      1. Level 2
        Microsoft Edge 128 Microsoft Edge 128 Windows 10 Windows 10 cn中国–四川–成都 电信

        大佬可以帮忙指出一下是哪里的问题吗 我这边不是很熟悉这个操作 求解答

  2. Level 2
    Microsoft Edge 128 Microsoft Edge 128 Windows 10 Windows 10 cn中国–四川–成都 电信

    那这个应该看哪个地址 是IPv4还是dns的 我这边dns有两个 那具体应该看哪个嘞 找到了正确的服务器地址应该怎么修改

发表回复

您的邮箱地址不会被公开。 必填项已用 * 标注