spider
Tracked open-source repos tagged spider, sorted by stars.
- #61★ 956+0Star change over the last 7 days
- #62★ 933+1Star change over the last 7 days
- #63
爬虫逆向案例，已完成：TLS指纹｜瑞数｜震坤行 | 网易易盾 | 微信小程序反编译逆向(百达星系) | 同花顺 | rpc解密 | 加速乐 | 极验滑块验证码 | 巨量算数 | Boss直聘 | 企查查 | 中国五矿 | qq音乐 | 产业政策大数据平台 | 企知道 | 雪球网(acw_sc__v2) | 1688 | 七麦数据 | whggzy | 企名科技 | mohurd | 艺恩数据 | 欧科云链
★ 914+4Star change over the last 7 days - #64
:point_right:一个基于spring boot 实现的java股票爬虫(仅支持A股)，如果你:heart:请:star: . V2升级版正在开发中！
★ 846-1Star change over the last 7 days - #65
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
★ 836+0Star change over the last 7 days - #66
A set of spiders and scrapers to extract location information from places that post their location on the internet.
★ 822+5Star change over the last 7 days - #67
基于中国国家图书馆ISBN检索的calibre的source/metadata插件。https://doiiars.com/article/NLCISBNPlugin
★ 793+2Star change over the last 7 days - #68
A Penetration Testing Framework, Information gathering tool & Website Vulnerability Scanner
★ 782+1Star change over the last 7 days - #69
🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON.
★ 776+0Star change over the last 7 days - #70
A lightweight web crawler framework.（Java爬虫框架）
★ 760-1Star change over the last 7 days - #71
:newspaper: Let ChatGPT Summarize Hacker News for You
★ 756+0Star change over the last 7 days - #72
Signal 18 repman - Replication Manager for MySQL / MariaDB / Percona Server
★ 739+0Star change over the last 7 days - #73
轻小说打包器，采集哔哩轻小说网站(bilinovel.com linovelib.com)内容，打包成EPUB格式，支持封面、插图、目录，支持分卷合并。
★ 735+6Star change over the last 7 days - #74
Python短视频去水印爬虫：抖音,皮皮虾,火山,微视,最右,快手,全民小视频,皮皮搞笑,西瓜视频,虎牙,梨视频,acfun,好看视频...
★ 692+7Star change over the last 7 days - #75
狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑 an enterprise-grade public opinion news crawler project: supports one-click operation of any number of crawlers, scheduled crawler tasks, batch deletion of crawlers; one-click deployment of crawlers
★ 686+1Star change over the last 7 days - #76★ 676+2Star change over the last 7 days
- #77★ 669+1Star change over the last 7 days
- #78
Krawl is a customizable, lightweight, cloud-native web deception server and anti-crawler that creates fake web applications with low-hanging vulnerabilities using realistic, randomly generated decoy data and AI-generated HTML templates.
★ 646+4Star change over the last 7 days - #79
NetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
★ 646+0Star change over the last 7 days - #80
问卷调查项目，云服务器推荐，挂机项目，免费代理，各种脚本收集。欢迎右上角点铃铛及时收取更新信息。(不要fork，低调) Questionnaire project, cloud server recommendation, hanging project, free proxy, various script collection. Welcome to the upper right corner of the point bell to receive timely updates. (Do not fork, low profile)
★ 643+1Star change over the last 7 days - #81
spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版
★ 613+0Star change over the last 7 days - #82
Python 3 script to dump/scrape/extract company employees from LinkedIn API
★ 611+1Star change over the last 7 days - #83★ 560+1Star change over the last 7 days
- #84
FreeProxy: Collecting free proxies from internet. (全球海量高质量免费代理，支持爬取数十个免费代理分享源，支持自定义规则代理筛选，爬虫与数据分析必备，每日更新海量免费代理。)
★ 534+8Star change over the last 7 days - #85
🎯 哔哩哔哩(bilibili)评论区数据可视化分析软件-- up主可用于指导自己的题材选择，明确自己的粉丝群体
★ 528+2Star change over the last 7 days
