scraper
Tracked open-source repos tagged scraper, sorted by stars.
- #31
Node.js scraper to get data from Google Play
★ 2,956+4Star change over the last 7 days - #32
Learn step-by-step how to scrape Google Trends data and make a result comparison using Python and Oxylabs SERP API. Extract keywords, their popularity, breakdown by region, related queries, and more.
★ 2,909+35Star change over the last 7 days - #33
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
★ 2,776+0Star change over the last 7 days - #34
Scrape metadata from any URL using Open Graph, JSON-LD, HTML meta tags, and smart fallbacks.
★ 2,734+2Star change over the last 7 days - #35
Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.
★ 2,732+14Star change over the last 7 days - #36★ 2,690-1Star change over the last 7 days
- #37
Downloads and archives content from reddit
★ 2,608+1Star change over the last 7 days - #38
Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up
★ 2,599+222Star change over the last 7 days - #39
Transform Web Content into LLM-Ready Data
★ 2,158+32Star change over the last 7 days - #40
Node.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
★ 2,139+4Star change over the last 7 days - #41
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
★ 2,105-1Star change over the last 7 days - #42
NewPipe's core library for extracting data from streaming sites
★ 1,960+3Star change over the last 7 days - #43
Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API. https://oxylabs.io/blog/how-to-scrape-google-jobs
★ 1,767+35Star change over the last 7 days - #44
Google Play Scraper for collecting public details about applications, games, movies & TV shows, books, and more.
★ 1,757+24Star change over the last 7 days - #45
Download website to local directory (including all css, images, js, etc.)
★ 1,751-1Star change over the last 7 days - #46
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
★ 1,671+4Star change over the last 7 days - #47★ 1,662+0Star change over the last 7 days
- #48
Completely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
★ 1,634+2Star change over the last 7 days - #49
Scrape tweets, profiles, followers and following from Twitter/X, no API key needed. Python library with smart multi-account pooling, proxy support and async.
★ 1,607+2Star change over the last 7 days - #50★ 1,554+0Star change over the last 7 days
- #51
A highly efficient, fast, powerful and light-weight anime downloader and streamer for your favorite anime.
★ 1,522+0Star change over the last 7 days - #52
电视剧/番剧自动化重命名工具, 一键批量改名. 可配合QBittorrent下载后自动重命名, 方便Emby自动刮削. 支持Windows, Linux, MacOS, Docker 和 群晖套件环境运行
★ 1,491+0Star change over the last 7 days - #53
An ergonomic, privacy-aware Python HTTP Client
★ 1,438+1Star change over the last 7 days - #54★ 1,386+1Star change over the last 7 days
- #55
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
★ 1,360+0Star change over the last 7 days - #56
Get Instagram posts/profile/hashtag data without using Instagram API
★ 1,352+1Star change over the last 7 days - #57★ 1,332+1Star change over the last 7 days
- #58
Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb (to which we are not affiliated in any way) movie database about movies, people and characters
★ 1,323+0Star change over the last 7 days - #59
動漫花園 镜像站 | 动画 BT 资源聚合站 | 动画 BT 资源开放接口
★ 1,301+4Star change over the last 7 days - #60
Boss直聘爬虫 / BOSS直聘职位数据抓取工具,基于 Chrome CDP 协议复用真实登录态,绕过字体反爬,输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.
★ 1,282+33Star change over the last 7 days