spider-rs/spider

Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust

↗ Open on GitHub

Stars

2,687

Forks

287

Language

Rust

License

MIT

Last push

1 week ago

Rust rust ai-agent automation crawler scraping web-scraping spider web-crawler headless-chrome web-data

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.