ScrapeGraphAI / Scrapegraph-ai
Python scraper based on AI
Why this job: says: scraper; topics: web-scraping, crawler, web-crawler
What it does
ScrapeGraphAI is a *web scraping* python library that uses LLM and direct graph logic to create scraping pipelines for websites and local documents (XML, HTML, JSON, Markdown, etc.).
Get started
pip install scrapegraphai
# IMPORTANT (for fetching websites content)
playwright install- Maintenance
- Active
- Last commit 34 days ago
- Stars
- 32,645
- +213 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v2.3.1
- Released 34 days ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- 10
- Last 90 days
- Issues
- 98% closed
- 9 still open
- Pull requests
- 527 merged
- 22 waiting
- Releases
- 460
- 30+ in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| firecrawl / firecrawl | 199,902 | today | AGPL-3.0 | No downloads |
| unclecode / crawl4ai | 87,122 | 5 days ago | Apache-2.0 | No downloads |
| vakra-dev / reader | 562 | 34 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 100%
- Makefile <1%
- Dockerfile <1%
Topics
- scraping
- scraping-python
- llm
- web-crawler
- web-scraping
- ai-scraping
- crawler
- markdown
- rag
- web-crawlers
- ai-crawler
- ai-search
Project record
- JobAutomation and scraping
- StatusListed
- Commits2,966
- Forks3,328
- Watching178
- Stars in 28 days+972
- CreatedJan 27, 2024
- First seen by usNov 7, 2026
- CheckedNov 9, 2026