Automation and scraping
106 repos on our list for this job.
Ranked by a score of how recently it was updated, contributors, growth, stars gained and total stars, and releases. How we rank
Featured
| Rank | Name |
|---|---|
| 1. | firecrawl /firecrawl Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥 199,902 stars+1,906 this week |
| 2. | iFurySt /open-computer-use 👾 Open Computer Use – Open-Source Alternative to Codex Computer Use 2,900 stars+75 this week |
| 3. | fastcrw /crw Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud. 1,237 stars+26 this week |
| 4. | agent-sh /computer-use-linux Native Linux desktop control for AI agents (MCP, Pi, CLI): semantic AT-SPI trees, screenshots, window targeting, and input across GNOME, KDE, Hyprland, niri, COSMIC, i3, Sway, labwc and other wlroots compositors, and X11. 831 stars+45 this week |
| 5. | agentrhq /webcmd Self-learning agent browser 2,768 stars+13 this week |
| 6. | amontlabs /lcu Codex computer use, decoupled from the app, for usage inside any harness. 2,398 stars+35 this week |
| 7. | ProxyShard /ShardBrowser Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ShardX team (formerly ProxyShard). Engine-level fingerprint spoofing in Chromium 157 (WebGL / WebGPU / Client Hints / fonts / TLS), 220+ device profiles bundled, stable QUIC + WebRTC over SOCKS5. 1,463 stars+76 this week |
| 8. | nano-muse /nanoMuse nanoMuse: an open-source personal agent for every device you own. One agent with a name and a look of its own that does things, keeps working while the app is closed, remembers you, and asks before anything you cannot undo. On Android, iPhone and iPad, Windows / macOS / Linux and in the browser; your phone's screen and your computer as its hands. 3,341 stars+264 this week |
| 9. | jackwener /OpenCLI Make Any Website into CLI & Use your logged-in browser by AI agent. 30,974 stars+150 this week |
| 10. | xlang-ai /OSWorld-V2 OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks 412 stars+7 this week |
| 11. | awlevin /typesafe-computer-use Computer use for about $0.0002 a step: OCR the screen, classify the next action with TypeSafe, click. macOS. 1,294 stars+14 this week |
| 12. | eatmoreduck /boss-zhipin-scraper Boss直聘爬虫 / BOSS直聘职位数据抓取工具,基于 Chrome CDP 协议复用真实登录态,绕过字体反爬,输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler. 1,729 stars+43 this week |
| 13. | Yu-tao-Li /dsh-computer-use-win DeepSeek Harness的Windows电脑操控插件 / Windows computer use for DeepSeek Harness 605 stars+151 this week |
| 14. | agent-labs-dev /fastbrowse A fast browser agent: Jev picks each action from what is on the page, an LLM reads and plans, and every claim in an answer cites a quote from the page. 220 stars+49 this week |
| 15. | clearcotelabs /clearcote-browser Open-source stealth Chromium with engine-level fingerprint spoofing - de-Googled, drop-in Playwright, fully buildable and verifiable from source. 248 stars+12 this week |
| 16. | socai-io /jev-social Open-source, local-first social media research agent for Instagram, TikTok, and LinkedIn. Jev routes read-only steps; socai CLI captures cited browser evidence. 207 stars+13 this week |
| 17. | Sentient-OS-Labs /sentient-os An on-device LLM understands your entire life, then proactively offers to get your work done through computer use. 716 stars+23 this week |
| 18. | feder-cr /invisible_playwright_mcp Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use. 877 stars+14 this week |
| 19. | Osmantic /ODS ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server. 7,801 stars+56 this week |
| 20. | browser-use /browser-use Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API. 120,380 stars+543 this week |
| 21. | unclecode /crawl4ai Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it. 87,122 stars+346 this week |
| 22. | browserbase /stagehand The SDK to extract data and interact with any site on the web. Get started with Claude Code, Codex, Eve, Mastra, and more. 25,988 stars+82 this week |
| 23. | CloakHQ /CloakBrowser Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed. 32,787 stars+113 this week |
| 24. | iFurySt /open-browser-use 🔮 Platform-neutral Browser Use for AI agents: real Chrome automation with a CLI + SDKs, no lock-in, dead simple. 418 stars+9 this week |
| 25. | Evil0ctal /Douyin_TikTok_Download_API 🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up. 21,301 stars+202 this week |
New to our list
| Name |
|---|
| AKamaly /CludeGods Always-on AI Gods that work inside Claude Code, and you can talk to them. Proactive workers, computer use (browser, terminal & files), real-time voice like Jarvis, workers on a call in their own voice, Slack, and Spaces for your projects. 51 stars+2 this week |
| alchaincyf /huashu-chrome 让任何 AI agent 操控你自己的 Chrome——带着全部登录态。MCP + Chrome 扩展,Claude Code / Codex / Cursor / Gemini CLI 通用。 579 starsThis week: Not stated |
| alibaba /qz-browser-agent Local-first AI agent for Chrome: browser automation, web research, and data extraction with your own model. 213 stars+48 this week |
| fatsearch /fatsearch Search and read the web for AI agents at 99% fewer tokens. Free CLI + MCP. 131 stars+79 this week |
| outcrawlai /scout Scout: the open-source browser agent, by Outcrawl. Mirrored automatically from Outcrawl's own repository. 743 stars+3 this week |
| rayobyte-data /rayobrowse Stealth Chromium browser for web scraping and AI agents. 214 starsThis week: Not stated |
| TIGER-AI-Lab /WebsiteBench Can AI agents rebuild websites through browser exploration? 144 stars+121 this week |
| YOLOW92 /pagesift Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary. 255 stars+68 this week |
More repos in this job
| Rank | Name |
|---|---|
| 26. | browser-use /browser-harness Let Claude Code, Codex or Cursor use your real Chrome, logged in as you. One prompt to set up. Open source, MIT. 18,965 stars+142 this week |
| 27. | adbar /trafilatura Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML 7,103 stars+43 this week |
| 28. | ScrapeGraphAI /Scrapegraph-ai Python scraper based on AI 32,645 stars+213 this week |
| 29. | ovobrowsersupport /ovobrowser 源码级 Chromium 指纹内核,检测站按普通 Chrome 评分。Source-level Chromium fingerprint kernel that passes bot detection tests. Not JS injection — C++ patches compiled into the binary. 1,125 stars+75 this week |
| 30. | OpenAdaptAI /OpenAdapt For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match. 1,869 stars+9 this week |
| 31. | yail259 /frankensurf One read() call for AI agents, stitched from 41 web tools. 110 stars+2 this week |
| 32. | ThinkFlowLab /system1-agents System 1 decision models (Jev, Laya, Cua-S1) as brain for agents: Browser use, computer use, games and robotics 181 stars+2 this week |
| 33. | Skyvern-AI /skyvern Automate browser based workflows with AI 23,367 stars+49 this week |
| 34. | dondai44423 /bladebro A Fully free agentic browser driver for AI , few tools, full control, real stealth, top-tier token efficiency. 344 stars+4 this week |
| 35. | nodemaven /google-browser-scraper Self-hosted Google search scraper for Python. Scrape Google SERP results with a real Chrome browser and your own residential proxy. Self-hosted SERP API alternative with JSON output, an HTTP API and an MCP server for AI agents. 113 stars+9 this week |
| 36. | clawbrowser /clawbrowser Agent-native browser with fingerprint control and proxy support. 138 stars+2 this week |
| 37. | steel-dev /steel-browser 🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure. 7,939 stars+31 this week |
| 38. | e2b-dev /open-computer-use AI computer use powered by open source LLMs and E2B Desktop Sandbox 2,407 stars+13 this week |
| 39. | sosoj92 /jarvis-assistant-vocal Assistant vocal local en francais : Claude ou Ollama (offline), domotique Hue, OBS, agenda, navigateur, appels Twilio, serveur MCP. Python. 549 stars+6 this week |
| 40. | chienbm98 /foxprofile Free, open-source anti-detect browser profile manager: per-profile fingerprint, cookies and proxy, Camoufox and Chrome engines, desktop app, REST API and MCP server for AI agents. Self-hosted alternative to GoLogin / MoreLogin. 189 stars+6 this week |
| 41. | Player-YN /BrowserKitten A Chrome side-panel agent for your signed-in browser. Read pages, take action, create files, and run local follow-ups. Bring your own models. 2,383 stars+4 this week |
| 42. | Ying-Kai-Liao /jev-browser Browser automation where an LLM plans and Jev (Typesafe System One) decides. Library, CLI and MCP server. 132 stars+4 this week |
| 43. | alibaba /page-agent JavaScript in-page GUI agent. Control web interfaces with natural language. 29,650 stars+35 this week |
| 44. | Youzini-afk /Varin The open-source agent harness, ready out of the box and customizable in depth. Tools, context, durable execution, permissions and recovery for code, research and office work, with a long-running super-agent Bot that leads a team of agents. 142 stars+70 this week |
| 45. | WeWorker /WeWorker Open-source desktop AI agent that takes real actions on websites — 33 adapters for mail, shopping, social, and more. 200 stars+42 this week |
| 46. | simular-ai /Agent-S Agent S: the state-of-the-art open source computer use agents 12,911 stars+53 this week |
| 47. | OmniJev /OneJev 🚀🚀 A multimodal System One decision model that gives calibrated answers to typed questions about screens, photos, video and text in one forward pass. 251 stars+32 this week |
| 48. | LvcidPsyche /auto-browser Give your AI agent a real browser — with a human in the loop. Open-source MCP-native browser agent. 924 stars+7 this week |
| 49. | only-cli /oc Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands. 551 stars+4 this week |
| 50. | nanobrowser /nanobrowser Open-source AI agent for web automation. Use your real, logged-in browser to automate daily tasks. 14,265 stars+44 this week |
| 51. | quantumproxies /quantumproxies.io Residential, datacenter, ISP & mobile proxies with 90M+ IPs in 200+ countries — plus Scraper & SERP APIs. Code examples in Python, Node.js, PHP, Go, Java, C#, Ruby and curl. 778 stars-1 this week |
| 52. | seleniumbase /SeleniumBase Browser automation, web scraping, and testing. CDP Mode provides a Stealthy Chromium instance that bypasses bot-detection systems. Includes an MCP server. 13,233 stars+19 this week |
| 53. | redf0x1 /camofox-browser Anti-detection browser server for AI agents — REST API wrapping Camoufox engine with OpenClaw plugin support 438 stars+3 this week |
| 54. | NopeCHALLC /nopecha-extension Automated CAPTCHA solver for your browser. Works with Selenium, Puppeteer, Playwright, and more. 11,099 stars+16 this week |
| 55. | bytedance /UI-TARS-desktop The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra 39,583 stars+71 this week |
| 56. | awss1i /assay An agent-native QA CLI for web pages. Deterministic, no tests to write, no LLM. 110 stars+1 this week |
| 57. | Sriram-PR /doc-scraper Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data) 109 stars+1 this week |
| 58. | agent-sandbox /agent-sandbox Agent-Sandbox is an easy-to-use, enterprise-grade sandbox platform for AI Agents — letting them securely run untrusted LLM-generated code, Browser use, Computer use, and deploy websites, among other tasks. 231 stars+2 this week |
| 59. | tmseidel /ai-git-bot The self-hosted AI workflow automation platform for Git repositories. 196 stars+2 this week |
| 60. | affromero /flight-finder Self-hosted flight, hotel, and car rental price tracking with alerts, price history, and web and CLI interfaces. 185 stars+3 this week |
| 61. | savka777 /jev-use Say it, and your Mac does it. A computer-use harness on Jev that reads the screen through Accessibility. Fast, no vision model 130 stars+1 this week |
| 62. | alexvilelabah /bah-browser Open-source AI browser agent — type plain-language commands and Bah operates the web for you. Works with cloud AI (DeepSeek, Mistral, NVIDIA) or local Ollama models. 108 stars+1 this week |
| 63. | xberg-io /crawlberg Turn any website into clean, structured data: Markdown, metadata and links from one page or a whole site, in every major language. 196 stars+1 this week |
| 64. | AIPexStudio /AIPex AIPex: AI browser automation assistant, no migration and privacy first. Alternative to Manus Browser Operator、 Claude Chrome and Agent Browser 1,283 stars+4 this week |
| 65. | alirezamika /autoscraper A Smart, Automatic, Fast and Lightweight Web Scraper for Python 8,080 stars+10 this week |
| 66. | vb2250158 /RabiRoute Self-hosted message gateway for AI agents: Codex, QQ, WeChat/WeCom, Feishu, smart devices and desktop automation. | AI 消息网关:连接聊天、智能设备与 Agent,支持定时任务和角色上下文。 492 stars0 this week |
| 67. | henrique-coder /perplexity-webui-scraper An advanced, high-performance Python client, MCP server, and REST API for reverse-engineering Perplexity AI's WebUI. 142 stars+2 this week |
| 68. | lewisdonovan /google-news-scraper Lightweight scraper for Google News 384 stars0 this week |
| 69. | Johell1NS /browser-search A skill for AI agents: search the web with SearXNG, browse with Camofox, bypass protections with CloakBrowser. Anti-hallucination by design. Self-hosted, free, unlimited. 543 stars+4 this week |
| 70. | fullselfbrowsing /FSB DOM-first AI browser automation for Chrome and MCP clients. 205 stars+1 this week |
| 71. | MigoXLab /webqa-agent Autonomous web browser agent that audits performance, functionality & UX for engineers and vibe-coding creators. 网站自主评估测试 Agent,支持 GUI/CLI 一键完成性能、功能使用与交互体验的测试评估 240 stars0 this week |
| 72. | lidge-jun /aside-codemode One call where Aside used to spend fifty — rg-backed search, Aside-shaped file tools, and batched browser work inside a single sandboxed JavaScript block. On a real folder, 55s of find+grep became 1s. 129 stars0 this week |
| 73. | olo-dot-io /Uni-CLI One command for every interface—search, run, and inspect real software across APIs, browsers, desktops, local tools, and MCP. 228 stars0 this week |
| 74. | Deodat-Lawson /LaunchStack AI-powered StartUp Accelerator Engine built with Next.js, LangChain, PostgreSQL + pgvector. Upload, organize, and chat with documents. Includes predictive missing-document detection, role-based workflows, and page-level insight extraction. 896 stars+2 this week |
| 75. | alex-on-ai /WebReaper AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl. 152 stars0 this week |
| 76. | opentabs-dev /opentabs Browser automation clicks buttons. OpenTabs calls APIs. 1,017 stars+9 this week |
| 77. | TurixAI /TuriX-CUA This is the official website for TuriX Computer-use-Agent 3,176 stars+1 this week |
| 78. | StoneSteel27 /AutomatiQ Simplify Web Reverse-engineering for AI Agents 179 stars+1 this week |
| 79. | michaljach /opencode-browser Browser automation plugin for OpenCode AI editor - Control Chrome/Edge with AI, automate web testing, scraping & form filling via MCP integration 114 stars+1 this week |
| 80. | vakra-dev /reader Open source web infrastructure for AI. Scrape, crawl, and automate the web, clean markdown, browser sessions, ready for your agents. 562 stars+1 this week |
| 81. | itsOwen /CyberScraper-2077 A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama 3,298 stars-1 this week |
| 82. | foxhui /WebAI2API WebAI2API: 基于 Camoufox 的网页 AI 转 API 工具,支持 LMArena/Gemini等,多窗口并发与账号隔离。 | Web AI to OpenAI API via Camoufox. Supports LMArena/Gemini and more, multi-window concurrency & account isolation. 1,424 stars+6 this week |
| 83. | Jeomon /Web-Use Web-Use is a CDP powered Browser Agent 303 stars+2 this week |
| 84. | vmDeshpande /ai-agent-automation Modular AI agent workflow automation platform with schedulers, tools, and observability. https://vmdeshpande.github.io/ai-automation-platform-website/ 178 stars0 this week |
| 85. | apiguru-app /amazon-scraper-v2 Agent-ready Amazon Scraper API: real-time product details (batch ASIN), offers & stock, reviews, search, best sellers, deals and seller data across 20 marketplaces. One pasted line for Claude Code / Codex / Cursor, an MCP server, or plain HTTP with 3 free calls a day and no key. Python examples inside. 227 stars+1 this week |
| 86. | Bin-Huang /camoufox-cli Anti-detect browser automation CLI & Skills for AI agents — Camoufox-powered fingerprint spoofing, no bot-detectable Playwright leaks 360 stars+2 this week |
| 87. | woniu9524 /open-web-bridge Drive your real Chrome from any AI agent — logged-in sessions, real fingerprint, live tabs. CLI-based, works with OpenCode, Pi, or any Harness. 114 stars0 this week |
| 88. | mdowis /anansi A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server so any LLM can drive a full crawl by conversation. 117 stars0 this week |
| 89. | FronkonGames /Steam-Games-Scraper Extract information from all games published in Steam thanks to its Web API, and store it in JSON format. 167 stars+2 this week |
| 90. | m92vyas /llm-reader Turn Webpage to LLM friendly input text. Similar to Firecrawl and Jina Reader API. Makes RAG, AI web scraping, image & webpage links extraction easy. 315 stars+1 this week |
| 91. | mishushakov /llm-scraper Turn any webpage into structured data using LLMs 6,953 stars+4 this week |
| 92. | paulpierre /markdown-crawler A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG 480 stars+1 this week |
| 93. | ShuxinYang111 /oysterworkflow Teach AI how your work actually gets done. Capture real computer work, extract the workflow graph and judgment, then run it with Codex or your own agent. 175 stars0 this week |
| 94. | ai-naymul /BrowserPilot Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined 180 stars0 this week |
| 95. | X-isdoingreat /canvas-pilot Local-first Canvas LMS AI agent that learns each course's recurring assignment workflow and reuses it through scan -> approval -> execute with student review. 125 stars0 this week |
| 96. | oxbshw /Open-Workflow-Library Open workflow intelligence for discovering, validating, repairing, and generating automation workflows across frameworks — starting with n8n. 557 stars0 this week |
| 97. | EthanXiang777 /ash-agents A swarm of disposable agents for unattributable web interaction 414 stars-3 this week |
| 98. | rodricios /wxpath wxpath - declarative web crawling with XPath; a Web Query Language (WQL) 110 stars0 this week |
