Scrapy by scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
pythonscrapingcrawlingframeworkcrawlerhacktoberfestweb-scrapingweb-scraping-python
Verdict 78/100 health $4.13/mo cheapest, hetzner 2/5 setup difficulty 3 open CVEs Last release 9 days ago
Health score
78 /100
6-dim composite
Self-hosts from
$4.13 /mo
hetzner · CAX11
Difficulty
2 /5
Docker + read README
GitHub stars
62k
12k forks
Health score breakdown
6-dimension composite. See methodology for formula and weights.
activity
89
maturity
100
community
84
security
85
sustainability
65
adoption
45
Adoption signals
Real-world usage data, pulled from each registry. The bigger the numbers, the more battle-tested the project.
| Signal | Value | Source |
|---|---|---|
| GitHub stars | 62k | github.com/scrapy/scrapy |
| GitHub forks | 12k | github.com/scrapy/scrapy |
| PYPI downloads (last month) | 3252k | scrapy |
Release & maintenance
Is this project actively maintained, or about to die? Check the recency of last commit and last release.
| Project age | 16.2 years | since Feb 2010 |
| Last commit | 3 days ago | May 4, 2026 |
| Releases shipped | 50 | last: 9 days ago |
| Security policy | SECURITY.md | declared by maintainers |
Self-hosting cost across providers
Detected requirements: 4GB RAM, 40GB disk minimum. Cheapest plan per provider that meets the requirement.
| Provider | Plan | Specs | Monthly | |
|---|---|---|---|---|
| hetzner | CAX11 | 2c · 4GB · 40GB | $4.13 USD | Deploy → |
| vultr | VC2 | 1c · 1GB · 25GB | $5 USD | Deploy → |
| linode | Nanode 1GB | 1c · 1GB · 25GB | $5.12 USD | Deploy → |
| digitalocean | Basic Regular 1GB | 1c · 1GB · 25GB | $6 USD | Deploy → |
Security advisories
25 known advisories tracked via OSV.dev.
3 currently open without a documented fix. Most recent:
GHSA-cwxj-rr6w-m6w7. What people say on Hacker News
- US threatens to scrap EU visa waivers over data sharing demands
- Show HN: I built a web builder after 6 years of trying
- Show HN: Hackamaps – A global hackathon map I build after hitting Lovable Limits
- Public Libraries Scrap Late Fines to Alleviate Inequity (2019)
- China pushes EU capitals to scrap 'Made in Europe' law or face retaliation
Ready to self-host Scrapy?
Spin up a hetzner CAX11 (4GB RAM, 40GB disk) for $4.13/mo and follow the project's official install docs.
Data last refreshed May 7, 2026.
Similar open-source projects
Projects in our directory that replace the same SaaS or share topics with Scrapy.
core
:house_with_garden: Open source home automation that puts local control and privacy first.
fiber
⚡️ Express inspired web framework written in Go
nuxt
The Full-Stack Vue Framework.
aiohttp
Asynchronous HTTP client/server framework for asyncio and Python
fastapi
FastAPI framework, high performance, easy to learn, fast to code, ready for production
InvenTree
Open Source Inventory Management System