Latest Crawlee News & Updates

See the latest news and media coverage for Crawlee. We track all announcements, press releases, and industry mentions in real time, all in one place.

Company icon
Crawlee

Web scraping library for JavaScript and Python

crawlee.dev

Last updated

Latest news about Crawlee

In short: Crawlee released the version 4.0.0 candidate and transitioned its Python library to stable version 1, enhancing its scraping toolset.

Company announcements

Crawlee

Crawlee released v4.0.0-rc.0

A release candidate for version 4.0.0, tagged by Martin Adámek on 12 Aug, including a fix for 403 responses in camoufox-cloudflare e2e tests.

Crawlee

Crawlee releases version 3.16.0

Includes bug fixes, new features like @crawlee/stagehand package, and performance improvements across multiple packages.

Crawlee

Crawlee releases v3.16 with StagehandCrawler

Introduces AI-powered StagehandCrawler for natural language web interactions, async iterators for Dataset and KeyValueStore, discoverValidSitemaps utility, and enhanced Cloudflare handling.

Unlock all announcements with a

Media coverage

GitHub

Per-Domain Throttling (SQL storage)

I'm crawling thousands of domains using 10+ workers processing requests from a shared PostgreSQL request queue. I need per-domain rate limiting (e.g., "max 10 requests/minute...

GitHub

A web scraping and browser automation library

Crawlee covers your crawling and scraping end-to-end and helps you build reliable scrapers. Fast. Your crawlers will appear human-like and fly under the radar of...

Unlock all articles with a

Never miss news about Crawlee

Track Crawlee and your other target companies to get real-time alerts and weekly summaries delivered straight to your inbox.