Latest Crawlee News & Updates

See the latest news and media coverage for Crawlee. We track all announcements, press releases, and industry mentions in real time, all in one place.

Company icon
Crawlee

Web scraping library for JavaScript and Python

crawlee.dev

Last updated

Latest news about Crawlee

In short: Crawlee achieved major milestones with the release of version 3.17.0 and the stable launch of its Python library version 1.0.

Company announcements

Crawlee

Crawlee releases version 3.16.0

Includes bug fixes, new features like @crawlee/stagehand package, and performance improvements across multiple packages.

Crawlee

Crawlee releases v3.16 with StagehandCrawler

Introduces AI-powered StagehandCrawler for natural language web interactions, async iterators for Dataset and KeyValueStore, discoverValidSitemaps utility, and enhanced Cloudflare handling.

Crawlee

Crawlee released version 3.15.2

It updates many package versions, fixes launchOptions with useIncognitoPages, enables systemInfoV2 by default, and re-exports MemoryStorage.

Unlock all announcements with a

Media coverage

GitHub

Per-Domain Throttling (SQL storage)

I'm crawling thousands of domains using 10+ workers processing requests from a shared PostgreSQL request queue. I need per-domain rate limiting (e.g., "max 10 requests/minute...

GitHub

A web scraping and browser automation library

Crawlee covers your crawling and scraping end-to-end and helps you build reliable scrapers. Fast. Your crawlers will appear human-like and fly under the radar of...

Unlock all articles with a

Never miss news about Crawlee

Track Crawlee and your other target companies to get real-time alerts and weekly summaries delivered straight to your inbox.