Latest Crawlee News & Updates

Crawlee releases v4.0.0-rc.1 pre-release with breaking changes and new features

This release moves packages out of the monorepo, introduces DomCrawler and OpenTelemetry instrumentation, and fixes HTTP redirect handling for credentials and cookies.

Crawlee releases v3.16 with StagehandCrawler

Introduces AI-powered StagehandCrawler for natural language web interactions, async iterators for Dataset and KeyValueStore, discoverValidSitemaps utility, and enhanced Cloudflare handling.

Crawlee releases Crawlee for Python v1

It moves from beta to stable and follows semantic versioning. New features include unified storage clients, AdaptivePlaywright, Impit HTTP client, sitemap loader, robots.txt support, fingerprinting, and OpenTelemetry.

Crawlee announces release of version 3.14.0

This release includes bug fixes and new features such as the maxCrawlDepth crawler option and improvements in request queue validation. The update was published on 2025-07-25.

Crawlee for Python: Build a Bounded Web Crawler - DEV Community

Crawlee is most useful when your task has moved beyond “fetch one URL.” It gives you a crawl loop...

Apify Announces the Launch of Crawlee for Python

Crawlee: Crawlee helps you build reliable crawlers. Fast. | Product Hunt

Crawlee is an intuitive, customizable open-source library for web scraping and browser automation. Quickly scrape data, store it, and avoid getting blocked with auto-generated human-like...

Announcing Crawlee: the web scraping and browser automation library

Crawlee is an open-source web scraping and automation library that helps you build reliable scrapers. Fast.