UncleCode d024749633 refactor(deep-crawl): add max_pages limit and improve crawl control ...

Add max_pages parameter to all deep crawling strategies to limit total pages crawled.
Add score_threshold parameter to BFS/DFS strategies for quality control.
Remove legacy parameter handling in AsyncWebCrawler.
Improve error handling and logging in crawl strategies.

BREAKING CHANGE: Removed support for legacy parameters in AsyncWebCrawler.run_many()

2025-03-03 21:51:11 +08:00

..

advanced

feat(browser): add BrowserProfiler class for identity-based browsing

2025-03-02 20:32:29 +08:00

api

Release prep (#749)

2025-02-28 19:53:35 +08:00

assets

docs(multi-url): improve documentation clarity and update examples

2025-01-23 22:33:36 +08:00

basic

Merge branch 'vr0.4.3b2'

2025-01-22 20:51:46 +08:00

blog

Release prep (#749)

2025-02-28 19:53:35 +08:00

core

refactor(deep-crawl): add max_pages limit and improve crawl control

2025-03-03 21:51:11 +08:00

extraction

Feat/llm config (#724)

2025-02-21 15:41:37 +08:00

index.md

feat(crawler): add URL redirection tracking

2025-01-19 19:53:38 +08:00