yujunjun/crawl4ai
1
0
Fork 0
mirror of https://github.com/unclecode/crawl4ai.git synced 2025-12-13 03:20:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
crawl4ai/docs/md_v2/api
History
UncleCode 825c78a048 refactor(dispatcher): migrate to modular dispatcher system with enhanced monitoring 
Reorganize dispatcher functionality into separate components:
- Create dedicated dispatcher classes (MemoryAdaptive, Semaphore)
- Add RateLimiter for smart request throttling
- Implement CrawlerMonitor for real-time progress tracking
- Move dispatcher config from CrawlerRunConfig to separate classes

BREAKING CHANGE: Dispatcher configuration moved from CrawlerRunConfig to dedicated dispatcher classes. Users need to update their configuration approach for multi-URL crawling.
2025-01-11 21:10:27 +08:00
..
arun_many.md
refactor(dispatcher): migrate to modular dispatcher system with enhanced monitoring
2025-01-11 21:10:27 +08:00
arun.md
refactor(dispatcher): migrate to modular dispatcher system with enhanced monitoring
2025-01-11 21:10:27 +08:00
async-webcrawler.md
refactor(dispatcher): migrate to modular dispatcher system with enhanced monitoring
2025-01-11 21:10:27 +08:00
crawl-result.md
refactor(dispatcher): migrate to modular dispatcher system with enhanced monitoring
2025-01-11 21:10:27 +08:00
parameters.md
refactor(dispatcher): migrate to modular dispatcher system with enhanced monitoring
2025-01-11 21:10:27 +08:00
strategies.md
refactor(docs): reorganize documentation structure and update styles
2025-01-07 20:49:50 +08:00