a9e24307cc
* fix: Update export of URLPatternFilter * chore: Add dependancy for cchardet in requirements * docs: Update example for deep crawl in release note for v0.5 * Docs: update the example for memory dispatcher * docs: updated example for crawl strategies * Refactor: Removed wrapping in if __name__==main block since this is a markdown file. * chore: removed cchardet from dependancy list, since unclecode is planning to remove it * docs: updated the example for proxy rotation to a working example * feat: Introduced ProxyConfig param * Add tutorial for deep crawl & update contributor list for bug fixes in feb alpha-1 * chore: update and test new dependancies * feat:Make PyPDF2 a conditional dependancy * updated tutorial and release note for v0.5 * docs: update docs for deep crawl, and fix a typo in docker-deployment markdown filename * refactor: 1. Deprecate markdown_v2 2. Make markdown backward compatible to behave as a string when needed. 3. Fix LlmConfig usage in cli 4. Deprecate markdown_v2 in cli 5. Update AsyncWebCrawler for changes in CrawlResult * fix: Bug in serialisation of markdown in acache_url * Refactor: Added deprecation errors for fit_html and fit_markdown directly on markdown. Now access them via markdown * fix: remove deprecated markdown_v2 from docker * Refactor: remove deprecated fit_markdown and fit_html from result * refactor: fix cache retrieval for markdown as a string * chore: update all docs, examples and tests with deprecation announcements for markdown_v2, fit_html, fit_markdown
3.2 KiB
3.2 KiB
Contributors to Crawl4AI
We would like to thank the following people for their contributions to Crawl4AI:
Core Team
- Unclecode - Project Creator and Main Developer
- Nasrin - Project Manager and Developer
- Aravind Karnam - Head of Community and Product
Community Contributors
- aadityakanjolia4 - Fix for
CustomHTML2Textis not defined. - FractalMind - Created the first official Docker Hub image and fixed Dockerfile errors
- ketonkss4 - Identified Selenium's new capabilities, helping reduce dependencies
- jonymusky - Javascript execution documentation, and wait_for
- datehoer - Add browser prxy support
Pull Requests
- dvschuyl - AsyncPlaywrightCrawlerStrategy page-evaluate context destroyed by navigation #304
- nelzomal - Enhance development installation instructions #286
- HamzaFarhan - Handled the cases where markdown_with_citations, references_markdown, and filtered_html might not be defined #293
- NanmiCoder - fix: crawler strategy exception handling and fixes #271
- paulokuong - fix: RAWL4_AI_BASE_DIRECTORY should be Path object instead of string #298
Feb-Alpha-1
- sufianuddin - fix: Documentation for JsonCssExtractionStrategy
- tautikAg - fix: Markdown output has incorect spacing
- cardit1 - fix: 'AsyncPlaywrightCrawlerStrategy' object has no attribute 'downloads_path'
- dmurat - fix: Incorrect rendering of inline code inside of links
- Sparshsing - fix: Relative Urls in the webpage not extracted properly
Other Contributors
Typo fixes
Acknowledgements
We also want to thank all the users who have reported bugs, suggested features, or helped in any other way to make Crawl4AI better.
If you've contributed to Crawl4AI and your name isn't on this list, please open a pull request with your name, link, and contribution, and we'll review it promptly.
Thank you all for your contributions!