Logo
Explore Help
Register Sign In
yujunjun/crawl4ai
1
0
Fork 0
You've already forked crawl4ai
mirror of https://github.com/unclecode/crawl4ai.git synced 2025-11-26 09:52:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
crawl4ai/docs/examples/cli/extract.yml

11 lines
331 B
YAML
Raw Normal View History

feat(cli): add command line interface with comprehensive features Implements a full-featured CLI for Crawl4AI with the following capabilities: - Basic and advanced web crawling - Configuration management via YAML/JSON files - Multiple extraction strategies (CSS, XPath, LLM) - Content filtering and optimization - Interactive Q&A capabilities - Various output formats - Comprehensive documentation and examples Also includes: - Home directory setup for configuration and cache - Environment variable support for API tokens - Test suite for CLI functionality
2025-02-10 16:58:52 +08:00
type: "llm"
provider: "openai/gpt-4o-mini"
api_token: "env:OPENAI_API_KEY"
instruction: "Extract all articles with their titles, authors, publication dates and main topics in a structured format"
params:
chunk_token_threshold: 4096
overlap_rate: 0.1
word_token_rate: 0.75
temperature: 0.3
max_tokens: 1000
verbose: true
Reference in New Issue Copy Permalink
Powered by Gitea Version: 1.23.5 Page: 157ms Template: 20ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API