mirror of
https://github.com/mendableai/firecrawl.git
synced 2025-06-27 00:41:33 +00:00
6634d236bf
* wip * integrating smart-scrape * integrate smartscrape into llmExtract * wip * smart scrape multiple links * fixes * fix * wip * it worked! * wip. there's a bug on the batchExtract TypeError: Converting circular structure to JSON * wip * retry model * retry models * feat/scrape+json+extract interfaces ready * vertex -> googleapi * fix/transformArrayToObject. required params on schema is still a bug * change model * o3-mini -> gemini * Update extractSmartScrape.ts * sessionId * sessionId * Nick: f-0 start * Update extraction-service-f0.ts * Update types.ts * Nick: * Update queue-worker.ts * Nick: new interface * rename analyzeSchemaAndPrompt -> F0 * refactor: rename agent ID to model in types and extract logic * agent * id->model * id->model * refactor: standardize agent model handling and validation across extraction logic * livecast agent * (feat/f1) sdks (#1459) * feat: add FIRE-1 agent support to Python and JavaScript SDKs Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev> * feat: add FIRE-1 agent support to scrape methods in both SDKs Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev> * feat: add prompt and sessionId to AgentOptions interface Co-Authored-By: hello@sideguide.dev <hello@sideguide.dev> * Update index.ts --------- Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: hello@sideguide.dev <hello@sideguide.dev> Co-authored-by: Nicolas <nicolascamara29@gmail.com> * feat(v1): rate limits * Update types.ts * Update llmExtract.ts * add cost tracking * remove * Update requests.http * fix smart scrape cost calc * log sm cost * fix counts * fix * expose cost tracking * models fix * temp: skipLibcheck * get rid of it * fix ts * dont skip lib check * Update extractSmartScrape.ts * Update queue-worker.ts * Update smartScrape.ts * Update requests.http * fix(rate-limiter): * types: fire-1 refine * bill 150 * fix credits used on crawl * ban from crawl * route cost limit warning * Update generic-ai.ts * genres * Update llmExtract.ts * test server diff * cletu --------- Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com> Co-authored-by: Thomas Kosmas <thomas510111@gmail.com> Co-authored-by: Ademílson F. Tonato <ademilsonft@outlook.com> Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: hello@sideguide.dev <hello@sideguide.dev> Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
43 lines
763 B
Plaintext
43 lines
763 B
Plaintext
.DS_Store
|
|
/node_modules/
|
|
/dist/
|
|
.env
|
|
*.csv
|
|
dump.rdb
|
|
/mongo-data
|
|
apps/js-sdk/node_modules/
|
|
|
|
apps/api/.env.local
|
|
|
|
apps/test-suite/node_modules/
|
|
|
|
|
|
apps/test-suite/.env
|
|
apps/test-suite/logs
|
|
apps/test-suite/load-test-results/test-run-report.json
|
|
|
|
apps/playwright-service-ts/node_modules/
|
|
apps/playwright-service-ts/package-lock.json
|
|
|
|
|
|
/examples/o1_web_crawler/venv
|
|
*.pyc
|
|
.rdb
|
|
|
|
apps/js-sdk/firecrawl/dist
|
|
|
|
/examples/o1_web_crawler/firecrawl_env
|
|
/examples/crm_lead_enrichment/crm_lead_enrichment_env
|
|
/.venv
|
|
/examples/claude_web_crawler/firecrawl_env
|
|
/examples/haiku_web_crawler/firecrawl_env
|
|
/examples/sonnet_web_crawler/firecrawl_env
|
|
/examples/internal_link_assitant/firecrawl_env
|
|
|
|
/apps/api/logs/*
|
|
/apps/api/debug/*
|
|
|
|
.vscode
|
|
llm-links.txt
|
|
mapped-links.txt
|
|
gke-key.json |