3527 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
rafaelmmiller	85247991bc	generic	2025-04-18 00:00:18 -07:00
Nicolas	287032017b	Merge branch 'sdk-improv/async' of https://github.com/mendableai/firecrawl into sdk-improv/async	2025-04-17 23:50:57 -07:00
Nicolas	8eb4e1a96a	Update firecrawl.py	2025-04-17 23:50:56 -07:00
rafaelmmiller	23ef26655c	params	2025-04-17 23:37:45 -07:00
rafaelmmiller	22cfdd6ae3	added agent options types	2025-04-17 23:31:28 -07:00
Nicolas	f48937a55d	Update firecrawl.py	2025-04-17 23:17:00 -07:00
Nicolas	d9780412f5	Update firecrawl.py	2025-04-17 23:08:33 -07:00
Nicolas	c67425ad8b	Merge branch 'main' into sdk-improv/async	2025-04-17 22:59:07 -07:00
Gergő Móricz	ec3d679c5b	feat(rust-sdk): add agent options	2025-04-17 22:15:13 -07:00
kkharji	f2c01340d1	feat(rust): update rust sdk to support new features (#1446) ... * chore(rust-sdk): cargo fmt * feat(rust-sdk): implement search api + example + test * feat(rust-sdk): implement crawl cancel api + example + test * feat(rust-sdk): implement crawl check errors api + example + test * feat(rust-sdk): implement batch crawl + test + example + Fix MapOptions * feat(rust-sdk): implement extract api + test + example * feat(rust-sdk): implement llmtxt api + test + example * chore(rust-sdk): correct mock tests * chore(rust-sdk): prep for cargo distribution	2025-04-18 06:59:59 +02:00
Gergő Móricz	33aece8e96	more cost calc	2025-04-17 14:00:48 -07:00
Gergő Móricz	9bea877eb1	feat(extract): cost limit (#1473)	2025-04-17 21:44:28 +02:00
Gergő Móricz	7df557e59c	feat(cost-tracking): add model tracking and more costs	2025-04-17 11:33:10 -07:00
Nicolas	5aa9469081	Update __init__.py	2025-04-17 11:14:09 -07:00
Gergő Móricz	f844b329f1	remove agent preview rate limiter	2025-04-17 11:04:45 -07:00
Gergő Móricz	06770bc63f	fix(scrape/json): move back to 4o mini	2025-04-17 10:48:13 -07:00
Gergő Móricz	8546bcacc0	new cost tracking	2025-04-17 09:23:53 -07:00
Gergő Móricz	ba4df67de7	force 2.5	2025-04-16 16:53:04 -07:00
Gergő Móricz	6a93293fd0	feat(smart-scrape): use correct models for multi-entity assembly	2025-04-16 16:39:48 -07:00
Gergő Móricz	751c30f139	feat(extractSmartScrape): better pagination handling	2025-04-16 16:23:12 -07:00
Gergő Móricz	509e6e658c	feat(llmExtract): more logging	2025-04-16 15:40:07 -07:00
Gergő Móricz	4c5120e081	feat(llm-extract): do more logging, even more	2025-04-16 15:10:17 -07:00
Gergő Móricz	b45e3bda13	better logs	2025-04-16 15:08:05 -07:00
Gergő Móricz	ad7e3f62d1	feat(extractSmartScrape): resolve refs in provided schema	2025-04-16 14:32:00 -07:00
Gergő Móricz	5ee2434c9d	more logs	2025-04-16 14:24:09 -07:00
Gergő Móricz	772a3ea751	Bump the SDK	2025-04-16 12:36:43 -07:00
Gergő Móricz	4740254b89	feat(rquests.http): add extract	2025-04-16 12:32:02 -07:00
Gergő Móricz	c713251261	feat(extraction-service): send thisSessionId for single entity	2025-04-16 12:28:35 -07:00
Gergő Móricz	7787a58beb	default timeout	2025-04-16 10:48:03 -07:00
Gergő Móricz	39d10dc734	feat: disable cost tracking	2025-04-16 09:55:32 -07:00
Gergő Móricz	8766bc6f6b	temp: don't... do that	2025-04-16 03:28:33 -07:00
Gergő Móricz	defc80af32	stream session IDs for single URLs	2025-04-16 03:23:18 -07:00
Gergő Móricz	d82f44c93e	feat(extract): log failed extracts	2025-04-16 03:13:02 -07:00
Gergő Móricz	aa20246571	minor cost tracking fix	2025-04-16 02:06:39 -07:00
Nicolas	51967c7c3d	Merge branch 'main' into rafa/sessionIdsExtract	2025-04-16 01:48:13 -07:00
Gergő Móricz	dcef6fbc13	feat(extractSmartScrape): mog it to 100 pages max	2025-04-16 01:13:49 -07:00
Gergő Móricz	129b10e478	fix(llmExtract): cost calculation	2025-04-16 01:04:48 -07:00
rafaelmmiller	f92217e3b6	wip	2025-04-16 00:38:35 -07:00
Gergő Móricz	0d813b628b	feat: correlate smart scrape	2025-04-16 00:25:42 -07:00
Gergő Móricz	edd4c30908	FIX IT	2025-04-16 00:11:27 -07:00
Gergő Móricz	a06910115b	asd	2025-04-16 00:03:07 -07:00
Gergő Móricz	2245650bc3	fix	2025-04-15 23:54:56 -07:00
Gergő Móricz	2193bee133	Improve logging	2025-04-15 23:52:20 -07:00
Gergő Móricz	0935ec210e	feat(smartScrape): better loggin	2025-04-15 23:34:00 -07:00
Gergő Móricz	b6abe4f26b	fix(smartScrape): pass extract id	2025-04-15 23:23:18 -07:00
Gergő Móricz	80b507e64e	correlate with eid	2025-04-15 23:06:13 -07:00
Gergő Móricz	512a2b1cd4	feat(extract): run on original links if reranker is weird	2025-04-15 22:57:20 -07:00
Gergő Móricz	13bd50ad2b	feat(fetch): don't time out (for smart scrape)	2025-04-15 21:57:05 -07:00
Gergő Móricz	0abe60085b	fix	2025-04-15 20:29:01 -07:00
Gergő Móricz	eea1267b50	feat(batchExtract): thingymajig	2025-04-15 20:28:53 -07:00