3537 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Nicolas	eb2e51e50b	Nick: fixed /extract without a schema	2024-12-03 12:08:15 -03:00
Nicolas	e485ea7e40	Merge pull request #939 from mendableai/fix/next-check-py-sdk ... Fix/while next loop	2024-12-03 11:23:33 -03:00
rafaelmmiller	781adc21af	fixes while next loop	2024-12-03 11:10:19 -03:00
Nicolas	4bb46ed152	Nick: extract prompt fixes and limit the number of urls	2024-12-01 20:29:03 -03:00
rafaelmmiller	5ddb7eb922	parameter	2024-11-29 16:44:54 -03:00
Eric Ciarla	2988a56ee5	Merge pull request #928 from BexTuychiev/hacker-news-scraper ... Add a new project to examples that shows how to scrape Hacker News website	2024-11-29 08:49:00 -05:00
Gergő Móricz	42980c899d	fix(scrapeURL/fire-engine): fast fail on chrome error	2024-11-28 18:41:48 +01:00
BexTuychiev	137726ca4f	feature: Add a log message for every file saved	2024-11-28 15:02:29 +05:00
BexTuychiev	d777633b30	Add a new project to examples that shows how to scrape Hacker News website	2024-11-28 14:30:09 +05:00
Móricz Gergő	60ea97c51c	fix(log_job): infinite loop	2024-11-28 08:49:03 +01:00
rafaelmmiller	943bbae88d	fixed nested data inside extract	2024-11-27 18:29:37 -03:00
Nicolas	53e0cb6b19	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-11-27 12:47:12 -03:00
Nicolas	02cd5bcfa4	Nick: bumped the status rl	2024-11-27 12:47:11 -03:00
rafaelmmiller	b69c6f9f95	added library.tiktok to allowedKeywords	2024-11-27 10:10:43 -03:00
Nicolas	ea1d3d7025	Nick: fix extract python sdk	2024-11-26 19:43:32 -03:00
Nicolas	dbda659e71	Nick: bump 1.9.1	2024-11-26 18:01:26 -03:00
Nicolas	bc0d66e96e	Nick: fixed extract types on node sdk	2024-11-26 18:00:49 -03:00
Nicolas	6c33b978f3	Merge pull request #915 from mendableai/nsc/new-extract ... Extract (beta)	2024-11-26 10:02:09 -08:00
Nicolas	5522d6af7d	Update extract.ts	2024-11-26 15:01:42 -03:00
Gergő Móricz	d3a9d29288	return bug	2024-11-26 18:04:09 +01:00
Gergő Móricz	e217952434	fix(crawl): finish crawl even if last one fails	2024-11-26 16:28:45 +01:00
Gergő Móricz	f395c5b008	fix(crawl): failed behaviour	2024-11-26 16:25:48 +01:00
Eric Ciarla	a9a3739883	Merge pull request #918 from BexTuychiev/map-endpoint ... Add notebook and markdown files for two articles: mastering /scrape and mastering /crawl	2024-11-25 15:48:42 -05:00
Nicolas	8a26f08b14	Update extract.ts	2024-11-24 20:37:58 -08:00
Nicolas	2513efc971	Update extract.ts	2024-11-24 20:31:38 -08:00
Nicolas	a18614cd00	Update queue-jobs.ts	2024-11-24 19:48:57 -08:00
Nicolas	18b864eace	Update index.ts	2024-11-24 19:48:13 -08:00
Nicolas	d817aa744f	Update v1.ts	2024-11-24 19:46:31 -08:00
Nicolas	30def84c0a	Nick: scrape timeout + warnings	2024-11-24 19:44:51 -08:00
Nicolas	b693c6c23b	Update extract.ts	2024-11-24 19:36:18 -08:00
Nicolas	95bea6a391	Nick: re-ranker safety + unit tests	2024-11-24 19:34:56 -08:00
BexTuychiev	c0fd256021	Add notebook and markdown files for two articles: mastering /scrape and mastering /map	2024-11-23 21:47:36 +05:00
Nicolas	ce6d3e21e1	Update README.md	2024-11-23 00:06:49 -08:00
rafaelmmiller	24724e958e	added new etier	2024-11-21 13:45:30 -03:00
Nicolas	aa26dbe74e	Nick: map e2e tests	2024-11-20 17:03:04 -08:00
Nicolas	6fbfeafe38	Nick: fixed map settings	2024-11-20 16:51:13 -08:00
Nicolas	aaddbdc1bc	Update map.ts	2024-11-20 16:47:07 -08:00
Nicolas	5f4c8da109	Update pnpm-lock.yaml	2024-11-20 16:44:52 -08:00
Nicolas	42922c68d6	Update package.json	2024-11-20 16:44:40 -08:00
Nicolas	93e106d321	Update v0.ts	2024-11-20 16:43:02 -08:00
Nicolas	3eaa3b38ab	Nick: formatting	2024-11-20 16:42:42 -08:00
Nicolas	c78dae178b	Merge branch 'main' into nsc/new-extract	2024-11-20 16:41:13 -08:00
Nicolas	945183ffbd	Update extract.ts	2024-11-20 16:40:55 -08:00
Nicolas	d196b9d93d	Update extract.ts	2024-11-20 13:16:36 -08:00
Nicolas	9512d81e05	Update extract.ts	2024-11-20 13:15:52 -08:00
Nicolas	3de4997f4d	Loggin num tokens	2024-11-20 13:09:46 -08:00
Nicolas	769f08c10d	Billing and log for extract	2024-11-20 13:08:09 -08:00
Nicolas	0e4e9a3b37	Nick:	2024-11-20 13:01:36 -08:00
Nicolas	09dd5136b7	Update build-document.ts	2024-11-20 12:51:16 -08:00
Nicolas	67a2989874	Nick: fixes	2024-11-20 12:48:10 -08:00