310 Commits

Author	SHA1	Message	Date
Gergő Móricz	ad1a6fbc74	fix(v1/map): handle invalid URLs gracefully	2024-09-10 19:41:01 +02:00
Gergő Móricz	4ebc35c9dd	fix(crawl-status): add success: true	2024-09-10 18:59:09 +02:00
Gergo Moricz	26f2095de6	fix(v1): proper Invalid URL handling	2024-09-10 09:24:23 +02:00
Nicolas	60a15d00eb	Update types.ts	2024-09-08 16:39:12 -03:00
Nicolas	c6f1d80992	Update crawl.ts	2024-09-05 13:03:43 -03:00
Nicolas	eb03a81152	Update crawl-status.ts	2024-09-05 12:55:04 -03:00
Nicolas	82cb80c817	Update map.ts	2024-09-04 23:46:18 -03:00
rafaelsideguide	cb8571abad	fix: enforced dotenv config	2024-09-04 15:57:57 -03:00
Nicolas	049a11187d	Nick:	2024-09-03 21:09:32 -03:00
Nicolas	3244454826	Nick:	2024-09-02 19:36:36 -03:00
Nicolas	2444f7c450	Update scrape.ts	2024-09-02 18:51:18 -03:00
Nicolas	00dacaf935	Nick: scrape id when origin is website for report system	2024-09-02 18:43:52 -03:00
rafaelsideguide	036eb925a2	fix(v1): maxDepth	2024-09-02 09:55:35 -03:00
Nicolas	86b0477708	Update map.ts	2024-09-01 19:54:15 -03:00
Nicolas	304b3e752e	Update map.ts	2024-09-01 19:52:21 -03:00
Nicolas	95b9dc915d	Nick: webhooks v1 working great	2024-09-01 13:44:36 -03:00
Nicolas	fe6abe8f7d	Nick:	2024-09-01 12:55:02 -03:00
Nicolas	8431be5826	Nick:	2024-08-31 14:23:55 -03:00
Nicolas	af5cc5f16b	Nick: 1.2 - v1 llm extract	2024-08-31 13:25:48 -03:00
Nicolas	d347160ff9	Nick:	2024-08-30 17:32:41 -03:00
Nicolas	522d256b11	Merge branch 'main' into v1/llm-extract	2024-08-30 17:16:21 -03:00
Nicolas	ef5c8931eb	Update scrape.ts	2024-08-30 17:09:44 -03:00
Nicolas	050cac51ec	Update types.ts	2024-08-30 17:02:29 -03:00
Nicolas	012bc74e14	Revert "Update types.ts" ... This reverts commit 77766cf00d7f42d77a94af624538f55667ad2128.	2024-08-30 17:02:05 -03:00
Nicolas	77766cf00d	Update types.ts	2024-08-30 17:01:54 -03:00
Nicolas	0732997a13	Merge branch 'main' into v1/llm-extract	2024-08-30 15:42:45 -03:00
Gergo Moricz	c8e0bb93ea	fix(crawl-status): handle null data when purging rawHtml	2024-08-30 20:40:57 +02:00
Gergo Moricz	6a6b487474	fix(v1): don't fail on doc = null	2024-08-30 20:28:18 +02:00
Nicolas	71dab56e36	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-08-30 15:21:29 -03:00
Nicolas	d7dbc2536d	Update crawl.ts	2024-08-30 15:21:22 -03:00
Nicolas	9de39cfa2c	Merge pull request #591 from mendableai/mog/websocket-sdk ... [v1] Websockets SDKs	2024-08-30 15:06:06 -03:00
Nicolas	7c8ca0c889	Update types.ts	2024-08-30 13:54:04 -03:00
Nicolas	f4a49bc1d1	Update types.ts	2024-08-30 13:49:16 -03:00
Nicolas	bb4808443c	Merge branch 'main' into v1/llm-extract	2024-08-30 12:48:26 -03:00
Nicolas	b8920d6f4a	Nick:	2024-08-30 12:37:45 -03:00
Nicolas	ee3e5dc69c	Nick:	2024-08-30 12:34:45 -03:00
Nicolas	e5ca4364ba	Nick: improvements to llm extract error handling	2024-08-30 11:57:55 -03:00
Nicolas	52ac132328	Update auth.ts	2024-08-30 11:10:48 -03:00
Nicolas	41eb620959	Nick: prompt option, still need to convert to new structured outputs	2024-08-29 21:00:57 -03:00
Nicolas	49e1cb7ca0	Nick:	2024-08-29 20:08:06 -03:00
Gergő Móricz	d4001e4528	fix(api/websocket): fix auth and termination	2024-08-29 20:01:00 +02:00
rafaelsideguide	7eefaffe48	fix: rawHtml for v0	2024-08-29 12:24:14 -03:00
rafaelsideguide	f8323f9b11	fix: moved delete rawHtml to end of controller	2024-08-29 10:02:05 -03:00
Nicolas	67229c6b3a	Nick: fixed credits issue	2024-08-28 18:32:45 -03:00
Nicolas	8be75accb8	Nick:	2024-08-28 15:40:30 -03:00
Nicolas	4edd9a34c7	Nick: totalCount -> total, completedCount -> completed	2024-08-28 14:46:53 -03:00
rafaelsideguide	b7f62f93c4	Merge branch 'v1-webscraper' of https://github.com/mendableai/firecrawl into v1-webscraper	2024-08-28 14:18:07 -03:00
rafaelsideguide	1c35534e2a	fix(v1): check-status for preview	2024-08-28 14:18:05 -03:00
Nicolas	af67b14c9d	Nick:	2024-08-28 14:17:59 -03:00
Nicolas	08387c06f8	Update auth.ts	2024-08-28 14:09:12 -03:00