Gergő Móricz
7128f83a7a
fix(js-sdk): isows import issues (FIR-1586) (FIR-1536) ( #1411 )
...
* attempt
* improvements
* kill isows -- there's been native websocket support in node since 21
* clean up the diff
2025-04-04 17:54:37 +02:00
Gergő Móricz
24f5199359
compare format (FIR-1560) ( #1405 )
2025-04-02 19:52:43 +02:00
Ademílson F. Tonato
58e587d99e
feat(queue-jobs): update notification logic for concurrency limits and add parameter (jsdocs) to batchScrapeUrls
2025-03-31 13:27:36 +01:00
Gergő Móricz
46048bc94d
feat(scrapeURL): return js returns from f-e (FIR-1535) ( #1385 )
...
* feat(scrapeURL): return js returns from f-e
* feat(js-sdk): handle new results
2025-03-28 12:42:25 +01:00
Nicolas
555dab50e7
Nick: bump
2025-03-24 20:17:22 +04:00
Nicolas
a50dc106ef
(feat/deep-research) Deep Research Alpha v1 - Structured Outputs + Customizability ( #1365 )
...
* Nick:
* Nick: structured output support
* Nick: support for zod and pydantic
2025-03-24 20:13:52 +04:00
Nicolas
723c16499d
Merge branch 'nsc/deep-research-prompts'
2025-03-18 15:53:02 -04:00
Nicolas
4fc5e6f6ca
Nick: added analysis prompt to the sdks
2025-03-18 15:52:55 -04:00
Gergő Móricz
d0b468ee7b
feat(scrape/actions/click): add all parameter (FIR-1443) ( #1342 )
...
* feat(scrape/actions/click): add all parameter
* bump sdk
2025-03-17 20:47:17 +01:00
Rafael Miller
6d3c639f58
added 403s to sdk error handlers ( #1357 )
2025-03-17 18:06:29 +01:00
Nicolas
6d250360c2
Nick: bump
2025-03-16 22:45:16 -04:00
Nicolas
0fb9c1f32e
Update index.ts
2025-03-16 22:28:47 -04:00
Nicolas
f1206e4870
Nick: urls optional on extract
2025-03-15 22:50:19 -04:00
Gergő Móricz
ca93ba6c6d
fix(js-sdk/crawl,batch-scrape): retry status call if it returns an error up to 3 times ( #1343 )
2025-03-15 12:42:53 +01:00
Gergő Móricz
7cf2e52fe6
feat(crawl): add maxDiscoveryDepth ( #1329 )
2025-03-12 18:46:57 +01:00
Gergő Móricz
0154e40685
fix(js-sdk/extract): fix zod type check with zod version discrepancy
2025-03-12 16:02:44 +01:00
Nicolas
60346ecfa3
Fix/p token ( #1305 )
...
* preview-token
* Nick:
---------
Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com>
2025-03-06 19:03:33 -03:00
Gergő Móricz
e1cfe1da48
feat(crawl): includes/excludes fixes (FIR-1300) ( #1303 )
...
* feat(crawl): includes/excludes fixes pt. 1
* fix(snips): billing tests
* drop tha logs
* fix(ci): add replica url
* feat(crawl): drop initial scrape if it's not included
* feat(ci): more verbose logging
* fix crawl path in test
* fix(ci): wait for api
* fix(snips/scrape/ad): test for more pixels
* feat(js-sdk/crawl): add regexOnFullURL
2025-03-06 17:05:15 +01:00
Nicolas
22d4f0de38
(feat/deep-research) Alpha prep + Improvements ( #1284 )
...
* Update index.ts
* Nick:
* Nick: topic -> query
* Update deep-research.ts
* Nick: bump
* Nick: add onSource callback
2025-03-02 17:33:21 -03:00
Nicolas
99e61c967c
Update index.ts
2025-03-02 02:39:52 -03:00
Gergő Móricz
05c29e8299
js-sdk: bump
2025-02-28 12:40:39 +01:00
Nicolas
39b61132bf
Nick: fixed js sdk
2025-02-27 20:39:53 -03:00
Nicolas
289e351c14
(feat/deep-research-alpha) Added Max Urls, Sources and Fixes ( #1271 )
...
* Nick: fixes
* Nick:
* Update deep-research-status.ts
2025-02-27 13:24:40 -03:00
Nicolas
2151ca846c
Merge branch 'main' of https://github.com/mendableai/firecrawl
2025-02-20 10:50:32 -03:00
Nicolas
7db2d25efa
Nick:
2025-02-20 10:50:22 -03:00
Gergő Móricz
c75522f535
feat(sdk): enforce timeout on client-side if set ( #1204 )
2025-02-20 13:35:31 +01:00
Eric Ciarla
d984b50400
Add llmstxt generator endpoint ( #1201 )
...
* Nick:
* Revert "fix(v1/types): fix extract -> json rename (FIR-1072) (#1195 )"
This reverts commit 586a10f40d354a038afc2b67809f20a7a829f8cb.
* Update deep-research-service.ts
* Nick:
* init
* part 2
* Update generate-llmstxt-service.ts
* Fix queue
* Update queue-worker.ts
* Almost there
* Final touches
* Update requests.http
* final touches
* Update requests.http
* Improve logging
* Change endpoint to /llmstxt
* Update queue-worker.ts
* Update generate-llmstxt-service.ts
* Nick: cache
* Update index.ts
* Update firecrawl.py
* Update package.json
---------
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
2025-02-19 14:42:33 -03:00
Gergő Móricz
e373fab5c1
fix(sdk/js): don't require CrawlScrapeOptions.formats
2025-02-19 17:58:19 +01:00
Gergő Móricz
8e1e5986f7
feat(sdk/js): bump
2025-02-19 17:37:36 +01:00
Gergő Móricz
4fd26a3baa
feat(js-sdk): support scrapeOptions in ExtractParams
2025-02-19 17:08:43 +01:00
Nicolas
5c47e97db2
(feat/deep-research) Alpha implementation of deep research ( #1202 )
...
* Nick:
* Revert "fix(v1/types): fix extract -> json rename (FIR-1072) (#1195 )"
This reverts commit 586a10f40d354a038afc2b67809f20a7a829f8cb.
* Update deep-research-service.ts
* Nick:
* Nick:
* Nick:
* Nick:
* Nick:
* Nick:
* Update deep-research-service.ts
* Nick:
* Update deep-research-service.ts
* Apply suggestions from code review
---------
Co-authored-by: Gergő Móricz <mo.geryy@gmail.com>
2025-02-19 12:44:21 -03:00
Gergő Móricz
b136e42b53
feat(v1): proxy option / stealthProxy flag (FIR-1050) ( #1196 )
...
* feat(v1): proxy option / stealthProxy flag
* feat(js-sdk): add proxy option
2025-02-18 18:03:10 +01:00
Nicolas
73ecaf74c2
feat(v1/extract) Show sources out of __experimental ( #1180 )
...
* Nick:
* Nick:
* Nick:
2025-02-13 12:41:45 -03:00
Gergő Móricz
844ba39f74
fix(sdks): MIT license
2025-02-06 16:07:50 +01:00
Nicolas
68d3baaac3
v1.16.0 js sdk
2025-01-30 14:52:46 -03:00
Gergő Móricz
a6722d4a95
feat(webhook): add event picker
2025-01-30 18:43:37 +01:00
Gergő Móricz
d09e0603f8
feat(scrapeUrl/fire-engine): add blockAds flag (FIR-692) ( #1106 )
...
* feat(scrapeUrl/fire-engine): add blockAds flag
* feat(v1/scrape): blockAds test
2025-01-29 15:03:37 +01:00
Gergő Móricz
74438a4048
Revert "Revert "feat(v1/map): timeout"" ( #1105 )
...
This reverts commit 831c61706d7b1ef9da525b2e1602913bc4f678e3.
2025-01-29 08:12:50 +01:00
Gergő Móricz
831c61706d
Revert "feat(v1/map): timeout"
...
This reverts commit 57e98e83d7ab43249963b0a14c157aaec7fd4ec7.
2025-01-28 16:45:47 +01:00
Gergő Móricz
57e98e83d7
feat(v1/map): timeout
2025-01-28 16:44:44 +01:00
Hercules Smith
b8c4e198d1
Fix bad WebSocket URL in CrawlWatcher ( #1053 )
...
* fix: bad websocket url in crawl watcher
Fixed CrawlWatcher creating WebSocket using standard http url from base app.
* Use regex to improve url replacement
2025-01-28 08:40:30 +01:00
Nicolas
16af54cf2b
Nick: bump sdks
2025-01-20 13:43:31 -03:00
Nicolas
ef69b1ac88
Nick: allowExternalLinks is now enableWebSearch
2025-01-20 13:41:30 -03:00
Nicolas
a5d379c935
Update package.json
2025-01-20 13:31:08 -03:00
Gergő Móricz
9ad263da21
fix(js-sdk): typo
2025-01-20 17:27:26 +01:00
Nicolas
4e8e58729a
Update index.ts
2025-01-18 21:10:20 -03:00
Nicolas
0ec52613e2
Nick:
2025-01-18 21:10:11 -03:00
Nicolas
88904a5cde
Nick: js-sdk 1.15.4
2025-01-18 18:10:23 -03:00
Nicolas
a7178c0c6f
Nick: patch js-sdk
2025-01-18 18:08:50 -03:00
Nicolas
56776da28d
Nick: json output to new format
2025-01-18 17:54:04 -03:00
