1271 Commits

Author	SHA1	Message	Date
Nicolas	78badf8f72	Nick: wip	2024-10-28 16:02:07 -03:00
Nicolas	801f0f773e	Nick: fix auto charge failing when payment is through Link	2024-10-26 03:59:15 -03:00
Nicolas	97b8d6c333	Update auto_charge.ts	2024-10-25 16:05:39 -03:00
Nicolas	95c4652fd4	Nick: 10min cooldown on auto charge	2024-10-25 16:05:23 -03:00
Nicolas	4590577cba	Merge branch 'main' into nsc/pay-as-you-go-lw2	2024-10-25 14:02:24 -03:00
Nicolas	dbcf2d7ff6	Nick: fix loggin for batch scrape	2024-10-24 23:44:08 -03:00
Nicolas	73e6db45de	Update email_notification.ts	2024-10-24 23:14:41 -03:00
Nicolas	d965f2ce7d	Nick: fixes	2024-10-24 23:13:30 -03:00
Nicolas	29b34270c8	Merge branch 'main' into nsc/pay-as-you-go-lw2	2024-10-24 22:31:04 -03:00
Gergő Móricz	1da6360b77	feat(batch/scrape): restructure logs, add webhooks	2024-10-23 21:55:21 +02:00
Nicolas	19cac2220f	Nick:	2024-10-23 16:31:01 -03:00
Nicolas	d8abd15716	Nick: from bulk to batch	2024-10-23 15:37:24 -03:00
Gergő Móricz	70c4e7c334	feat(bulk/scrape): check credits via url list length	2024-10-23 19:42:02 +02:00
Nicolas	66e505317e	Merge branch 'main' into mog/bulk-scrape	2024-10-23 14:36:26 -03:00
Nicolas	e0d3b761fc	Merge pull request #808 from mendableai/feat/skipTlsVerification ... feat: skipTlsVerification	2024-10-22 20:47:13 -03:00
Nicolas	d375bca167	Update acuc-cache-clear.ts	2024-10-22 20:42:59 -03:00
Nicolas	bbfdda8867	Nick: init	2024-10-22 19:47:23 -03:00
Thomas Kosmas	acde353e56	skipTlsVerification on robots.txt scraping	2024-10-23 01:07:03 +03:00
Thomas Kosmas	bd55464b52	skipTlsVerification	2024-10-22 22:28:02 +03:00
Gergő Móricz	6ed3104eb6	feat: clear ACUC cache endpoint based on team ID	2024-10-22 20:28:10 +02:00
Nicolas	d2344aa14b	Revert "Nick: improved map ranking algorithm" ... This reverts commit 7acd8d2edb6abc45a63fe1060377d2acb398ec36.	2024-10-21 16:11:32 -03:00
Nicolas	d31b85fa91	Merge pull request #793 from mendableai/fix/issue-665 ... [Bug] encoding error for special token	2024-10-21 12:24:46 -03:00
Nicolas	7acd8d2edb	Nick: improved map ranking algorithm	2024-10-19 13:27:47 -03:00
rafaelsideguide	aed11e72a6	fix encoding if error	2024-10-18 11:50:58 -03:00
Nicolas	79e65f31ef	Update v1.ts	2024-10-17 17:57:44 -03:00
Gergő Móricz	03b37998fd	feat: bulk scrape	2024-10-17 19:40:18 +02:00
Nicolas	081d7407b3	Merge pull request #788 from mendableai/nsc/log-extractpr-options ... Extractor options logging v1 fix	2024-10-16 23:51:22 -03:00
Nicolas	06b8d24a4c	Update scrape.ts	2024-10-16 23:50:21 -03:00
Nicolas	a73b06589c	Merge pull request #785 from mendableai/nsc/support-for-all-metadata ... Return all the website metadata	2024-10-16 23:37:26 -03:00
Nicolas	2ac50a16f5	Update metadata.ts	2024-10-16 23:37:07 -03:00
Nicolas	8974230db4	Nick: formatting + error handling	2024-10-16 23:35:03 -03:00
Nicolas	c0384ea381	Nick: added tests	2024-10-16 23:32:44 -03:00
Nicolas	417c7697c3	Update metadata.ts	2024-10-16 23:26:46 -03:00
Nicolas	ff906f7750	Update excludeTags.ts	2024-10-16 13:40:34 -03:00
Nicolas	2c1a98f019	Update excludeTags.ts	2024-10-16 13:37:40 -03:00
Nicolas	cf8fe93281	Update credit_billing.ts	2024-10-16 01:09:57 -03:00
Nicolas	e5a5ca2446	Update credit_billing.ts	2024-10-16 01:06:10 -03:00
Nicolas	027158fa44	Nick:	2024-10-15 21:47:27 -03:00
Nicolas	795e5a9228	Update metadata.ts	2024-10-15 21:36:13 -03:00
Nicolas	b4f6a0f919	Nick: geolocation	2024-10-15 21:12:33 -03:00
Nicolas	54a54b9f33	Nick: admin init	2024-10-15 17:28:28 -03:00
rafaelsideguide	4afcd16e02	performance improv for ws	2024-10-15 10:12:27 -03:00
rafaelsideguide	3afaab13d9	feat/improv-crawl-status-filters	2024-10-14 18:14:00 -03:00
rafaelsideguide	180801225b	fix/check files on crawl	2024-10-14 15:44:45 -03:00
Nicolas	e40036caf7	Merge branch 'main' of https://github.com/mendableai/firecrawl	2024-10-14 12:24:45 -03:00
Nicolas	c3a9630e33	Reapply "Merge pull request #773 from mendableai/nsc/retries-acuc-price-credits-fallback" ... This reverts commit a6888ce17b98e4a47fbfc9796911446a6513959c.	2024-10-14 12:24:34 -03:00
rafaelsideguide	2bf7b433e2	fixed file blocking process	2024-10-14 12:18:26 -03:00
rafaelsideguide	a6888ce17b	Revert "Merge pull request #773 from mendableai/nsc/retries-acuc-price-credits-fallback" ... This reverts commit ba9ad1ef7f02722ce88c1c29fa285befd3c3ec51, reversing changes made to 666082a7ddfa52242b4dd27f2c5f37f1f98a3302.	2024-10-14 10:32:09 -03:00
Nicolas	821c62c575	Update credit_billing.ts	2024-10-13 22:30:11 -03:00
Nicolas	78b6127d88	Nick: retries for acuc	2024-10-13 22:27:38 -03:00