1849 Commits

Author SHA1 Message Date
Nicolas
8efd444ba2
Merge pull request #399 from mendableai/nsc/sitemap-fix-fire-engine
Sitemap fallback fixes w/ fire-engine
2024-07-12 23:24:15 -04:00
Nicolas
949791049f Nick: 2024-07-12 23:20:26 -04:00
Nicolas
d0c8d3ecde Merge branch 'main' into nsc/sitemap-fix-fire-engine 2024-07-12 22:15:06 -04:00
Nicolas
a3b1703b68 Update fireEngine.ts 2024-07-12 22:15:00 -04:00
Nicolas
09bc2c7a9c
Merge pull request #394 from mendableai/nsc/small-fe-print
Log Fire-engine page errors
2024-07-12 22:14:04 -04:00
Nicolas
e098e88ea7 Nick: 2024-07-12 22:02:08 -04:00
Nicolas
bfc7f5882e Update index.ts 2024-07-12 19:57:12 -04:00
Nicolas
da3e6525a9
Merge pull request #398 from mendableai/nsc/slack-alerts-1
CI for alerts instead
2024-07-12 19:52:34 -04:00
Nicolas
436e8922a7 Nick: doing on the ci instead 2024-07-12 19:49:38 -04:00
Nicolas
e61e94cb78
Merge pull request #397 from mendableai/nsc/slack-alerts-1
Slack Alerts for when queue is over capacity
2024-07-12 19:24:59 -04:00
Nicolas
fc3328f3d1 Update index.ts 2024-07-12 19:12:56 -04:00
Nicolas
fd18f2269b Nick: slack alerts 2024-07-12 19:07:59 -04:00
Nicolas
214a6ee608
Merge pull request #396 from mendableai/bugfix/crawl-docker
[BUG] Fixed docker self hosting issue
2024-07-12 16:48:16 -04:00
rafaelsideguide
f453bcf17c bugfix docker self hosting 2024-07-12 16:51:20 -03:00
Nicolas
f2a08e0ab8
Merge pull request #395 from kun432/kun432/fix-use-db-auth-check-for-selfhost
Fix USE_DB_AUTHENTICATION checks for self-host
2024-07-12 15:39:35 -04:00
Nicolas
0ddaac6ae0 Nick: fixed the other instances as well 2024-07-12 15:39:10 -04:00
Nicolas
5da03a8fbd Update fireEngine.ts 2024-07-12 14:59:49 -04:00
Kuniaki Shimizu
bd986a453c fix USE_DB_AUTHENTICATION checks 2024-07-13 03:50:46 +09:00
Nicolas
b5b75086c1 Update index.ts 2024-07-12 10:44:14 -04:00
Nicolas
c07a1912e9
Merge pull request #393 from mendableai/mog/job-stuck-fix
fix(bull): requeue jobs after restart
2024-07-12 10:43:02 -04:00
Gergo Moricz
0d3e09e798 fix: try-catch job removal 2024-07-12 16:35:50 +02:00
Gergő Móricz
69d724714f
Merge branch 'main' into mog/job-stuck-fix 2024-07-12 16:33:34 +02:00
Nicolas
c3eecf7b9f Update index.ts 2024-07-12 10:22:06 -04:00
sanix-darker
3a744eb963
feat: update the doc and version 2024-07-12 15:33:31 +02:00
sanix-darker
2ae2ccad1c
chore: update license on Cargo.toml 2024-07-12 15:32:57 +02:00
sanix-darker
80af390557
chore: update doc and libs 2024-07-12 15:22:55 +02:00
sanix-darker
6ea36d38f3
chore: no need for Makefile 2024-07-12 15:10:12 +02:00
sanix-darker
d7bbb22ae4
feat: update fly github action 2024-07-12 15:06:54 +02:00
sanix-darker
9deaa8b0e9
feat: add rust sdk ci github action 2024-07-12 14:58:41 +02:00
sanix-darker
0b19c940f1
fix: format the rust code 2024-07-12 14:58:11 +02:00
sanix-darker
aa9d49cfda
fix(test): updates and keep relevant tests 2024-07-12 14:41:53 +02:00
sanix-darker
21983011b9
feat: update tests 2024-07-12 14:07:58 +02:00
sanix-darker
d86de4f5a6
feat: add Debug to FireCrawl 2024-07-12 14:07:23 +02:00
sanix-darker
d8f67d5045
chore(doc): adding sdk rust lib 2024-07-12 13:59:41 +02:00
sanix-darker
20932f7b31
feat(test): start implementing tests for the lib 2024-07-12 13:59:04 +02:00
sanix-darker
2f6215c492
feat: add dotenv and assert-match as dev dependencies 2024-07-12 13:58:38 +02:00
Gergo Moricz
10957b748b fix(bull): requeue jobs after restart 2024-07-12 13:55:53 +02:00
sanix-darker
bcf596c310
fix: license 2024-07-12 13:20:39 +02:00
sanix-darker
04e94cdb20
chore: update cargo.toml file by adding more elements 2024-07-12 13:15:24 +02:00
Nicolas
961b27811d
Merge pull request #386 from mendableai/feat/fire-engine-fallback-for-sitemap
[Feat] Added fire-engine fallback for getting sitemaps
2024-07-11 20:38:01 -04:00
Nicolas
84de63dbeb
Merge pull request #375 from StefanTerdell/self-host-qol
Self-hosting quality of life fixes
2024-07-11 20:37:39 -04:00
Nicolas
30c1118713
Merge pull request #326 from mendableai/feat/save-docs-on-supabase
[Feat] Added implementation for saving docs on supabase
2024-07-11 20:27:41 -04:00
jhoseph88
68828a5b5c Pass along current, total, current_step, and current_url in js sdk 2024-07-11 19:37:09 -04:00
Gergo Moricz
7e3a368684 fix: unpause globally 2024-07-12 00:05:35 +02:00
Gergo Moricz
ee1d41406e feat: unpause by http request 2024-07-11 23:56:36 +02:00
Gergo Moricz
f64a2d8668 fix: rename fly tomls to original 2024-07-11 23:21:02 +02:00
Gergo Moricz
bd84290b9e fix: reenable hyperdx 2024-07-11 23:20:51 +02:00
Gergo Moricz
09bca05b20 feat: fix iteration 3 (actually works) 2024-07-11 23:14:15 +02:00
Gergo Moricz
9cd7d79b64 feat: avoid double SIGINT crashing 2024-07-11 20:35:15 +02:00
Gergo Moricz
eaa8db4b19 fix(fly): raise kill timeout for graceful shutdown 2024-07-11 20:09:06 +02:00