Nicolas 7c0b3ad098

(feat/conc) Move fully to a concurrency limit system (#1045) ...

* Nick: conc limits init

* Nick: test suite plans

* fix(email_notification): move expiry check to redis

* fix(email_notification): add db check in case redis resets

* Update rate-limiter.ts

* Update queue-jobs.ts

* Create concurrency-limit.test.ts

* Update concurrency-limit.test.ts

* Create queue-concurrency-integration.test.ts

* Update queue-concurrency-integration.test.ts

---------

Co-authored-by: Móricz Gergő <mo.geryy@gmail.com>

2025-01-30 13:47:29 -03:00

..

sharedLibs

chore(go-html-to-md): Update html-to-markdown dependency

2025-01-28 18:36:01 +02:00

src

(feat/conc) Move fully to a concurrency limit system (#1045)

2025-01-30 13:47:29 -03:00

utils

feat(queue-worker): fix redirect slipping

2024-12-15 20:16:52 +01:00

.dockerignore

Initial commit

2024-04-15 17:01:47 -04:00

.env.example

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

.env.local

Add SearchApi to search

2024-09-05 18:36:59 +03:00

.gitattributes

Initial commit

2024-04-15 17:01:47 -04:00

.gitignore

Update .gitignore

2024-12-23 18:42:05 -03:00

.prettierrc

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

docker-entrypoint.sh

Nick:

2025-01-19 13:09:29 -03:00

Dockerfile

port most of cheerio stuff to rust (#1089)

2025-01-24 22:04:54 +01:00

fly.staging.toml

fix(fly): change proxy limits

2024-08-14 18:52:40 +02:00

fly.toml

fix(fly): change proxy limits

2024-08-14 18:52:40 +02:00

jest.config.js

Nick:

2024-04-20 16:38:05 -07:00

jest.setup.js

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

openapi-v0.json

add zod, create middleware, update openapi declaration, add crawl logic

2024-08-15 23:30:33 +02:00

openapi.json

add zod, create middleware, update openapi declaration, add crawl logic

2024-08-15 23:30:33 +02:00

package.json

update bullmq

2025-01-24 18:56:03 +01:00

pnpm-lock.yaml

update bullmq

2025-01-24 18:56:03 +01:00

requests.http

docs: update cancel crawl response

2025-01-24 16:16:17 +00:00

tsconfig.json

revert to pdf parse

2024-12-17 12:12:22 -05:00

v1-openapi.json

docs: update cancel crawl response

2025-01-24 16:16:17 +00:00