Gergő Móricz 3f0b8b8e27

Remove old cache mechanisms (redis cache, PDF cache, crawl maps, etc.) (FIR-2266) (#1667) ...

* feat(api): remove old indexes pt. 1

* feat(map): better subdomain support

* more culling

* adjust map maxage

* feat(api/tests): add tests for pdf caching

* fix(scrapeURL/index): pdf caching

* restore pdf cache

* fix __experimental_cache

* sitemap fetching

* remove extra var

2025-06-20 19:40:28 +02:00

..

sharedLibs

feat: enhance metadata extraction by including 'itemprop' attribute in HTML (#1624)

2025-06-03 18:16:46 +02:00

src

Remove old cache mechanisms (redis cache, PDF cache, crawl maps, etc.) (FIR-2266) (#1667)

2025-06-20 19:40:28 +02:00

utils

add initial codeowners

2025-02-25 14:28:09 +01:00

.dockerignore

…

.env.example

Fix PLAYWRIGHT_MICROSERVICE_URL env var to use /scrape endpoint (#1654)

2025-06-11 16:53:32 +02:00

.env.local

Add SearchApi to search

2024-09-05 18:36:59 +03:00

.gitattributes

…

.gitignore

Update .gitignore

2024-12-23 18:42:05 -03:00

.prettierrc

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

docker-entrypoint.sh

Update self-hosted Kubernetes deployments examples for compatibility and consistency (#1177)

2025-02-18 13:33:20 +01:00

Dockerfile

feat: parse PDFs on fc side and reject if too long for timeout (FIR-2083) (#1592)

2025-05-23 13:45:53 +02:00

jest.config.js

…

jest.setup.js

WebScraper refactor into scrapeURL (#714)

2024-11-07 20:57:33 +01:00

openapi-v0.json

add zod, create middleware, update openapi declaration, add crawl logic

2024-08-15 23:30:33 +02:00

openapi.json

Nick: updated openapi specs

2025-06-20 14:30:37 -03:00

package.json

feat(index): add domain splitting for improved map querying (#1666)

2025-06-13 15:22:45 +02:00

pnpm-lock.yaml

feat(index): add domain splitting for improved map querying (#1666)

2025-06-13 15:22:45 +02:00

requests.http

Fix LLMs.txt cache bug with subdomains and add bypass option (#1557)

2025-05-16 16:29:09 -03:00

tsconfig.json

(feat/fire-1) FIRE-1 (#1462)

2025-04-15 00:19:45 -07:00

v1-openapi.json

Nick: updated openapi specs

2025-06-20 14:30:37 -03:00