Nicolas c5b6495e48

Merge pull request #1015 from mendableai/nsc/improves-sitemap-fetching ...

Improves sitemap fetching

2024-12-27 14:41:04 -03:00

..

__tests__

Nick: blocklist string

2024-12-20 18:09:49 -03:00

controllers

Nick: blocklist string

2024-12-20 18:09:49 -03:00

lib

Nick: blocklist string

2024-12-20 18:09:49 -03:00

main

Nick: blocklist string

2024-12-20 18:09:49 -03:00

routes

Nick: blocklist string

2024-12-20 18:09:49 -03:00

scraper

Merge pull request #1015 from mendableai/nsc/improves-sitemap-fetching

2024-12-27 14:41:04 -03:00

search

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

services

Nick: blocklist string

2024-12-20 18:09:49 -03:00

control.ts

Initial commit

2024-04-15 17:01:47 -04:00

index.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

run-req.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

strings.ts

Nick: fixed prettier

2024-12-11 19:46:11 -03:00

supabase_types.ts

Nick: revert trailing comma

2024-12-11 19:51:08 -03:00

types.ts

feat(runWebScraper): retry a scrape max 3 times in a crawl if the status code is failure

2024-12-14 00:54:05 +01:00