yujunjun/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2025-12-05 03:21:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
firecrawl/examples/kubernetes/firecrawl-helm
History
Gergő Móricz 3086a27459
feat: new app database shape (#2445) 
* fix(api/admin/integration/validate-api-key): correct parsing

* feat: rework job logging to new schema (draft impl)

* robust supa inserts

* fix: change tracking logic only when db auth is on

* hook up all request logging and uuidv7

* fix: integration logging

* fix: zdrcleaner

* fix: gcs retries correctly

* fix: move off of firecrawl_jobs

* temp: run prod tests

* fix zdr tests

* fix zdr on noq

* fix(api/tests/zdr): update log ignore list

* fix(log_job): insertion of searches

* fix(api/tests/zdr): wait for finish crons to fire

* fix(scrape-worker): propagate requestId when adding new jobs

* chore: re-disable prod test ci

* feat: prevent crawls from breaking during migration

* Update apps/api/src/controllers/v0/search.ts

Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>

* fix(admin): remove crawl check

* feat(api): update RPCs

* fix(log_job): playground team id

* fix: success -> is_successful

* feat(v2/search): fix ZDR in new data structure

* fix prev use of success

* fix: zdrcleaner issue

---------

Co-authored-by: cubic-dev-ai[bot] <191113872+cubic-dev-ai[bot]@users.noreply.github.com>
2025-12-03 11:02:55 +01:00
..
overlays
feat: add initial Helm chart for Firecrawl deployment (#1262)
2025-08-27 10:06:18 +02:00
templates
feat: new app database shape (#2445)
2025-12-03 11:02:55 +01:00
.helmignore
feat: add initial Helm chart for Firecrawl deployment (#1262)
2025-08-27 10:06:18 +02:00
Chart.yaml
feat: add initial Helm chart for Firecrawl deployment (#1262)
2025-08-27 10:06:18 +02:00
README.md
feat: add initial Helm chart for Firecrawl deployment (#1262)
2025-08-27 10:06:18 +02:00
values.yaml
feat: new app database shape (#2445)
2025-12-03 11:02:55 +01:00

README.md

Firecrawl Helm Chart

This Helm chart deploys Firecrawl components (API, Worker, Playwright service, Redis, etc.) on a Kubernetes cluster using environment-specific overlays.

Pre-deployment

  1. Configure Secrets and ConfigMaps:

    • Update values.yaml with the necessary environment-specific values in the overlays/<dev|prod>/values.yaml file.
    • Note: If using REDIS_PASSWORD, adjust the REDIS_URL and REDIS_RATE_LIMIT_URL in the ConfigMap to include the password.

  2. Build and Push Docker Images:

    • API/Worker: 
      docker build --no-cache --platform linux/amd64 -t ghcr.io/winkk-dev/firecrawl:latest ../../../apps/api
docker push ghcr.io/winkk-dev/firecrawl:latest
    • Playwright Service: 
      docker build --no-cache --platform linux/amd64 -t ghcr.io/winkk-dev/firecrawl-playwright:latest ../../../apps/playwright-service
docker push ghcr.io/winkk-dev/firecrawl-playwright:latest

Deployment

Render the manifests for review:

helm template winkk-ai . -f values.yaml -f overlays/dev/values.yaml -n winkk-ai

Deploy or upgrade the release:

helm upgrade firecrawl . -f values.yaml -f overlays/dev/values.yaml -n firecrawl --install --create-namespace

Testing

Forward the API service port to your local machine:

kubectl port-forward svc/firecrawl-api 3002:3002 -n firecrawl

Cleanup

To uninstall the deployment:

helm uninstall firecrawl -n firecrawl


---

This README provides a quick guide to configuring, deploying, testing, and cleaning up your Firecrawl installation using Helm.