mirror of
https://github.com/mendableai/firecrawl.git
synced 2025-11-03 11:33:53 +00:00
5e5b5ee0e2
* agent that decides if splits schema or not * split and merge properties done * wip * wip * changes * ch * array merge working! * comment * wip * dereferentiate schema * dereference schemas * Nick: new re-ranker * Create llm-links.txt * Nick: format * Update extraction-service.ts * wip: cooking schema mix and spread functions * wip * wip getting there!!! * nick: * moved functions to helpers * nick: * cant reproduce the error anymore * error handling all scrapes failed * fix * Nick: added the sitemap index * Update sitemap-index.ts * Update map.ts * deduplicate and merge arrays * added error handler for object transformations * Update url-processor.ts * Nick: * Nick: fixes * Nick: big improvements to rerank of multi-entity * Nick: working * Update reranker.ts * fixed transformations for nested objs * fix merge nulls * Nick: fixed error piping * Update queue-worker.ts * Update extraction-service.ts * Nick: format * Update queue-worker.ts * Update pnpm-lock.yaml * Update queue-worker.ts --------- Co-authored-by: rafaelmmiller <150964962+rafaelsideguide@users.noreply.github.com> Co-authored-by: Thomas Kosmas <thomas510111@gmail.com>
11 lines
328 B
TypeScript
11 lines
328 B
TypeScript
export const extractConfig = {
|
|
RERANKING:{
|
|
MAX_INITIAL_RANKING_LIMIT: 1000,
|
|
MAX_RANKING_LIMIT_FOR_RELEVANCE: 100,
|
|
INITIAL_SCORE_THRESHOLD_FOR_RELEVANCE: 0.75,
|
|
FALLBACK_SCORE_THRESHOLD_FOR_RELEVANCE: 0.5,
|
|
MIN_REQUIRED_LINKS: 1,
|
|
}
|
|
};
|
|
export const CUSTOM_U_TEAMS = ["874d40cc-a5c0-4e93-b661-9ddfbad5e51e"];
|