yujunjun/firecrawl
1
0
Fork 0
mirror of https://github.com/mendableai/firecrawl.git synced 2025-09-21 22:40:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
firecrawl/apps/api/sharedLibs/go-html-to-md/go.mod

19 lines
565 B
Modula-2
Raw Normal View History

feat: added go html to md parser
2024-09-02 14:15:56 -03:00
module html-to-markdown.go
feat(api): zero data retention (ENG-2376) (#1687) * add ZDR flag and v0 lockout * zdr walls on v1 and propagation * zdr within scrapeurl * fixes * more fixes * zdr flag on queue-worker logging * final stretch + testing, needs f-e changes * fixes * self-serve ZDR through request body * request-level zdr * improved zdrcleaner * generalize schema to allow for different data retention times in the future * update Go version on CI * feat(api/tests/zdr): test that nothing is logged * fix(api/tests/zdr): correct log name * fix(ci): envs * fix(zdrcleaner): lower bound on db query * zdr test with idmux * WIP Assignments * fix bad merge remove unused identity * fix stupid jest globals thing * feat(scrapeURL/zdr): blacklist pdf action * fix(concurrency-limit): zdr logging enforcement * temp: remove extra billing for zdr * SDK support * final zdr business logic fix rename * fix test log filtering * fix log filtering... again * fix(tests/zdr): more logging exceptions --------- Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-07-01 20:07:26 +02:00
go 1.23.0
toolchain go1.24.0
feat: added go html to md parser
2024-09-02 14:15:56 -03:00
chore(go-html-to-md): Update html-to-markdown dependency
2025-01-28 18:36:01 +02:00
require github.com/tomkosm/html-to-markdown v0.0.0-20250128162844-2f19490e042d
feat: added go html to md parser
2024-09-02 14:15:56 -03:00
require (
feat(api): zero data retention (ENG-2376) (#1687) * add ZDR flag and v0 lockout * zdr walls on v1 and propagation * zdr within scrapeurl * fixes * more fixes * zdr flag on queue-worker logging * final stretch + testing, needs f-e changes * fixes * self-serve ZDR through request body * request-level zdr * improved zdrcleaner * generalize schema to allow for different data retention times in the future * update Go version on CI * feat(api/tests/zdr): test that nothing is logged * fix(api/tests/zdr): correct log name * fix(ci): envs * fix(zdrcleaner): lower bound on db query * zdr test with idmux * WIP Assignments * fix bad merge remove unused identity * fix stupid jest globals thing * feat(scrapeURL/zdr): blacklist pdf action * fix(concurrency-limit): zdr logging enforcement * temp: remove extra billing for zdr * SDK support * final zdr business logic fix rename * fix test log filtering * fix log filtering... again * fix(tests/zdr): more logging exceptions --------- Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-07-01 20:07:26 +02:00
github.com/PuerkitoBio/goquery v1.10.3 // indirect
github.com/andybalholm/cascadia v1.3.3 // indirect
now using compiled go/C lib with koffi
2024-09-03 10:56:07 -03:00
github.com/kr/pretty v0.3.0 // indirect
feat(api): zero data retention (ENG-2376) (#1687) * add ZDR flag and v0 lockout * zdr walls on v1 and propagation * zdr within scrapeurl * fixes * more fixes * zdr flag on queue-worker logging * final stretch + testing, needs f-e changes * fixes * self-serve ZDR through request body * request-level zdr * improved zdrcleaner * generalize schema to allow for different data retention times in the future * update Go version on CI * feat(api/tests/zdr): test that nothing is logged * fix(api/tests/zdr): correct log name * fix(ci): envs * fix(zdrcleaner): lower bound on db query * zdr test with idmux * WIP Assignments * fix bad merge remove unused identity * fix stupid jest globals thing * feat(scrapeURL/zdr): blacklist pdf action * fix(concurrency-limit): zdr logging enforcement * temp: remove extra billing for zdr * SDK support * final zdr business logic fix rename * fix test log filtering * fix log filtering... again * fix(tests/zdr): more logging exceptions --------- Co-authored-by: Nicolas <nicolascamara29@gmail.com>
2025-07-01 20:07:26 +02:00
golang.org/x/net v0.41.0 // indirect
now using compiled go/C lib with koffi
2024-09-03 10:56:07 -03:00
gopkg.in/check.v1 v1.0.0-20201130134442-10cb98267c6c // indirect
gopkg.in/yaml.v2 v2.4.0 // indirect
feat: added go html to md parser
2024-09-02 14:15:56 -03:00
)
Iframe support
2024-10-31 14:40:33 +02:00
chore(go-html-to-md): Update html-to-markdown dependency
2025-01-28 18:36:01 +02:00
replace github.com/JohannesKaufmann/html-to-markdown => github.com/tomkosm/html-to-markdown v0.0.0-20250128162844-2f19490e042d
Reference in New Issue Copy Permalink