30 Commits

Author SHA1 Message Date
Aseem Bansal
6af0e8fd61
build(ingest): update base requirements file (#10368) 2024-04-24 20:07:15 +05:30
david-leifker
dc3ca789ff
docker(ingestion-base): set certificate location for python (#10364) 2024-04-23 18:54:49 -05:00
david-leifker
4bda3d87dc
build(docker): prefix pr on pr sha tags (#10171) 2024-03-29 17:27:57 -05:00
david-leifker
ef0048e42c
chore(ingestion-base): update base requirements (#10142) 2024-03-26 18:17:43 -05:00
Harshal Sheth
05593f443e
feat(docker): respect pip mirrors with uv (#9963) 2024-02-29 18:05:14 -08:00
Harshal Sheth
02f41b74b6
feat(ingest): use uv for python package installs (#9885) 2024-02-26 15:02:47 -08:00
Peng G
a4e5ed82fc
feat(build): upgrade fastapi and gitdb due to vulnerablities (#9819)
Co-authored-by: Peng Gao <pgao@slack-corp.com>
2024-02-12 14:55:27 -08:00
david-leifker
69d0ba1812
build(ingestion-smoke): fix smoke dockerfile (#9724) 2024-01-30 08:19:06 -06:00
Davi Arnaut
f627fc459d
feat(ingest): add ODBC library and tools to base image (#9701) 2024-01-23 22:34:18 -08:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
ethan-cartwright
dfb2f7e596
feat(classifier): Add support for excluding list of exact column names (#9472)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
2024-01-16 19:12:23 -08:00
Harshal Sheth
89c7059ce9
chore(build): update base-requirements + add script for regeneration (#9524) 2023-12-28 14:36:41 +05:30
Harshal Sheth
ca518d6c78
feat(ingest): remove librdkafka hacks (#9507) 2023-12-21 20:28:45 -05:00
noggi
193d1464a6
Fix downstream CI issue (#9479) 2023-12-18 14:06:17 -08:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… (#9233) 2023-11-13 16:26:53 -06:00
david-leifker
ebd2e2312b
fix(datahub-ingestion): remove old jars, sync pyspark version (#9217) 2023-11-10 22:10:00 -06:00
RyanHolstien
6f466b0e50
chore(docker): update base images to alpine 3.18 (#8967) 2023-10-17 15:40:38 -05:00
Aseem Bansal
71c9bd3a49
ci(ingest): update base requirements (#8995) 2023-10-13 11:48:22 +05:30
david-leifker
4d9a7ce7c9
ci: Docker slim tag fix (#8925) 2023-09-29 23:07:45 -05:00
david-leifker
b45b7f7d2a
fix(docker): slim tags (#8922) 2023-09-29 17:49:36 -05:00
david-leifker
d33a85314d
fix(docker): move base image to -base tag, full image to head (#8919)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-28 21:21:04 -05:00
Harshal Sheth
ed1d35c79b
fix(build): run codegen when building datahub-ingestion image (#8869) 2023-09-25 23:10:49 -05:00
Harshal Sheth
f7fee743bf
fix(ingest): use epoch 1 for dev build versions (#8824) 2023-09-12 13:11:01 -07:00
david-leifker
655914841b
fix(docker): misc docker fixes (#8677) 2023-08-22 10:38:08 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
Aseem Bansal
6530a940e1
chore(ci): update base requirements file (#8144) 2023-05-30 16:33:00 +05:30
Vinícius Mello
7059874dec
feat(ingest/bigquery): Add BigQuery Views lineage extraction from Google Data Catalog API (#8100) 2023-05-25 08:37:46 -07:00
Aseem Bansal
ee9dfda25e
chore(ci): regular upgrade base requirements.txt (#7821) 2023-04-18 20:36:05 +05:30
david-leifker
0a9dc73402
build(docker): metadata-ingestion images build and add slim version (#7412) 2023-03-20 18:06:35 -05:00