Sergio Gómez Villamor
8cae980286
tests(ingestion): moving some tests so they are available for sdk users ( #13540 )
2025-05-19 08:39:53 +02:00
Jaesung Ryu
06bee0d7c0
feat(ingest/mongodb) re-order aggregation logic ( #12428 )
...
Co-authored-by: Kade Ryu <kade@wrtn.io>
2025-02-05 11:25:09 -08:00
pankajmahato-visa
e569fbc8a6
fix(ingest/mongodb): Add Collection Name as Dataset Name in MongoDB ( #11698 )
2024-10-23 18:10:20 +02:00
Sergio Gómez Villamor
31edb46dbc
feat(ingestion): adds env property in ContainerProperties ( #11214 )
...
Co-authored-by: siladitya2 <siladitya2@gmail.com>
2024-09-18 14:56:52 +05:30
Andrew Sikowitz
30c4fa91ce
feat(ingest/mongodb): Ingest databases as containers ( #11178 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-08-21 14:53:47 -04:00
Tony Ouyang
943edc3462
feat(ingest/mongodb): improve sorting when downsampling collection schema ( #9856 )
2024-02-21 15:25:29 -08:00
Diego Reiriz Cores
60347d6735
fix(ingest/mongodb): support disabling schemaSamplingSize ( #9295 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-28 16:39:10 +05:30
Tony Ouyang
876de214c9
feat(ingest/mongodb): support stateful ingestion ( #9118 )
2023-11-01 12:43:17 +05:30
nicholas.fwang
852267972c
refactor(ingestion/mongodb): Add platform_instance to mongodb ( #8663 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-10-26 09:57:43 -07:00
Andrew Sikowitz
bf9f380350
fix(ingest): Generate browse paths v2 for more sources; properly pass platform_instance ( #8501 )
2023-07-25 11:35:34 +05:30
Harshal Sheth
fa0fd7b830
fix(ingest): tweak mongodb schema inference to fix test ( #5744 )
2022-08-26 11:15:16 -07:00
varunbharill
a5ec05e2b2
fix(ingest): mongodb enable version check for document size filter. ( #3644 )
2021-11-30 11:33:33 -08:00
Gabe Lyons
ff527f4bed
feat(foreign keys): add foreign key models ( #3275 )
2021-09-22 10:29:27 -07:00
Swaroop Jagadish
88afec7f1c
feat(ingest): adding maxSchemaSize to mongodb source ( #3153 )
2021-08-24 12:15:40 -07:00
rslanka
8844240328
feat: Adding support for nested schemas in ingestion and visualization ( #3079 )
2021-08-11 15:47:18 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest ( #2960 )
2021-07-29 20:04:40 -07:00
Harshal Sheth
be39037b10
build(ingest): reduce dependencies for dev install ( #2872 )
2021-07-14 20:02:48 -07:00
Harshal Sheth
2f921d15e8
fix(ingest): avoid setting timestamps unless source system provides it ( #2843 )
2021-07-08 12:11:06 -07:00
Harshal Sheth
d66381451a
feat(ingest): refactor mce comparison and add pytest update golden files option ( #2812 )
2021-06-30 16:53:20 -07:00
Kevin Hu
554e1637c5
fix(ingest): types for dbt ( #2716 )
2021-06-22 10:37:08 -07:00
Kevin Hu
5ab1cbbbb2
feat(ingest): MongoDB schema inference ( #2546 )
2021-05-13 19:44:33 -07:00
Gabe Lyons
851e00ba9f
feat(lineage): implement support for datasets, charts and dashboards downstream lineage fetching in a generic way ( #2397 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Brian <brianwebtek@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2021-04-23 00:18:39 -07:00
Harshal Sheth
a11329d5b8
refactor(ingest): update test harness to use a compose file per test ( #2392 )
2021-04-13 17:30:24 -07:00
Harshal Sheth
cb24628886
feat(ingest): verify dynamic registry types at runtime ( #2327 )
2021-04-01 12:15:05 -07:00
Harshal Sheth
a921d0deae
feat(ingest): MongoDB ingestion source ( #2289 )
2021-03-23 20:15:44 -07:00
