taufiqibrahim
db78373427
feat(ingest): kafka connect metadata ingestion ( #2516 )
2021-05-18 14:45:38 -07:00
Gary Lucas
af4f3b9683
fix(dbt): set target platform and load schema ( #2483 )
2021-05-17 12:22:52 -07:00
Harshal Sheth
8d910b9e39
docs(ingest): improve kafka schema registry config docs ( #2544 )
2021-05-12 17:54:33 -07:00
Harshal Sheth
a671001824
refactor(ingest): move Airflow into datahub_provider module ( #2521 )
2021-05-12 15:01:11 -07:00
Brian
d7d8870008
feat(usergroup): implement corpgroup in graphql, refactor avatars and ownership in react ( #2519 )
2021-05-11 17:55:45 -07:00
shakti-garg
8ed14a62e2
feat(business_glossary): add new entity business term and its relationship with dataset and its fields ( #2228 )
...
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-05-10 13:20:23 -07:00
Harshal Sheth
50ea58c32d
docs: improve airflow explanations and examples ( #2509 )
2021-05-06 19:12:19 -07:00
Harshal Sheth
7f0656fd5e
fix(ingest): replace ImportError with ModuleNotFoundError ( #2498 )
...
Using the more specific exception will prevent us from accidentally
ignoring errors that should be handled.
2021-05-05 14:05:16 -07:00
Rickard Cardell
48ea19a5f7
feat(react): add custom properties tab on dashboard profile page ( #2439 ) ( #2469 )
2021-04-27 11:26:09 -07:00
Brian
5894365d77
fix(bootstrap): update bootstrap data with more realistic nested schemas ( #2470 )
2021-04-27 11:19:40 -07:00
Gabe Lyons
851e00ba9f
feat(lineage): implement support for datasets, charts and dashboards downstream lineage fetching in a generic way ( #2397 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Brian <brianwebtek@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2021-04-23 00:18:39 -07:00
Gabe Lyons
c7b49de67b
feat(ingest): adding superset ingestion source ( #2425 )
2021-04-22 00:11:54 -07:00
Brian
95b96572c5
feat(react): schema visualization add support for nested structs ( #2423 )
2021-04-20 14:00:10 -07:00
Harshal Sheth
27a672e697
feat(ingest): add Kafka-based emitter example ( #2412 )
2021-04-16 17:54:50 -07:00
Harshal Sheth
91a2f69310
fix(ingest): properly handle fieldDiscriminator with restli ( #2408 )
2021-04-16 09:42:52 -07:00
Gabe Lyons
1e11851a90
feat(sample): adding sample mces for dataflows and datajobs ( #2396 )
2021-04-14 19:27:01 -07:00
Harshal Sheth
2af4603e49
fix(ingest): enable mypy disallow_incomplete_defs and disallow_untyped_decorators ( #2393 )
2021-04-14 13:40:24 -07:00
Harshal Sheth
41cd52f9e2
feat(ingest): add Airflow lineage backend ( #2368 )
2021-04-12 17:40:15 -07:00
Harshal Sheth
bd78b84bd3
feat(ingest): start airflow integration + metadata builders ( #2331 )
2021-04-05 19:11:28 -07:00
amy m
759288161c
feat(ingest): adding support for AWS Glue ( #2319 )
...
Co-authored-by: Harry Nash <harrywilliamnash@gmail.com>
2021-04-04 11:00:27 -07:00
Gabe Lyons
8ab2630fb6
feat(lineage): expandable lineage visualization for dataset <> dataset lineage ( #2333 )
2021-04-03 11:13:25 -07:00
Harshal Sheth
cc19465f55
fix(ingest): resolve array serialization bug ( #2290 )
2021-03-24 10:02:46 -07:00
Gary Lucas
922307f8ec
feat(ingest): Add DBT source to metadata-ingestion ( #2247 )
2021-03-22 23:11:29 -07:00
Dexter Lee
61c37aa04d
refactor(demo): Add empty global tags to BigQuery demo data ( #2258 )
2021-03-18 16:03:05 -07:00
Gabe Lyons
039fe597f7
feat(tags): editing tags from react client on datasets, schemas, charts & dashboards ( #2248 )
2021-03-18 11:52:14 -07:00
Harshal Sheth
aa6bc15cd7
fix(ingest): various avro codegen fixes ( #2232 )
2021-03-15 15:27:30 -07:00
Arun Vasudevan
7750c6120a
feat: MLmodel Graphql Query ( #2166 )
2021-03-13 08:34:48 -08:00
Harshal Sheth
4e15feebfd
fix(ingestion): nullable types and timestamp precision ( #2212 )
2021-03-10 23:29:24 -08:00
Harshal Sheth
6378347f81
feat(ingest): standalone metadata emitters ( #2207 )
2021-03-10 14:32:12 -08:00
Harshal Sheth
d220647094
feat: add date and time types to SQL model ( #2201 )
2021-03-09 23:07:20 -08:00
Gabe Lyons
0046aae7cf
feat(tags): Enriching sample data for tags ( #2194 )
2021-03-08 17:26:41 -08:00
Gabe Lyons
adfe60e97a
feat(tags): adding support for read/write of tags in gms & read-only in react datahub-frontend. ( #2164 )
2021-03-07 11:26:47 -08:00
Harshal Sheth
1f082b114b
feat(ingest): bigquery sample data ( #2178 )
2021-03-05 16:39:34 -08:00
Harshal Sheth
e096c61a32
fix(ingest): update sample MCEs based on MLModel changes ( #2124 )
2021-02-19 17:03:27 -08:00
Harshal Sheth
76e0594b8b
feat(ingest): add support for LDAP ingestion ( #2122 )
2021-02-18 20:05:39 -08:00
Harshal Sheth
dfe00bfee8
feat(ingest): improve error reporting for pipelines ( #2121 )
2021-02-18 11:15:13 -08:00
Harshal Sheth
02ffa6fd54
docs(ingest): add example DAGs for Airflow ( #2116 )
2021-02-17 18:01:22 -08:00
RyanHolstien
ea86ade29b
feat: ML Model Backend Implementation ( #1896 )
...
Co-authored-by: RyanHolstien <rholstien@expediagroup.com>
2021-02-17 13:28:13 -08:00
Harshal Sheth
fd4878a89d
docs(ingest): clarify docs for new ingestion framework ( #2108 )
2021-02-16 15:31:13 -08:00
Harshal Sheth
6e0c7ee37f
Add architecture diagram
2021-02-15 18:29:27 -08:00
Harshal Sheth
6b750fc4fb
Update docs
2021-02-15 18:29:27 -08:00
Harshal Sheth
f807bb44b8
Use type + config everywhere
2021-02-15 18:29:27 -08:00
Harshal Sheth
d483d23fd7
Allow/deny patterns for kafka source
2021-02-15 18:29:27 -08:00
Harshal Sheth
2307c59296
Add support for rich kafka config
2021-02-15 18:29:27 -08:00
Harshal Sheth
29c1cfac4d
Rename yaml -> yml
2021-02-15 18:29:27 -08:00
Harshal Sheth
36874970ce
Finish file sink
2021-02-15 18:29:27 -08:00
Harshal Sheth
2ef62149ea
Create examples directory
2021-02-15 18:29:27 -08:00
