Rickard Cardell
|
2f7e49b399
|
feat(ingest): datahub-rest - Make datahub-rest client more robust by configurable retries. (#3826) (#3860)
|
2022-01-11 19:35:06 -08:00 |
|
Swaroop Jagadish
|
480ad24282
|
feat(ingest): dbt - add support for dbt meta mapping (#3832)
|
2022-01-05 16:32:05 -08:00 |
|
Tamas Nemeth
|
e5d8313788
|
feat(ingest): sql parsing - Replacing sqlmetadata sql parser lib with sqlineage parser lib (#3806)
|
2022-01-05 12:22:59 -08:00 |
|
Tamas Nemeth
|
5df5150e51
|
feat(ingest): Add config option to set Bigquery credential in source config (#3786)
|
2021-12-27 05:48:45 -08:00 |
|
Sergio Gómez Villamor
|
3fa22e1138
|
feat(transform): adds simple add dataset properties transform (#3778)
|
2021-12-22 08:51:38 -08:00 |
|
Tamas Nemeth
|
2ee1a78f4e
|
fix(ingestion): Fix for same schema foreign key reference (#3769)
|
2021-12-20 07:11:55 -08:00 |
|
Harshal Sheth
|
22cef5f897
|
refactor(test): replace CliRunner with run_datahub_cmd method (#3746)
|
2021-12-16 20:07:38 -08:00 |
|
Harshal Sheth
|
adf9d2ead7
|
test(ingest): fix pytest warning for class starting with Test (#3745)
|
2021-12-14 22:44:42 -08:00 |
|
Tamas Nemeth
|
b9f67c5b65
|
feat(ingest): trim long sql queries in usage connector (#3725)
|
2021-12-13 09:16:24 -08:00 |
|
mayurinehate
|
bd4ecbc7b9
|
fix(nifi): add env in nifi config, add unit tests, fix nifi doc (#3703)
|
2021-12-09 13:34:13 -08:00 |
|
ecooklin
|
1a5121a5ae
|
feat(ingest): adds glossary terms transformer (#3657)
|
2021-12-07 21:54:15 -08:00 |
|
Adrian Garcia Badaracco
|
bd53f377ec
|
fix(tests): fix typo in test name (#3582)
* fix(tests): fix typo in test name
* find & replace function name
|
2021-11-28 21:09:42 -08:00 |
|
Swaroop Jagadish
|
6a00cfb4a1
|
feat(ingest): adding snowflake app name to connection string (#3574)
|
2021-11-15 13:08:07 -08:00 |
|
Vincenzo Lavorini
|
6cd31b5bdc
|
feat(ingest): adding openapi ingestion (#2706)
|
2021-11-09 21:22:15 -08:00 |
|
Noé López
|
cde1ce043d
|
feat(ingest): add transformer to add properties (#3480)
|
2021-11-09 20:03:21 -08:00 |
|
Ravindra Lanka
|
dcb8789f17
|
feat(ingestion): Support for converting AVRO schemas with logical types to MCE fields. (#3546)
|
2021-11-09 19:59:01 -08:00 |
|
Ravindra Lanka
|
c3f1bf0534
|
fix(ingestion): Make AVRO schema parsing robust to exceptions. (#3541)
|
2021-11-09 18:01:18 -08:00 |
|
Swaroop Jagadish
|
ec406c7928
|
feat(ingest): read-modify-write capabilities during ingestion, adding ownership patch transformer (#3506)
|
2021-11-03 21:39:52 -07:00 |
|
Kevin Hu
|
de41134a33
|
fix(ingestion): fix incorrect glue job names (#3503)
|
2021-11-02 22:54:47 -07:00 |
|
Harshal Sheth
|
dccef30daf
|
perf(ingest): lazy load ingestion plugins (#3430)
|
2021-10-25 14:10:24 -07:00 |
|
aseembansal-gogo
|
9dff1b7a1c
|
fix(ingest): allow database alias, remove extra removal from connect_… (#3352)
|
2021-10-19 22:29:38 -07:00 |
|
mayurinehate
|
f5d37c0621
|
feat(ingest): add complex types support in hive and trino source (#3375)
|
2021-10-18 22:53:51 -07:00 |
|
Harshal Sheth
|
6e5d1fe42f
|
fix(ingest): switch to avro from deprecated avro-python3 (#3412)
|
2021-10-18 15:35:27 -07:00 |
|
aseembansal-gogo
|
ebe0b3f7c1
|
feat(ingest): add mariadb as possible source (#3245)
|
2021-10-12 23:27:47 -07:00 |
|
Harshal Sheth
|
b43945ce55
|
test(airflow): remove unneeded execution_date parameter from test (#3368)
|
2021-10-12 23:25:27 -07:00 |
|
Swaroop Jagadish
|
7dab06519d
|
fix(ci): fix task instance constructor in airflow tests (#3366)
|
2021-10-11 20:58:37 -07:00 |
|
taufiqibrahim
|
ed38168f54
|
feat(ingest): add support for parsing lineage for redash connector (#3267)
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
|
2021-10-05 23:08:02 -07:00 |
|
Sergio Gómez Villamor
|
696ad2ccc4
|
feat(ingest): adds replace_existing config to browse path transformer (#3313)
|
2021-10-01 12:35:16 -07:00 |
|
adriaanslechten
|
185f7e2f5f
|
feat(ingest): optional custom headers REST emitter (#3290)
Co-authored-by: Adriaan Slechten <adriaan.slechten@klarna.com>
|
2021-09-23 12:53:39 -07:00 |
|
Gabe Lyons
|
ff527f4bed
|
feat(foreign keys): add foreign key models (#3275)
|
2021-09-22 10:29:27 -07:00 |
|
aseembansal-gogo
|
97bed71e1c
|
feat(ingest): support for env variable in cli (#3215)
|
2021-09-16 23:18:42 -07:00 |
|
aseembansal-gogo
|
903348e1db
|
fix(ingest): add missing partition keys in schema for glue sources (#3238)
|
2021-09-15 21:39:49 -07:00 |
|
Sergio Gómez Villamor
|
9e28423c6d
|
feat(ingest): add optional config for ownership type in ownership transformers (#3159)
Co-authored-by: Sergio Gómez <sergio.gomez.villamor@adevinta.com>
|
2021-09-01 22:44:03 -07:00 |
|
Fredrik Sannholm
|
f73725fdf6
|
feat(ingestion): bring your own SQL parser (#3110)
|
2021-08-23 20:21:48 -07:00 |
|
taufiqibrahim
|
dd1b81b727
|
feat(ingest): adding redash source (#2918)
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
|
2021-08-18 12:03:03 -07:00 |
|
Gabe Lyons
|
b73d0ebb8b
|
feat: Adding clarity around qualified unions and removing extra lines for structs (#3091)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
|
2021-08-12 16:25:44 -07:00 |
|
rslanka
|
8844240328
|
feat: Adding support for nested schemas in ingestion and visualization (#3079)
|
2021-08-11 15:47:18 -07:00 |
|
Rahul Jain
|
0e0198f385
|
feat(ingest): Added support for "add dataset ownership by regex match" (#2990)
|
2021-08-10 11:03:16 -07:00 |
|
Kevin Hu
|
5891482114
|
fix(ingest): apply case insensitive regex matching by default (#3067)
|
2021-08-10 10:35:57 -07:00 |
|
aseembansal-gogo
|
9ee091f518
|
feat(ingest): add transformers to clear dataset ownership, mark status, add browse paths (#2986)
|
2021-08-09 09:43:46 -07:00 |
|
Dexter Lee
|
8316316daa
|
fix(ingest): add default configurable timeout for rest emitter (#3055)
|
2021-08-08 22:30:55 -07:00 |
|
aseembansal-gogo
|
ac345e0ade
|
feat(ingest): add underlying platform for glue (#3035)
|
2021-08-06 10:19:21 -07:00 |
|
Dexter Lee
|
51a2669332
|
feat(ingest): add kafka emitters for MetadataChangeProposal format (#3018)
|
2021-08-03 11:17:16 -07:00 |
|
John Joyce
|
352a0abf8d
|
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2021-07-30 17:41:03 -07:00 |
|
Gabe Lyons
|
aa253f5b3b
|
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960)
|
2021-07-29 20:04:40 -07:00 |
|
Gabe Lyons
|
d9d03c9bd9
|
feat(ml-model): adding ml models and ml model groups (#2961)
|
2021-07-28 20:39:05 -07:00 |
|
Kevin Hu
|
bf2775f6cf
|
feat(ingest): type stubs for boto3 (#2975)
|
2021-07-28 20:35:35 -07:00 |
|
Chinmay Bhat
|
a33770b022
|
fix(ingest): fix hive ingestion to respect database configuration (#2978)
|
2021-07-28 20:20:18 -07:00 |
|
Harshal Sheth
|
7ab6355b1c
|
feat(ingest): stricter deserialization for MCE JSONs (#2976)
|
2021-07-28 14:50:21 -07:00 |
|
Harshal Sheth
|
14bca4c2f6
|
fix(ingestion): isolate dependency requirements of airflow hooks (#2977)
|
2021-07-28 14:23:06 -07:00 |
|