Ravindra Lanka
|
f4209504f1
|
feat(ingest): support Kafka confluent external schema resolution by name or subject (#4035)
|
2022-02-02 07:44:56 -08:00 |
|
Aseem Bansal
|
400e0fe838
|
feat(ingest): kafka - support schema references (#3862)
|
2022-01-17 14:29:54 -08:00 |
|
John Joyce
|
352a0abf8d
|
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2021-07-30 17:41:03 -07:00 |
|
Harshal Sheth
|
937f02c6bc
|
feat: usage stats (part 1) (#2750)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
|
2021-06-24 17:11:00 -07:00 |
|
Harshal Sheth
|
bd78b84bd3
|
feat(ingest): start airflow integration + metadata builders (#2331)
|
2021-04-05 19:11:28 -07:00 |
|
Harshal Sheth
|
ac064584ae
|
refactor(ingest): cleanup configuration models (#2134)
|
2021-02-23 15:55:31 -08:00 |
|
Harshal Sheth
|
38f75be8ad
|
gometa -> datahub
|
2021-02-15 18:29:27 -08:00 |
|
Harshal Sheth
|
9332e6b878
|
Add isort to CI
|
2021-02-15 18:29:27 -08:00 |
|
Harshal Sheth
|
d483d23fd7
|
Allow/deny patterns for kafka source
|
2021-02-15 18:29:27 -08:00 |
|
Harshal Sheth
|
43d5fac494
|
Black
|
2021-02-15 18:29:27 -08:00 |
|
Harshal Sheth
|
a87161cad7
|
Run black formatting on tests
|
2021-02-15 18:29:27 -08:00 |
|
Harshal Sheth
|
2307c59296
|
Add support for rich kafka config
|
2021-02-15 18:29:27 -08:00 |
|
Harshal Sheth
|
8ca8ef2d23
|
Fix kafka tests
|
2021-02-15 18:29:27 -08:00 |
|
Harshal Sheth
|
c7892ada4c
|
Codegen avro + datahub kafka sink (#3)
* Add codegen
* New architecture + setup file -> console pipeline
* Cleanup source loader
* Basic Kafka metadata source
* Kafka source and extractor
* Add kwargs construct interface
* Fix kafka source unit test
* start working on pipeline test
* kafka datahub sink
* Make myself a profile
* Ingest to datahub from kafka
* Update codegen
* Add restli transport
* Fix bug in restli conversion
|
2021-02-15 18:29:27 -08:00 |
|
Shirshanka Das
|
9e61220132
|
checking in testing fixtures. docker still not working
|
2021-02-15 18:29:27 -08:00 |
|