Swaroop Jagadish
|
3984506f51
|
feat(cli): add support for deletion based on filters, soft deletes an… (#3527)
|
2021-11-07 22:13:50 -08:00 |
|
mayurinehate
|
192f0d33a2
|
feat(ingest): kafka connect source improvements (#3481)
|
2021-11-03 15:03:05 -07:00 |
|
Ravindra Lanka
|
a1bf95307b
|
feat(ingest): user configurable dataset profiling. (#3453)
|
2021-10-27 19:49:40 -07:00 |
|
varunbharill
|
7e27355837
|
fix(ingest): Add gcp logging dependency for bigquery source. (#3451)
fixes #3450
|
2021-10-25 17:50:07 -07:00 |
|
Remi
|
91d20e41c0
|
fix(ingest): fix lookml derived tables parsing (#3443)
|
2021-10-25 14:08:30 -07:00 |
|
Harshal Sheth
|
6e5d1fe42f
|
fix(ingest): switch to avro from deprecated avro-python3 (#3412)
|
2021-10-18 15:35:27 -07:00 |
|
aseembansal-gogo
|
ebe0b3f7c1
|
feat(ingest): add mariadb as possible source (#3245)
|
2021-10-12 23:27:47 -07:00 |
|
mayurinehate
|
d22d1c2795
|
feat(ingest): add trino source to datahub (#3307)
|
2021-10-06 11:57:06 -07:00 |
|
taufiqibrahim
|
ed38168f54
|
feat(ingest): add support for parsing lineage for redash connector (#3267)
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
|
2021-10-05 23:08:02 -07:00 |
|
Chinmay Bhat
|
5a239905df
|
feat(ingest): add redshift usage source (#3277)
|
2021-09-23 13:39:33 -07:00 |
|
Swaroop Jagadish
|
9db7a34cfa
|
feat(ingest): looker and lookml improvements - connection, explores, folders (#3255)
|
2021-09-16 23:09:45 -07:00 |
|
Chinmay Bhat
|
9014afd9ed
|
refactor(ingest): rename azure source to azure_ad (#3181)
|
2021-09-02 09:24:10 -07:00 |
|
Shirshanka Das
|
88a3523fbb
|
feat(ingest): Add a business glossary source (#3164)
|
2021-09-01 15:10:12 -07:00 |
|
Chinmay Bhat
|
bda881cbf2
|
feat(ingest): Adding Azure Source integration to ingest users, groups and group memberships (#3161)
|
2021-08-29 08:32:40 -07:00 |
|
Swaroop Jagadish
|
65943cc190
|
deps(ingest): upgrade to pick up acryl-pyhive changes (#3145)
|
2021-08-23 20:18:11 -07:00 |
|
Swaroop Jagadish
|
72af0c317a
|
fix(deps): Adding min version to python-dateutil to guard against isoparse failures (#3139)
|
2021-08-21 18:41:28 -07:00 |
|
taufiqibrahim
|
dd1b81b727
|
feat(ingest): adding redash source (#2918)
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
|
2021-08-18 12:03:03 -07:00 |
|
John Joyce
|
8c9c696cdd
|
feat(ingest): Adding an Okta Integration to extract Users, Groups, Group Membership (#3043)
|
2021-08-11 18:49:16 -07:00 |
|
Kevin Hu
|
f642d6c0be
|
fix(ingest): sqlalchemy-snowflake add constraints to make sure we don't pull in 1.2.5 (#3078)
|
2021-08-11 13:20:01 -07:00 |
|
Chinmay Bhat
|
7abcb45f8c
|
feat(ingest): add support for jdbc connector to kafka-connect source (#3076)
|
2021-08-11 08:50:38 -07:00 |
|
Kevin Hu
|
40ecd96c7a
|
feat(ingest): replace and warn against relative imports (#3033)
|
2021-08-06 10:25:30 -07:00 |
|
John Joyce
|
352a0abf8d
|
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2021-07-30 17:41:03 -07:00 |
|
Gabe Lyons
|
aa253f5b3b
|
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960)
|
2021-07-29 20:04:40 -07:00 |
|
Kevin Hu
|
bf2775f6cf
|
feat(ingest): type stubs for boto3 (#2975)
|
2021-07-28 20:35:35 -07:00 |
|
Harshal Sheth
|
7ab6355b1c
|
feat(ingest): stricter deserialization for MCE JSONs (#2976)
|
2021-07-28 14:50:21 -07:00 |
|
Harshal Sheth
|
328b098d01
|
text(ingestion): test multiple python versions in CI (#2952)
|
2021-07-26 13:25:58 -07:00 |
|
Kevin Hu
|
662017ef17
|
fix(ingest): patch lookml types and refactor ingestion sources layout (#2950)
|
2021-07-26 13:06:52 -07:00 |
|
Harshal Sheth
|
5f0b4464f5
|
fix(ingest): pin snowflake sqlalchemy connector (#2923)
|
2021-07-20 19:28:40 -07:00 |
|
aseembansal-gogo
|
6e1b2cf4f7
|
feat(ingest): Add option to change name of database for postgres (#2898)
|
2021-07-20 07:01:42 -07:00 |
|
Harshal Sheth
|
283d131546
|
test(ingest): update tox test configurations and test airflow 2.x by default (#2906)
|
2021-07-17 20:00:50 -07:00 |
|
Harshal Sheth
|
8e573fdb31
|
fix(ingest): fix druid misconfiguration bug (#2882)
|
2021-07-14 20:29:23 -07:00 |
|
Harshal Sheth
|
be39037b10
|
build(ingest): reduce dependencies for dev install (#2872)
|
2021-07-14 20:02:48 -07:00 |
|
Harshal Sheth
|
74e34dddfc
|
feat(ingest): prettify stack traces in CLI (#2845)
|
2021-07-08 13:29:34 -07:00 |
|
Harshal Sheth
|
2f921d15e8
|
fix(ingest): avoid setting timestamps unless source system provides it (#2843)
|
2021-07-08 12:11:06 -07:00 |
|
Harshal Sheth
|
6fe663bf6a
|
feat(ingest): basic support for complex hive types (#2804)
|
2021-06-30 22:57:13 -07:00 |
|
Kevin Hu
|
4da76726d3
|
feat(ingest): SageMaker feature store ingestion (#2758)
|
2021-06-29 19:43:31 -07:00 |
|
Remi
|
2aa95ec750
|
feat(ingest): Improve lookml sql derived tables detection, add cascading derived tables to lineage (#2770)
|
2021-06-29 19:41:34 -07:00 |
|
Harshal Sheth
|
c8fe8d4026
|
fix(ingest): quote table names in hive (#2801)
|
2021-06-29 17:51:01 -07:00 |
|
Harshal Sheth
|
19b2a42a00
|
feat: usage stats (part 2) (#2762)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
|
2021-06-24 19:44:59 -07:00 |
|
Harshal Sheth
|
937f02c6bc
|
feat: usage stats (part 1) (#2750)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
|
2021-06-24 17:11:00 -07:00 |
|
Harshal Sheth
|
5d93f249b4
|
feat(ingest): expose additional types to Python via codegen (#2712)
|
2021-06-17 10:04:28 -07:00 |
|
Harshal Sheth
|
7e9a04479b
|
test(ingest): simplify docker cleanup commands (#2699)
|
2021-06-16 16:59:28 -07:00 |
|
Harshal Sheth
|
1b539220d5
|
feat(ingest): support Oracle service names (#2676)
|
2021-06-11 17:27:34 -07:00 |
|
Harshal Sheth
|
1857f85242
|
fix(ingest): upgrade acryl-pyhive to use sasl3 instead of sasl (#2684)
|
2021-06-11 17:24:41 -07:00 |
|
Harshal Sheth
|
5eee818a61
|
fix(ingest): pin to new mypy version (#2670)
|
2021-06-11 09:44:54 -07:00 |
|
zack3241
|
91eb3cc57e
|
Add get_identifier to hive source in metadata ingestion (#2667)
|
2021-06-09 15:12:17 -07:00 |
|
Kevin Hu
|
ebdaa0e359
|
feat(ingest): Feast ingestion integration (#2605)
* Add feast testing setup
* Init Feast test script
* Add feast to dependencies
* Update feast descriptors
* Sort integrations
* Working feast pytest
* Clean up feast docker-compose file
* Expand Feast tests
* Setup feast classes
* Add continuous and bytes data to feature types
* Update field type mapping
* Add PDLs
* Add MLFeatureSetUrn.java
* Comment out feast setup
* Add snapshot file and update inits
* Init Feast golden files generation
* Clean up Feast ingest
* Feast testing comments
* Yield Feature snapshots
* Fix Feature URN naming
* Update feast MCE
* Update Feature URN prefix
* Add MLEntity
* Update golden files with entities
* Specify feast sources
* Add feast source configs
* Working feast docker ingestion
* List entities and features before adding tables
* Add featureset names
* Remove unused
* Rename feast image
* Update README
* Add env to feast URNs
* Fix URN naming
* Remove redundant URN names
* Fix enum backcompatibility
* Move feast testing to docker
* Move URN generators to mce_builder
* Add source for features
* Switch TypeClass -> enum_type
* Rename source -> sourceDataset
* Add local Feast ingest image builds
* Rename Entity -> MLPrimaryKey
* Restore features and keys for each featureset
* Do not json encode source configs
* Remove old source properties from feature sets
* Regenerate golden file
* Fix race condition with Feast tests
* Exclude unknown source
* Update feature datatype enum
* Update README and fix typos
* Fix Entity typo
* Fix path to local docker image
* Specify feast config and version
* Fix feast env variables
* PR fixes
* Refactor feast ingest constants
* Make feature sources optional for back-compatibility
* Remove unused GCP files
* adding docker publish workflow
* Simplify name+namespace in PrimaryKeys
* adding docker publish workflow
* debug
* final attempt
* final final attempt
* final final final commit
* Switch to published ingestion image
* Update name and namespace in java files
* Rename FeatureSet -> FeatureTable
* Regenerate codegen
* Fix initial generation errors
* Update snapshot jsons
* Regenerated schemas
* Fix URN formats
* Revise builds
* Clean up feast URN builders
* Fix naming typos
* Fix Feature Set -> Feature Table
* Fix comments
* PR fixes
* All you need is Urn
* Regenerate snapshots and update validation
* Add UNKNOWN data type
* URNs for source types
* Add note on docker requirement
* Fix typo
* Reorder aspect unions
* Refactor feast ingest functions
* Update snapshot jsons
* Rebuild
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2021-06-09 15:07:04 -07:00 |
|
Kevin Hu
|
c0ace2ce59
|
fix(ingest): fix MyPy stubs (#2666)
|
2021-06-08 16:10:16 -07:00 |
|
Harshal Sheth
|
2123c8b6d7
|
fix(ingest): exclude mssql-odbc from "all" extra (#2660)
|
2021-06-07 14:00:35 -07:00 |
|
Harshal Sheth
|
31eae24300
|
fix(ingest): support mssql encryption via ODBC (#2657)
|
2021-06-04 18:19:11 -07:00 |
|