Harshal Sheth
|
47be95689e
|
refactor(ingest/stateful): remove most remaining state classes (#6791)
|
2022-12-19 13:40:48 -05:00 |
|
Dmitry Bryazgin
|
551ef1b335
|
feat(ingest): add stateful ingestion to the ldap source (#6127)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2022-12-13 01:13:39 -05:00 |
|
Alexey Kravtsov
|
c182fe7fca
|
feat(ingestion): add groups to ldap users (#5470)
|
2022-08-01 15:04:30 -07:00 |
|
Atul Saurav
|
648ebfcc93
|
feat(ingestion) ldap: make ldap attrs keys configurable (#4682)
|
2022-06-21 12:01:00 -07:00 |
|
John Joyce
|
8c9c696cdd
|
feat(ingest): Adding an Okta Integration to extract Users, Groups, Group Membership (#3043)
|
2021-08-11 18:49:16 -07:00 |
|
Gabe Lyons
|
aa253f5b3b
|
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960)
|
2021-07-29 20:04:40 -07:00 |
|
Harshal Sheth
|
be39037b10
|
build(ingest): reduce dependencies for dev install (#2872)
|
2021-07-14 20:02:48 -07:00 |
|
Harshal Sheth
|
d66381451a
|
feat(ingest): refactor mce comparison and add pytest update golden files option (#2812)
|
2021-06-30 16:53:20 -07:00 |
|
Kevin Hu
|
554e1637c5
|
fix(ingest): types for dbt (#2716)
|
2021-06-22 10:37:08 -07:00 |
|
Kevin Hu
|
ebdaa0e359
|
feat(ingest): Feast ingestion integration (#2605)
* Add feast testing setup
* Init Feast test script
* Add feast to dependencies
* Update feast descriptors
* Sort integrations
* Working feast pytest
* Clean up feast docker-compose file
* Expand Feast tests
* Setup feast classes
* Add continuous and bytes data to feature types
* Update field type mapping
* Add PDLs
* Add MLFeatureSetUrn.java
* Comment out feast setup
* Add snapshot file and update inits
* Init Feast golden files generation
* Clean up Feast ingest
* Feast testing comments
* Yield Feature snapshots
* Fix Feature URN naming
* Update feast MCE
* Update Feature URN prefix
* Add MLEntity
* Update golden files with entities
* Specify feast sources
* Add feast source configs
* Working feast docker ingestion
* List entities and features before adding tables
* Add featureset names
* Remove unused
* Rename feast image
* Update README
* Add env to feast URNs
* Fix URN naming
* Remove redundant URN names
* Fix enum backcompatibility
* Move feast testing to docker
* Move URN generators to mce_builder
* Add source for features
* Switch TypeClass -> enum_type
* Rename source -> sourceDataset
* Add local Feast ingest image builds
* Rename Entity -> MLPrimaryKey
* Restore features and keys for each featureset
* Do not json encode source configs
* Remove old source properties from feature sets
* Regenerate golden file
* Fix race condition with Feast tests
* Exclude unknown source
* Update feature datatype enum
* Update README and fix typos
* Fix Entity typo
* Fix path to local docker image
* Specify feast config and version
* Fix feast env variables
* PR fixes
* Refactor feast ingest constants
* Make feature sources optional for back-compatibility
* Remove unused GCP files
* adding docker publish workflow
* Simplify name+namespace in PrimaryKeys
* adding docker publish workflow
* debug
* final attempt
* final final attempt
* final final final commit
* Switch to published ingestion image
* Update name and namespace in java files
* Rename FeatureSet -> FeatureTable
* Regenerate codegen
* Fix initial generation errors
* Update snapshot jsons
* Regenerated schemas
* Fix URN formats
* Revise builds
* Clean up feast URN builders
* Fix naming typos
* Fix Feature Set -> Feature Table
* Fix comments
* PR fixes
* All you need is Urn
* Regenerate snapshots and update validation
* Add UNKNOWN data type
* URNs for source types
* Add note on docker requirement
* Fix typo
* Reorder aspect unions
* Refactor feast ingest functions
* Update snapshot jsons
* Rebuild
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
|
2021-06-09 15:07:04 -07:00 |
|
adriaanslechten
|
1295c44615
|
feat(ingest) LDAP groups ingestion (#2434)
|
2021-04-22 13:56:30 -07:00 |
|
Harshal Sheth
|
ffe03e6758
|
fix(ingest): streamline codegen init methods (#2400)
|
2021-04-14 19:25:57 -07:00 |
|
Harshal Sheth
|
a11329d5b8
|
refactor(ingest): update test harness to use a compose file per test (#2392)
|
2021-04-13 17:30:24 -07:00 |
|
Harshal Sheth
|
cb24628886
|
feat(ingest): verify dynamic registry types at runtime (#2327)
|
2021-04-01 12:15:05 -07:00 |
|
Harshal Sheth
|
aa6bc15cd7
|
fix(ingest): various avro codegen fixes (#2232)
|
2021-03-15 15:27:30 -07:00 |
|
Harshal Sheth
|
4e15feebfd
|
fix(ingestion): nullable types and timestamp precision (#2212)
|
2021-03-10 23:29:24 -08:00 |
|
Harshal Sheth
|
ac064584ae
|
refactor(ingest): cleanup configuration models (#2134)
|
2021-02-23 15:55:31 -08:00 |
|
Harshal Sheth
|
76e0594b8b
|
feat(ingest): add support for LDAP ingestion (#2122)
|
2021-02-18 20:05:39 -08:00 |
|