Kevin Hu
1c364b52f6
feat(docs): Docs for S3 ingestion with AWS Glue ( #2672 )
2021-06-14 17:08:50 -07:00
Remi
9fb2e6aaa8
Only work with dbt catalog data if load_catalog is False ( #2686 )
2021-06-14 16:58:19 -07:00
Gabe Lyons
0b75b4a96a
removing whitespace from service aspect ( #2688 )
2021-06-12 17:48:36 -07:00
Vincenzo Lavorini
a7fc76f590
feat(sql_views): added views as datasets for SQLAlchemy DBs ( #2663 )
2021-06-11 17:30:33 -07:00
Harshal Sheth
1b539220d5
feat(ingest): support Oracle service names ( #2676 )
2021-06-11 17:27:34 -07:00
Harshal Sheth
1857f85242
fix(ingest): upgrade acryl-pyhive to use sasl3 instead of sasl ( #2684 )
2021-06-11 17:24:41 -07:00
Rickard Cardell
2cb06188ce
Fix 2592 neo4j connection options ( #2632 )
2021-06-11 09:55:30 -07:00
Harshal Sheth
5eee818a61
fix(ingest): pin to new mypy version ( #2670 )
2021-06-11 09:44:54 -07:00
Kevin Hu
24268c2021
feat(ingest): headers for codegen Python scripts ( #2637 )
2021-06-11 09:44:18 -07:00
Thomas Larsson
61a8994bb6
fix(analytics): Support sasl authentication to kafka ( #2675 )
2021-06-10 12:10:13 -07:00
zack3241
18557ed42a
feat(k8s): Add imagePullSecrets to all K8's jobs ( #2671 )
2021-06-10 12:06:27 -07:00
zack3241
91eb3cc57e
Add get_identifier to hive source in metadata ingestion ( #2667 )
2021-06-09 15:12:17 -07:00
Gabe Lyons
28b5856c36
fix(no-code): Adding Chart input relationship annotations ( #2669 )
...
* chart input relationship pdl fix
* commiting schema.avsc changes
2021-06-09 15:09:50 -07:00
Kevin Hu
ebdaa0e359
feat(ingest): Feast ingestion integration ( #2605 )
...
* Add feast testing setup
* Init Feast test script
* Add feast to dependencies
* Update feast descriptors
* Sort integrations
* Working feast pytest
* Clean up feast docker-compose file
* Expand Feast tests
* Setup feast classes
* Add continuous and bytes data to feature types
* Update field type mapping
* Add PDLs
* Add MLFeatureSetUrn.java
* Comment out feast setup
* Add snapshot file and update inits
* Init Feast golden files generation
* Clean up Feast ingest
* Feast testing comments
* Yield Feature snapshots
* Fix Feature URN naming
* Update feast MCE
* Update Feature URN prefix
* Add MLEntity
* Update golden files with entities
* Specify feast sources
* Add feast source configs
* Working feast docker ingestion
* List entities and features before adding tables
* Add featureset names
* Remove unused
* Rename feast image
* Update README
* Add env to feast URNs
* Fix URN naming
* Remove redundant URN names
* Fix enum backcompatibility
* Move feast testing to docker
* Move URN generators to mce_builder
* Add source for features
* Switch TypeClass -> enum_type
* Rename source -> sourceDataset
* Add local Feast ingest image builds
* Rename Entity -> MLPrimaryKey
* Restore features and keys for each featureset
* Do not json encode source configs
* Remove old source properties from feature sets
* Regenerate golden file
* Fix race condition with Feast tests
* Exclude unknown source
* Update feature datatype enum
* Update README and fix typos
* Fix Entity typo
* Fix path to local docker image
* Specify feast config and version
* Fix feast env variables
* PR fixes
* Refactor feast ingest constants
* Make feature sources optional for back-compatibility
* Remove unused GCP files
* adding docker publish workflow
* Simplify name+namespace in PrimaryKeys
* adding docker publish workflow
* debug
* final attempt
* final final attempt
* final final final commit
* Switch to published ingestion image
* Update name and namespace in java files
* Rename FeatureSet -> FeatureTable
* Regenerate codegen
* Fix initial generation errors
* Update snapshot jsons
* Regenerated schemas
* Fix URN formats
* Revise builds
* Clean up feast URN builders
* Fix naming typos
* Fix Feature Set -> Feature Table
* Fix comments
* PR fixes
* All you need is Urn
* Regenerate snapshots and update validation
* Add UNKNOWN data type
* URNs for source types
* Add note on docker requirement
* Fix typo
* Reorder aspect unions
* Refactor feast ingest functions
* Update snapshot jsons
* Rebuild
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-09 15:07:04 -07:00
Kevin Hu
c0ace2ce59
fix(ingest): fix MyPy stubs ( #2666 )
2021-06-08 16:10:16 -07:00
Harshal Sheth
2f7b4f9def
build(docker): test docker builds in pull request CI ( #2661 )
2021-06-08 09:47:32 -07:00
Dexter Lee
83c5259d14
docs(nocode): fix typo in autocomplete annotation ( #2664 )
2021-06-08 09:08:45 -07:00
Gabe Lyons
d3a1e2ccab
docs(nocode): adding documentation to handle backwards incompatibility issues ( #2662 )
2021-06-07 23:20:00 -07:00
Harshal Sheth
2123c8b6d7
fix(ingest): exclude mssql-odbc from "all" extra ( #2660 )
2021-06-07 14:00:35 -07:00
Dexter Lee
9c030d8325
fix(NoCode): Update snapshot json to latest ( #2655 )
2021-06-07 11:52:52 -07:00
Harshal Sheth
31eae24300
fix(ingest): support mssql encryption via ODBC ( #2657 )
2021-06-04 18:19:11 -07:00
Harshal Sheth
051fa253d1
fix(docker): use debug tag in local dev images ( #2658 )
2021-06-04 18:12:26 -07:00
Harshal Sheth
e73c6525e9
revert: "fix(docker): pin containers to golden hash for release ( #2654 )" ( #2659 )
...
This reverts commit a483933eab6d072ba6d2a414e378eee1e80dbdc6 and moves
us back to using HEAD in quickstart on the master branch.
2021-06-04 18:11:36 -07:00
Gabe Lyons
b1ff56f606
docs(nocode): Adding documentation for no-migration upgrade option ( #2656 )
2021-06-04 17:54:17 -07:00
Dexter Lee
ee454eb5d6
feat(nocode): Add datahub-upgrade job to helm chart and set version to v0.8.1 ( #2643 )
2021-06-04 15:13:32 -07:00
Harshal Sheth
a483933eab
fix(docker): pin containers to golden hash for release ( #2654 )
2021-06-04 12:46:57 -07:00
John Joyce
9829576202
feat(datahub-upgrade): improve no code upgrade logging ( #2653 )
2021-06-04 12:21:17 -07:00
Harshal Sheth
f91062d827
docs(nocode): fix links to datahub-upgrade ( #2651 )
2021-06-04 11:30:06 -07:00
John Joyce
d26903f160
fix(gms): Return empty snapshots when one does not exist ( #2646 )
2021-06-04 11:28:53 -07:00
John Joyce
cc3caa998b
fix(datahub-upgrade): fixing mis-spelled schema registry url ( #2652 )
2021-06-04 11:05:13 -07:00
Harshal Sheth
9e79272a5f
fix: use head tag by default in quickstart ( #2650 )
2021-06-04 09:52:10 -07:00
Dexter Lee
e187b07cf3
docs(nocode): Update migration docs with workaround for stuck upgrade( #2649 )
2021-06-04 00:18:41 -07:00
Dexter Lee
d5934f70bb
fix(nocode): Fix docker image tag for run_upgrade script ( #2648 )
2021-06-03 21:42:23 -07:00
Dexter Lee
5ca484a153
fix(analytics): fix index names ( #2647 )
2021-06-03 21:38:43 -07:00
Harshal Sheth
7f0c6bb5c9
fix(build): don't purge ingestion codegen files on gradle clean ( #2645 )
2021-06-03 20:33:25 -07:00
John Joyce
c98446c9a5
fix(datahub-upgrade): remove debug flag ( #2640 )
2021-06-03 16:26:20 -07:00
John Joyce
81c9fc30aa
feat(datahub-upgrade): Use the "head" image tag. ( #2641 )
2021-06-03 16:25:17 -07:00
Gabe Lyons
b6889181ce
docs(no-code): removing unused snapshot annotations ( #2642 )
2021-06-03 16:24:43 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling ( #2629 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
Shirshanka Das
7a0bab62b6
docs: update roadmap with accomplished items ( #2617 )
2021-06-03 11:43:26 -07:00
Harshal Sheth
a0ad590b3f
fix(ingest): improve redshift ingestion performance ( #2635 )
2021-06-03 11:14:34 -07:00
shubham garg
4e73011bb9
feat(react): replace user urn with username ( #2599 )
...
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-06-03 11:10:03 -07:00
Gabe Lyons
47554d2d4a
fix(react): url encoding urns and tag profile fix ( #2623 )
2021-06-03 11:08:43 -07:00
Harshal Sheth
6b9d0d0129
fix(ingest): include urn as key for kafka emitter ( #2634 )
2021-06-03 11:04:40 -07:00
Dexter Lee
9bff4e1cc4
fix(ci): update trigger to always generate docker images ( #2636 )
2021-06-03 11:02:59 -07:00
Rickard Cardell
2f3de31ec3
feat(react): custom properties are now sortable by name in the UI ( #2622 )
2021-06-02 09:48:39 -07:00
Thomas Larsson
b512920022
fix(ingestion): improve robustness of glue ingestion source ( #2626 )
...
fixes : #2625
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-06-01 11:02:52 -07:00
Brian
7261eb9230
fix(react): update ispartofbuilderfromdataflow, update ui in datajob header ( #2619 )
2021-05-28 10:25:00 -07:00
John Joyce
4d82ff8b62
feat(analytics): support configuration of Kafka SSL ( #2620 )
2021-05-27 16:37:57 -07:00
Brian
409246a99d
feat(react): eliminate noises in react build, test and cleanup, get rid of warnings ( #2618 )
2021-05-27 11:23:09 -07:00
