John Joyce
3668de85e0
Fixing domains double icon on profile ( #4093 )
2022-02-08 15:21:07 -08:00
John Joyce
2a9a076fc1
feat(ingest): Adding Tableau Source Connector [BETA] ( #4063 )
2022-02-08 14:26:44 -08:00
John Joyce
169cd4fde9
feat(containers): Adding Containers UI (as demo'd in Jan Townhall) ( #4037 )
2022-02-02 13:51:39 -08:00
Tamas Nemeth
928ab74f33
feat(ingest): bigquery - profile only the latest partition/shard ( #3930 )
2022-02-01 10:05:35 -08:00
dipeshmaurya
ad0019cb22
fix(docs): typo in bigquery_to_datahub.yml ( #3988 )
2022-01-27 15:01:59 -08:00
John Joyce
0da1a6b53d
fix(graphQL): Fixing set ordering in batchGet of entities ( #3950 )
2022-01-23 11:24:09 -08:00
Ravindra Lanka
a44b48a6b8
feat(ingest): elasticsearch - add Elasticsearch Source ( #3893 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-14 13:10:12 -08:00
Tamas Nemeth
0f20d60bfc
feat(profiler): using approximate queries for profiling ( #3752 )
2022-01-05 12:42:15 -08:00
Tamas Nemeth
450cdc1739
feat(snowflake-usage): Generate email address if not exists ( #3791 )
2021-12-29 08:14:18 -08:00
Tamas Nemeth
5df5150e51
feat(ingest): Add config option to set Bigquery credential in source config ( #3786 )
2021-12-27 05:48:45 -08:00
jawadqu
b4eaa9e09e
feat(ingestion): Mode retry wait logic to avoid hitting Mode API rate limit ( #3761 )
2021-12-16 19:17:12 -08:00
jawadqu
578590e795
feat(ingestion) : Add Metabase Source Connector ( #3602 )
...
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-13 23:02:47 -08:00
Gabe Lyons
8394fc62b0
feat(mode): add mode analytics ingestion source ( #3710 )
2021-12-09 16:10:08 -08:00
mayurinehate
bd4ecbc7b9
fix(nifi): add env in nifi config, add unit tests, fix nifi doc ( #3703 )
2021-12-09 13:34:13 -08:00
Gabe Lyons
46850324d2
fix(ingest): revert accidental change to example recipe file_to_datahub_rest.yml ( #3698 )
2021-12-08 16:56:08 -08:00
mayurinehate
1d7ec8dba8
feat(ingest): add nifi source ( #3681 )
2021-12-08 14:56:31 -08:00
John Joyce
2f03ad854b
feat(recommendations): Recommendations infra P1 ( #3455 )
2021-10-26 21:23:08 -07:00
John Joyce
ed01b59a00
feat(users & groups): User & Groups Management GraphQL APIs + UI ( #3318 )
2021-10-07 16:14:35 -07:00
taufiqibrahim
ed38168f54
feat(ingest): add support for parsing lineage for redash connector ( #3267 )
...
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
2021-10-05 23:08:02 -07:00
Chinmay Bhat
9014afd9ed
refactor(ingest): rename azure source to azure_ad ( #3181 )
2021-09-02 09:24:10 -07:00
Shirshanka Das
88a3523fbb
feat(ingest): Add a business glossary source ( #3164 )
2021-09-01 15:10:12 -07:00
Chinmay Bhat
bda881cbf2
feat(ingest): Adding Azure Source integration to ingest users, groups and group memberships ( #3161 )
2021-08-29 08:32:40 -07:00
taufiqibrahim
dd1b81b727
feat(ingest): adding redash source ( #2918 )
...
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
2021-08-18 12:03:03 -07:00
John Joyce
8c9c696cdd
feat(ingest): Adding an Okta Integration to extract Users, Groups, Group Membership ( #3043 )
2021-08-11 18:49:16 -07:00
rslanka
8844240328
feat: Adding support for nested schemas in ingestion and visualization ( #3079 )
2021-08-11 15:47:18 -07:00
Kevin Hu
45247083e3
docs(ingest): link to docs from recipes ( #3058 )
2021-08-09 10:00:47 -07:00
Kevin Hu
32b8fc6108
feat(docs): refactor source and sink ingestion docs ( #3031 )
2021-08-08 13:40:51 -07:00
John Joyce
352a0abf8d
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect ( #2983 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest ( #2960 )
2021-07-29 20:04:40 -07:00
Harshal Sheth
3e328d9511
fix(ingest): add quotes to secured kafka yaml config example ( #2911 )
2021-07-22 13:20:00 -07:00
Kevin Hu
859fab8bd3
docs(ingest): update sample recipe and test input for dbt ( #2917 )
2021-07-20 13:28:37 -07:00
Kevin Hu
a2106ca9e8
feat(ingest): SageMaker jobs and models ( #2830 )
2021-07-08 16:16:16 -07:00
Harshal Sheth
288d17f07e
docs(ingest): update links to Kafka docs ( #2834 )
2021-07-06 15:33:52 -07:00
Kevin Hu
4da76726d3
feat(ingest): SageMaker feature store ingestion ( #2758 )
2021-06-29 19:43:31 -07:00
Kevin Hu
7083de9b4f
fix(ingest): use correct platform for MongoDB ingestion ( #2783 )
2021-06-29 10:16:58 -07:00
Kevin Hu
a89094da5b
feat(ingest): add support for Glue ETL jobs ( #2687 )
2021-06-22 11:33:22 -07:00
Kevin Hu
554e1637c5
fix(ingest): types for dbt ( #2716 )
2021-06-22 10:37:08 -07:00
Harshal Sheth
5d93f249b4
feat(ingest): expose additional types to Python via codegen ( #2712 )
2021-06-17 10:04:28 -07:00
Kevin Hu
ebdaa0e359
feat(ingest): Feast ingestion integration ( #2605 )
...
* Add feast testing setup
* Init Feast test script
* Add feast to dependencies
* Update feast descriptors
* Sort integrations
* Working feast pytest
* Clean up feast docker-compose file
* Expand Feast tests
* Setup feast classes
* Add continuous and bytes data to feature types
* Update field type mapping
* Add PDLs
* Add MLFeatureSetUrn.java
* Comment out feast setup
* Add snapshot file and update inits
* Init Feast golden files generation
* Clean up Feast ingest
* Feast testing comments
* Yield Feature snapshots
* Fix Feature URN naming
* Update feast MCE
* Update Feature URN prefix
* Add MLEntity
* Update golden files with entities
* Specify feast sources
* Add feast source configs
* Working feast docker ingestion
* List entities and features before adding tables
* Add featureset names
* Remove unused
* Rename feast image
* Update README
* Add env to feast URNs
* Fix URN naming
* Remove redundant URN names
* Fix enum backcompatibility
* Move feast testing to docker
* Move URN generators to mce_builder
* Add source for features
* Switch TypeClass -> enum_type
* Rename source -> sourceDataset
* Add local Feast ingest image builds
* Rename Entity -> MLPrimaryKey
* Restore features and keys for each featureset
* Do not json encode source configs
* Remove old source properties from feature sets
* Regenerate golden file
* Fix race condition with Feast tests
* Exclude unknown source
* Update feature datatype enum
* Update README and fix typos
* Fix Entity typo
* Fix path to local docker image
* Specify feast config and version
* Fix feast env variables
* PR fixes
* Refactor feast ingest constants
* Make feature sources optional for back-compatibility
* Remove unused GCP files
* adding docker publish workflow
* Simplify name+namespace in PrimaryKeys
* adding docker publish workflow
* debug
* final attempt
* final final attempt
* final final final commit
* Switch to published ingestion image
* Update name and namespace in java files
* Rename FeatureSet -> FeatureTable
* Regenerate codegen
* Fix initial generation errors
* Update snapshot jsons
* Regenerated schemas
* Fix URN formats
* Revise builds
* Clean up feast URN builders
* Fix naming typos
* Fix Feature Set -> Feature Table
* Fix comments
* PR fixes
* All you need is Urn
* Regenerate snapshots and update validation
* Add UNKNOWN data type
* URNs for source types
* Add note on docker requirement
* Fix typo
* Reorder aspect unions
* Refactor feast ingest functions
* Update snapshot jsons
* Rebuild
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-09 15:07:04 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling ( #2629 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
taufiqibrahim
db78373427
feat(ingest): kafka connect metadata ingestion ( #2516 )
2021-05-18 14:45:38 -07:00
Gary Lucas
af4f3b9683
fix(dbt): set target platform and load schema ( #2483 )
2021-05-17 12:22:52 -07:00
Harshal Sheth
8d910b9e39
docs(ingest): improve kafka schema registry config docs ( #2544 )
2021-05-12 17:54:33 -07:00
Gabe Lyons
851e00ba9f
feat(lineage): implement support for datasets, charts and dashboards downstream lineage fetching in a generic way ( #2397 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Brian <brianwebtek@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2021-04-23 00:18:39 -07:00
Gabe Lyons
c7b49de67b
feat(ingest): adding superset ingestion source ( #2425 )
2021-04-22 00:11:54 -07:00
amy m
759288161c
feat(ingest): adding support for AWS Glue ( #2319 )
...
Co-authored-by: Harry Nash <harrywilliamnash@gmail.com>
2021-04-04 11:00:27 -07:00
Gary Lucas
922307f8ec
feat(ingest): Add DBT source to metadata-ingestion ( #2247 )
2021-03-22 23:11:29 -07:00
Harshal Sheth
6378347f81
feat(ingest): standalone metadata emitters ( #2207 )
2021-03-10 14:32:12 -08:00
Harshal Sheth
76e0594b8b
feat(ingest): add support for LDAP ingestion ( #2122 )
2021-02-18 20:05:39 -08:00
Harshal Sheth
fd4878a89d
docs(ingest): clarify docs for new ingestion framework ( #2108 )
2021-02-16 15:31:13 -08:00
