11753 Commits

Author SHA1 Message Date
Aseem Bansal
a087a9fbb9
chore(ci): update base ingestion image requirements file (#6687) 2022-12-08 09:59:19 +05:30
Felix Lüdin
05e18a0ae7
feat(ingest): use entry point for registering transformers (#6628) 2022-12-07 23:08:08 -05:00
Aditya Radhakrishnan
f0f0355a83
feat(onboarding): adds framework and some steps for onboarding steps UI (#6462)
* feat(onboarding): adds models and API for onboarding steps feature

* feat(onboarding): adds backend for onboarding steps feature

* feat(onboarding): adds framework and some steps for onboarding steps UI
2022-12-07 16:21:55 -08:00
Mayuri Nehate
9e3267a0ec
feat(ingest): add timestamps for snowflake objects (#6570)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-07 18:11:08 -05:00
İnanç Dokurel
996dabfcac
fix(ingestion/vertica): support columns with timestamp precision (#6295)
Co-authored-by: İnanç Dokurel <inancdokurel@users.noreply.github.com>
Fixes https://github.com/datahub-project/datahub/issues/5295
2022-12-07 18:10:37 -05:00
mohdsiddique
c4dcd268a6
feat(ingest): support knowledge links in business glossary (#6375)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-07 18:09:50 -05:00
david-leifker
3758bcbe34
fix(docs): update examples for protobuf (#6681) 2022-12-07 16:48:01 -06:00
Maggie Hays
8a8b667a52
docs(search): update broken youtube link (#6678) 2022-12-07 09:29:44 -08:00
Harshal Sheth
bf307a4bcf
feat(ingest): run profiler in more cardinality cases (#6397) 2022-12-07 12:20:06 -05:00
mohdsiddique
1282cf7638
fix(): plugins doc fix (#6674) 2022-12-07 08:37:05 -08:00
Mayuri Nehate
eeb7a9dfe5
feat(ingest): snowflake - update snowflake docs, add simple validations (#6636) 2022-12-07 14:56:03 +01:00
Shirshanka Das
8e05fdf516
fix(datahub-protobuf): fix missing httpclient dependency (#6672) 2022-12-07 07:28:17 -06:00
Aseem Bansal
626a06445a
feat(ci): add smoke test for domain mutation (#6641) 2022-12-07 15:27:50 +05:30
Tamas Nemeth
9a1f78fc60
fix(ingest): profiling - Changing profiling defaults on Bigquery and Snowflake (#6640) 2022-12-07 10:33:10 +01:00
John Joyce
15e9475efb
fix(docker): Fix datahub-frontend dockerfile (#6670) 2022-12-06 23:11:54 -08:00
David Haglund
1a6677083e
fix(ingest/powerbi-report-server): deprecate unused graphql config (#6630) 2022-12-07 01:03:49 -05:00
mohdsiddique
b46d52dc0f
feat(gms): Enable auth-api publishing to maven (#6671) 2022-12-06 21:56:36 -08:00
Maggie Hays
e95bd98fe1
fix(docs): Update domains.md (#6667) 2022-12-06 18:52:13 -08:00
Harshal Sheth
e37157f9b4
docs(): add languages to code highlighting (#5576) 2022-12-06 16:13:28 -08:00
Matthieu Blais
4e2dde84f6
feat(ingest/dbt): add support for latest DBT version 1.3 (#6651)
Co-authored-by: Matthieu Blais <matthieu.blais@tech.jago.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-06 19:03:24 -05:00
dependabot[bot]
438bbdee0f
build(deps): bump decode-uri-component in /datahub-web-react (#6617) 2022-12-06 14:45:27 -08:00
Harshal Sheth
c8969d9ba8
fix(ingest/snowflake): support domains for snowflake schema containers (#6662) 2022-12-06 14:24:07 -08:00
Harshal Sheth
fceef480a2
chore(ingest): remove feast-legacy (#6661) 2022-12-06 14:19:38 -08:00
Harshal Sheth
f0206baa8b
fix(ingest): issue warning correctly (#6623) 2022-12-06 14:17:14 -08:00
Tamas Nemeth
2373c707b8
feat(ingest): bigquery - Running lineage extraction after metadata extraction (#6653)
* Running lineage extraction after metadata extraction
Adding table creation/alter time to the datasetproperties
Fixing bigquery permissions doc

* Disabling by default to run sql parser in a separate process
Fixing adding views to the global view list
2022-12-06 23:04:27 +01:00
Harshal Sheth
71bfa98f89
fix(ingest): fix lingering demo-data source issues (#6659) 2022-12-06 16:10:21 -05:00
Paul Logan
dbb4c84cb2
docs: move rfcs to separate repo (#6621)
* moving rfc's

* ignoring rfc/

* moving RFC

* updating rfc policy page

* removing unused filter patter

* removing unused filter patter
2022-12-06 13:03:15 -08:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework (#6634) 2022-12-06 10:22:41 -08:00
Aseem Bansal
b4d966be1e
docs(managed datahub): adding release notes for v0.1.70 (#6655) 2022-12-06 23:48:43 +05:30
Aseem Bansal
43c566ee4f
feat(ingest): add dummy data source for automated testing (#6550) 2022-12-06 16:57:12 +05:30
Aditya Radhakrishnan
70659711a8
perf(ui-ingestion): cache on creation or deletion of ingestion sources to reduce latency (#6647) 2022-12-05 22:20:24 -08:00
John Joyce
88d2d9bb08
refactor(ui): Making improvements to UI ingestion forms, adding MySQL, Trino, Presto, MSSQL, MariaDB forms (#6607) 2022-12-05 16:06:07 -08:00
Chris Collins
b6887d23bb
feat(graph) Add createdOn, createdActor, updatedOn, updatedActor to graph edges (#6615) 2022-12-05 16:56:28 -05:00
Fredrik Sannholm
4dd66be654
feat(ingest/kafka-connect): support MongoSourceConnector (#6416)
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-05 16:09:58 -05:00
Mayuri Nehate
e5a823e0d8
feat(ingest/snowflake): support filtering by fully qualified schema_pattern (#6611) 2022-12-05 14:27:25 -05:00
syedzoherer
ffea9302d9
Add AWS Postgres Iam Auth jar to GMS (#6371)
* Add AWS Postgres Iam Auth jar to GMS

* Added IAM support for Postgres

* Setting IAM support for Postgres as false by default

* format fix

Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-12-05 13:07:26 -06:00
Mayuri Nehate
fdcb731e29
feat(ingest): snowflake - config variable for specifying a direct private key (#6609) 2022-12-05 19:09:08 +05:30
Shirshanka Das
ed9110ea44
docs: add links from main README to slack, teams actions (#6633) 2022-12-04 23:21:38 -08:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible (#6616) 2022-12-04 19:57:47 -08:00
Shirshanka Das
155a68386a
docs(actions): slack, teams (#6632) 2022-12-04 13:27:52 -08:00
Shirshanka Das
4876fdd084
feat(quickstart): add support for env vars for Slack, Teams actions (#6591) 2022-12-03 23:00:50 -08:00
Aditya Radhakrishnan
5e971ce71e
fix(analytics): skip ListDomains if user cannot manage domains and have only one loading message (#6624) 2022-12-02 19:30:02 -08:00
Maggie Hays
c8d943acc9
docs():Townhall agenda wikimedia (#6622) 2022-12-02 17:42:58 -08:00
djordje-mijatovic
99e6f3a87c
feat(ingest): print detailed GMS error messages (#6519)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-02 18:20:09 -05:00
Chris Collins
8ff35b81ed
fix(ui) Fix double scroll in embedded list search sections (#6618) 2022-12-02 15:12:15 -06:00
Harshal Sheth
a1e62c723e
docs(ingest): add airflow docs that use the PythonVirtualenvOperator (#6604) 2022-12-02 19:56:17 +01:00
Harshal Sheth
71466aab36
fix(ingest): only require github_info for lookml and not looker (#6608) 2022-12-02 19:54:24 +01:00
Harshal Sheth
44cfd21a65
chore(ingest): bump and pin mypy (#6584) 2022-12-02 19:53:28 +01:00
Mayuri Nehate
1689212434
feat(ingest): add external url for snowflake objects (#6580) 2022-12-02 13:38:46 -05:00
Tamas Nemeth
43775ecd49
fix(ingest/bigquery): ignore complex types from profiling (#6613) 2022-12-02 13:26:53 -05:00