927 Commits

Author SHA1 Message Date
Mayuri Nehate
4b515e022b
feat(ingest): salesforce - add connector (#5104)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
2022-07-06 10:01:16 -07:00
Aditya Radhakrishnan
fc8e59387d
feat(ingest): update CSV source to support description and ownership type (#5346) 2022-07-06 21:29:29 +05:30
Mayuri Nehate
f23c2c9b64
fix(ingest): tableau - omit schema fields when name is absent (#5275) 2022-07-05 10:40:55 -07:00
Shirshanka Das
e93e4691fb
feat(ingest): lookml - adding support for only emitting reachable views from explores (#5333) 2022-07-05 10:14:12 -07:00
Mayuri Nehate
80e91b457f
feat(ingest): looker - ingest dashboard create/update/delete timestamps (#5312) 2022-07-05 09:04:41 -07:00
Mugdha Hardikar
5455122267
feat(ingest): delta-lake: adding support for delta lake (#5259)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-27 16:16:33 -07:00
Shirshanka Das
4b3135a0f8
feat(ingest): dbt - improving dbt_meta mapping (#5237) 2022-06-24 13:43:12 +02:00
Tamas Nemeth
1086614129
fix(ingest): bigquery - Grouping date named tables at bigquery (#5230)
* Grouping date named tables at bigquery
* Fixing table name for sharded tables
2022-06-23 11:53:25 +02:00
Piotr Sierkin
9f2b3b9ba6
fix(ingest): dbt - make assertion display names consistent (#5214)
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-22 22:07:00 -07:00
Aditya Radhakrishnan
82ca92f8f9
feat(ingest): adds csv enricher ingestion source (#5221) 2022-06-22 12:25:39 +05:30
Atul Saurav
648ebfcc93
feat(ingestion) ldap: make ldap attrs keys configurable (#4682) 2022-06-21 12:01:00 -07:00
Aseem Bansal
c942350e3c
feat(ci): split integration tests to reduce run time (#5205) 2022-06-20 21:08:37 +05:30
Shirshanka Das
0ee2569d5c
feat(ingest): dbt - adding support for dbt tests (#5201) 2022-06-18 13:30:04 -07:00
Aseem Bansal
4541379024
feat(build): changes to decrease build time, cancel runs in case of multiple commits (#5187) 2022-06-17 18:05:10 +05:30
Tamas Nemeth
b0db17e237
feat(ingest): bigquery - option to send usage queries as well as operational metadata (#5151) 2022-06-16 16:00:35 -07:00
skrydal
503208beaa
feat(ingest): dbt - add platform instance for target platform (#5129) 2022-06-12 09:29:44 -07:00
Sebo Kim
da273802be
fix(ingest): looker - original view name should be used for explore_joins (#4928) 2022-06-08 18:42:55 -07:00
Gabe Lyons
538cfba526
fix(ingest): dbt - ensure platform_instance filled out only for dbt nodes (#5115) 2022-06-07 20:09:42 -07:00
Shirshanka Das
601ee9eae1
feat(looker): ensure explore name matches looker's display name (#5111) 2022-06-07 16:49:53 -07:00
Gabe Lyons
3c7c83f447
tests(lookml): adding tests for model deny patterns (#4934) 2022-06-06 08:26:27 -07:00
Gabe Lyons
e607410a40
dont set platform instances for sources (#5028) 2022-05-27 10:57:27 -07:00
Ravindra Lanka
26c0acf786
fix(build): fix for hana build failure for aarch64. (#5019) 2022-05-26 15:29:21 -07:00
Ravindra Lanka
108b492ed1
feat(ingestion): Add Iceberg source (#5010)
Co-authored-by: cccs-eric <eric.ladouceur@cyber.gc.ca>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-05-26 08:05:57 -07:00
buggythepirate
92338c7912
feat(ingest): Added new ingestion source SAP HANA (#4376)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:42:50 -07:00
Ebu (えぶ)
2911e1ed1b
feat(ingest): Add Source from Vertica (#4555)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:26:28 -07:00
John Joyce
1e428aacd8
feat(DataHub Operations): Adding GraphQL mutation for reporting Dataset operations (#4988) 2022-05-25 13:27:46 -07:00
mayurinehate
6f553d4644
fix(ingest): tableau - fix chart custom properties None key error, update docs (#4931) 2022-05-24 22:52:53 -07:00
Tamas Nemeth
be91e2341f
feat(ingest): s3 - speeding up ingestion with sampling (#4927) 2022-05-24 22:17:10 -07:00
Gabe Lyons
7b1cf6f8b2
feat(dbt): enable data platform instance on dbt (#4926) 2022-05-17 16:53:16 -07:00
Aseem Bansal
15438f62f1
fix(doc): update doc url to generated docs (#4860) 2022-05-13 10:19:46 +05:30
Aseem Bansal
b9f78026c8
revert(bigquery-usage): dataset allow filter impl (#4901)
* Revert "fix(ingestion): bigquery-usage: Fix biquery usage table deny pattern template (#4898)"
2022-05-11 20:03:03 +02:00
Shirshanka Das
8d281fc013
fix(ingest): lookml - add view definitions for all views (#4875) 2022-05-10 10:48:36 -07:00
Zach Bluhm
6ced69cf31
fix(bigquery-usage): dataset allow filter impl (#4776)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-06 13:45:37 -07:00
Tamas Nemeth
56ee4d9651
feat(ingest): s3 - add support for multiple pathspecs in one recipe (#4777) 2022-05-05 10:09:47 -07:00
mayurinehate
d3fb6ce026
fix(ingest): great-expectations - fix failure to serialize type Decimal (#4763) 2022-05-04 22:56:08 -07:00
Ravindra Lanka
df75eafcfc
fix(ci): fix presto_on_hive tests. (#4802) 2022-05-02 21:09:33 -07:00
Aditya Radhakrishnan
c20a47f34c
feat(operation): display the reported time for last updated in the UI (#4800) 2022-05-02 16:00:29 -07:00
mayurinehate
c34a1ba735
fix(s3): improved handling for corner cases (#4774) 2022-04-29 12:25:41 -07:00
Jordan Wolinsky
bbac4a7a11
feat(ingestion): glue/s3 - Ingest Tags from s3 bucket on an AWS Glue job and S3 Data Lake Ingest Job (#4689) 2022-04-29 10:09:06 +02:00
mayurinehate
33d6842ab0
fix(tableau): miscellaneous tableau fixes for lineage, browse path, non-embedded datasets (#4724)
* fix(tableau): add config whether to emit aspects for external datasets

other changes:
- do not set browse path in absence of datasource or project name
- remove unused nodes from tableau metadata query

* fix(tableau): remove redundant (transitive) lineage edges between tables, datasource, sheet

other changes:
- update subtypes for datasource to be more specific

* fix(tableau): fix browse paths for custom sql and embedded datasource

other changes:
- do not set browse path if any intermediate folder level in browse path is empty

* docs(tableau): update tableau doc
2022-04-27 11:20:03 -07:00
Danilo Peixoto
d2a6bc06dc
feat(ingest): feast - add support for Feast 0.18, deprecate older integration (#4094) 2022-04-26 14:35:02 -07:00
cccs-eric
abf8d62cf5
fix(azure_ad): silently discard other Azure AD object types (#4693) (#4704) 2022-04-26 13:56:46 -07:00
Tamas Nemeth
474b0ba61e
feat(ingest): dbt - add query tag mapping and match template (#4744) 2022-04-25 10:56:45 -07:00
Arun Vasudevan
5aa3da5c9c
feat(ingestion) dbt: Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern (#4587)
* Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern
Co-authored-by: BZ <93607724+BoyuanZhangDE@users.noreply.github.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-13 16:58:36 -07:00
Kevin Hu
08c34bfe15
feat(ingest): capture MSSQL table+column descriptions (#4579)
* feat(ingest): capture MSSQL table+column descriptions

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-12 17:49:56 -07:00
Zach Bluhm
ff685b7feb
feat: Enable the ingestion of bigquery audit logs to parse usage info… (#4441)
* feat: Enable the ingestion of bigquery audit logs to parse usage information

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-12 14:58:34 -07:00
Dyana Rose
5b22d96e04
fix(ingestion): looker - extract explore views from join name (#4627)
Co-authored-by: Dyana Rose <dyanarose@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-04-12 08:20:10 -07:00
jchen0824
524d183d93
feat: add presto-on-hive metadata ingestion source (#4625)
* feat(metadata ingestion source): add presto-on-hive metadata ingestion source

Co-authored-by: Houren Chen <houren.chen@grabtaxi.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-11 17:46:44 -07:00
Gabe Lyons
112589db32
feat(tableau): add some logic to normalize table names in tableau (#4609)
* add some logic to normalize table names in tableau
2022-04-07 12:15:41 -07:00
Ravindra Lanka
5e25cd1e22
feat(ingestion): Redshift Usage Source - simplify OperationalStats workunit generation. (#4585)
* feat(ingestion): Redshift Usage Source - simplify OperationalStats workunit generation.
2022-04-07 11:24:26 -07:00