3904 Commits

Author SHA1 Message Date
Aseem Bansal
4541379024
feat(build): changes to decrease build time, cancel runs in case of multiple commits (#5187) 2022-06-17 18:05:10 +05:30
Tamas Nemeth
b0db17e237
feat(ingest): bigquery - option to send usage queries as well as operational metadata (#5151) 2022-06-16 16:00:35 -07:00
data ** 100
f4674c3e78
fix(ingest): glue - fix profiling config option for column_count (#5178) 2022-06-15 23:07:58 -07:00
Sayak Maity
0257388e65
fix(airflow): fixes DeprecationWarning with hook-class-names (#5143) 2022-06-13 13:32:11 +02:00
mayurinehate
7b143b06fc
feat(ingest): snowflake profile tables only if they have been updates since N days (#5132) 2022-06-13 14:59:16 +05:30
skrydal
503208beaa
feat(ingest): dbt - add platform instance for target platform (#5129) 2022-06-12 09:29:44 -07:00
mayurinehate
7aa481dd07
fix(ingest): fix table urn for athena connectionType (#5135) 2022-06-09 11:10:23 -07:00
BZ
01a96a029d
fix(dbt): validator should not complain when paths are None (#5125) 2022-06-09 08:44:46 -07:00
Tamas Nemeth
6302d32685
fix(ingestion): bigquery-usage - Only send operational metadata for allowed tables (#5127) 2022-06-09 08:38:23 +02:00
cccs-eric
f25a5f043d
fix(iceberg): Change how MapType are mapped to Avro to support complex Map key type. (#5060) 2022-06-09 08:13:10 +05:30
Sebo Kim
da273802be
fix(ingest): looker - original view name should be used for explore_joins (#4928) 2022-06-08 18:42:55 -07:00
Tamas Nemeth
09fc50674d
fix(ingestion): bigquery-usage - Removing filtering at queryevents (#5124) 2022-06-08 21:21:58 +02:00
Aseem Bansal
2b06cb19fd
fix(bigquery): handling of empty partitioned tables, improve report message (#5122) 2022-06-08 23:03:32 +05:30
Tamas Nemeth
c677a06fd8
feat(ingestion): bigquery-usage - Collect stats from read event reasons (#5118) 2022-06-08 14:18:22 +02:00
Gabe Lyons
538cfba526
fix(ingest): dbt - ensure platform_instance filled out only for dbt nodes (#5115) 2022-06-07 20:09:42 -07:00
Shirshanka Das
601ee9eae1
feat(looker): ensure explore name matches looker's display name (#5111) 2022-06-07 16:49:53 -07:00
Tamas Nemeth
039e98e8cf
feat(docs): Updating example files with the new ingestion recipe suffix (#5103) 2022-06-07 15:52:26 -07:00
John Joyce
5c501fba2c
fix(cli): Bumping avro-gen3 to 0.7.4 (#5098) 2022-06-07 12:56:06 -07:00
Shirshanka Das
51854a768d
fix(ci): pin google-cloud-logging to avoid pip backtracking (#5109) 2022-06-07 23:14:00 +05:30
Aseem Bansal
596853ae1f
fix(build): remove dependencies added for compatibility (#5108) 2022-06-07 19:59:17 +05:30
Aseem Bansal
e567d70d37
fix(build): reduce time taken for resolution (#5106) 2022-06-07 17:32:33 +05:30
Shirshanka Das
7cef07490f
fix(deps): ingest - moving packaging to framework_common (#5096) 2022-06-06 16:34:23 -07:00
Aseem Bansal
c43ad54a64
fix(profiling): don't stop if some steps fail (#5095) 2022-06-06 14:36:32 -07:00
Gabe Lyons
3c7c83f447
tests(lookml): adding tests for model deny patterns (#4934) 2022-06-06 08:26:27 -07:00
Lal Rishav
4f82e29697
feat(ingest): snowflake using oauth for Azure (#4647) 2022-06-06 17:49:49 +05:30
Shirshanka Das
e62c647693
feat(cli): suggest upgrades when appropriate (#5091) 2022-06-04 09:34:17 -07:00
Tamas Nemeth
72d6c57044
feat(ingest): rest_emitter - Adding option to rest emitter to disable ssl verification (#5042) 2022-06-04 12:43:50 +05:30
Shirshanka Das
64fae6121a
feat(docs): ingest - add tab for config json schema (#5086) 2022-06-03 14:57:36 -07:00
Tamas Nemeth
aeffd26bb3
fix(ingest): looker - handle invalid json in Looker query dynamic field (#5083) 2022-06-03 14:30:57 -07:00
Shirshanka Das
b2d957ddbf
feat(docs): make config section for ingestion sources auto-open by default (#5075) 2022-06-02 18:27:13 +02:00
Aseem Bansal
f81ead366d
feat(redash): add parallelism support for ingestion (#5061) 2022-06-01 19:36:30 +05:30
Felix Lüdin
2a373c21e5
fix(docs): hana - rename SAP HANA source and data platform (#5043) 2022-05-31 14:44:16 -07:00
Shirshanka Das
83d9f7d6e6
fix(ingest): fix build breakage due to traitlets 5.2.2 bug (#5051) 2022-05-31 14:42:56 -07:00
Aseem Bansal
08a5fcfd01
fix(redash): fix bug with names, add option for page size, debugging info (#5045) 2022-05-31 18:10:34 +05:30
Aseem Bansal
a79d02abe1
doc(bigquery): fix missing permissions (#5041) 2022-05-30 14:09:12 +02:00
BZ
5b55f25b69
feat(ingest): glue - enable profiling (#4879) 2022-05-30 13:46:35 +02:00
Tamas Nemeth
f40c250e9f
fix(profiling): bigquery - Fix for Bigquery temp table creation on GE >= 0.15.3 (#5035) 2022-05-30 15:43:52 +05:30
Shirshanka Das
65d96b9108
fix(build): m1 build fails to install hdb-cli (#5040) 2022-05-30 11:02:33 +02:00
Ravindra Lanka
96f923e007
fix(ingest): common - fix nullability determination for the AVRO fixed type. (#5023) 2022-05-29 09:06:08 -07:00
Aseem Bansal
1fd5549ae3
fix(cli): don't use env for container, add example (#5012) 2022-05-29 08:26:45 -07:00
Shirshanka Das
3bb8a41c2a
fix(build): docgen should fail if plugin is not loadable (#5038) 2022-05-29 08:09:02 -07:00
RyanHolstien
2a2fd05345
feat: telemetry improvements (#5029) 2022-05-27 17:04:45 -07:00
Gabe Lyons
e607410a40
dont set platform instances for sources (#5028) 2022-05-27 10:57:27 -07:00
Aseem Bansal
d926fa26f5
fix(parsing): incorrect parsing for commas (#5027) 2022-05-27 22:22:13 +05:30
Aseem Bansal
64bb918939
fix(parsing): improve sql parsing, some debugging redash (#5025) 2022-05-27 19:28:45 +05:30
Ravindra Lanka
d200103ea7
fix(ingestion): Remove hana from base_dev_requirements to unblock m1 users (#5024) 2022-05-27 14:20:15 +05:30
Aseem Bansal
912ce11821
fix(bigquery): reduce number of calls for details of partitioning (#5014) 2022-05-27 13:09:08 +05:30
Ravindra Lanka
26c0acf786
fix(build): fix for hana build failure for aarch64. (#5019) 2022-05-26 15:29:21 -07:00
Harshal Sheth
480fb2e770
test(ingestion): change class names to avoid unittest warnings (#5005) 2022-05-26 22:09:40 +05:30
Harshal Sheth
06a290fcd6
fix(ingestion): use raw strings for regexes (#5006) 2022-05-26 20:56:02 +05:30