Harshal Sheth
e99875cac6
chore(ingest): enable flake8 bugbear linting ( #7763 )
2023-04-10 14:14:42 -07:00
Mayuri Nehate
f563695bc6
fix(ingest/snowflake): fix tags without lineage query, remove comma ( #7779 )
2023-04-10 13:18:45 -07:00
Aseem Bansal
49a4585ecb
doc(cli): fix get cli example ( #7742 )
2023-04-10 12:45:51 -07:00
Arne Jacobs
041df376cb
fix(docs): replaced outdated docs command for building breaking changes of the metadata model ( #7759 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-04-10 14:09:55 -05:00
Hyejin Yoon
294c5ff507
feat(docs): refactor guide on graphql ( #7745 )
...
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Hyejin Yoon <hyejin.yoon@acryl.io>
2023-04-08 08:26:58 +09:00
mohdsiddique
5e145cbb2d
feat(ingestion/okta): okta stateful ingestion ( #7736 )
...
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-04-07 13:44:32 -07:00
Mayuri Nehate
5fd7981532
fix(ingest/snowflake): fix incorrect tag urn case, improve tag display name ( #7758 )
2023-04-07 13:07:08 -07:00
Andrew Sikowitz
087855f374
fix(ingest/bigquery): Support cross project usage using FileBackedDict ( #7663 )
...
Includes major refactor of bigquery usage ingestion, minor refactor of the source as a whole, and reporting cleanup.
Includes bigquery performance testing changes.
2023-04-07 12:18:26 -07:00
Jeff Merrick
fd758deb3d
docs(): add styles for sphinx generated python docs ( #7773 )
2023-04-07 11:28:31 -07:00
Mayuri Nehate
1fda92441f
feat(snowflake): improve snowflake lineage perf and memory, push down to snowflake ( #7710 )
2023-04-07 11:06:06 -07:00
Hyejin Yoon
f779d7416e
feat(docs): add quickstart snippet on main page ( #7716 )
...
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-192-168-0-10.us-west-2.compute.internal>
2023-04-07 09:33:23 -07:00
RyanHolstien
8ffb6a3585
feat(config): allow hooks to be enabled/disabled ( #7761 )
2023-04-07 11:10:05 -05:00
Andrew Sikowitz
44663fa035
fix(ingest/bigquery): Raise report_failure threshold; add robustness around table parsing ( #7772 )
...
- Converted getting views and tables to iterators
- Catches exception around table expiration time being impossible to represent in python because it's too far in the future
2023-04-06 13:24:22 -07:00
Harshal Sheth
dac540e691
ci: limit qodana concurrency to group ( #7764 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-04-06 10:48:58 -07:00
Tamas Nemeth
37b350c8e3
fix(ingest/redshift): fixing sql which extracts lineage from insert queries ( #7770 )
2023-04-06 16:34:34 +02:00
Tamas Nemeth
96bacfc5d7
fix(ingest/redshift): Fixing adding back db name in redshift urn ( #7765 )
2023-04-06 11:45:10 +02:00
Tamas Nemeth
29d2492667
fix(ingest/bigquery): Lineage edges use datetime with timezone; correctly parse last_altered ( #7762 )
2023-04-06 02:46:50 +00:00
Hyejin Yoon
7ec1daa7d4
feat: make demo site accessible directly from navbar ( #7715 )
...
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
2023-04-06 10:40:20 +09:00
Hyejin Yoon
2f625d99b3
feat: add docs on windows compatibility ( #7713 )
...
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
2023-04-05 17:36:55 -07:00
Indy Prentice
f23693156d
fix(search) Increase weight on fieldPath field for searching ( #7725 )
...
Co-authored-by: Indy Prentice <indy@ip-192-168-5-57.us-west-2.compute.internal>
2023-04-05 17:45:37 -05:00
Pedro Figueiredo
8457ac75a7
docs(docker): fix typo in README.md ( #7729 )
2023-04-05 14:32:18 -07:00
Harshal Sheth
2840cba68b
docs(ingest/lookml): update error message for Looker connection fetch ( #7756 )
2023-04-05 13:41:17 -07:00
Harshal Sheth
5bb0e60bd3
fix(ingest/dbt-cloud): use correct dbt cloud IDE urls ( #7755 )
2023-04-05 13:40:56 -07:00
Chris Collins
70e60847a2
fix(auto-complete) Pass in views to auto-complete endpoint for filtering ( #7754 )
2023-04-05 16:48:08 +05:30
Harshal Sheth
e06117af66
fix(ingest/demo-data): fix bug in path type ( #7749 )
2023-04-04 23:16:15 -07:00
Mayuri Nehate
20504aae70
fix(ingest/bigquery): fix and refractor exported audit logs query ( #7699 )
2023-04-05 11:17:25 +05:30
Thosan Girisona
062e8ae323
fix(TestResults UI):show non-failing TestResult ( #7747 )
2023-04-05 11:16:44 +05:30
Harshal Sheth
e71c0d3490
feat(sdk): fix ownership emission for groups ( #7751 )
2023-04-05 11:15:06 +05:30
Aseem Bansal
a11a7fa9d0
feat(snowflake): better error message on key pair authentication ( #7734 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-04-05 00:46:07 +00:00
Harshal Sheth
8d99babf75
feat(ingest/dbt): update subtypes for dbt ( #7750 )
2023-04-04 17:11:23 -07:00
Indy Prentice
ae9326c0db
docs(search): Add example search for finding tables without the name field ( #7647 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-04-04 17:16:27 -05:00
mohdsiddique
6a1abc832e
doc(ingestion): tableau quick ingestion guide ( #7682 )
...
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-04-04 13:12:42 -07:00
Andrew Sikowitz
06bc1c32e0
refactor(ingest/bigquery): Standardize audit log parsing and make TopKDict a DefaultDict ( #7738 )
...
- Moves get_sanitized_table_ref calls to ReadEvent / QueryEvent creation
- Standardizes how the audit log is read and parsed, unifying code when reading from gcp logging vs audit metadata (exported logs)
- Adds error handling around the parsing of each event, to catch errors from the new get_sanitized_table_ref calls
- Makes TopKDict inherit from DefaultDict and cleans up calls around that.
2023-04-04 11:58:48 -07:00
Andrew Sikowitz
ce1ac7fa12
refactor(ingest): Use sqlite.Row row_factory for FileBackedCollections ( #7739 )
2023-04-04 11:53:56 -07:00
Tim
23e57fffa2
fix(sdk): remove rest emitter to graph cache in CorpGroup ( #7743 )
2023-04-04 10:32:15 -07:00
Harshal Sheth
f860ce95c0
feat(ingest): emit state payloads as soft-deleted ( #7714 )
2023-04-04 17:06:21 +00:00
Harshal Sheth
82dc2b6393
feat(docs): clear up source configs ( #7720 )
2023-04-04 18:40:19 +05:30
Harshal Sheth
8394dcb538
chore(ingest): change kafka connect mapped ports ( #7728 )
2023-04-04 18:38:30 +05:30
Aseem Bansal
0e04e0c80f
docs(airflow): update with information for new plugin ( #7732 )
2023-04-04 15:20:02 +05:30
Harshal Sheth
1634edaf25
feat(ingest/dbt): include dbt unique_id in properties ( #7737 )
2023-04-04 13:37:13 +05:30
John Joyce
3609167086
fix(ci): Fixing broken Domains Test ( #7746 )
2023-04-04 13:36:34 +05:30
Harshal Sheth
f780da4c0a
feat(ingest/lookml): support views with derived_table.explore_source ( #7704 )
2023-04-03 16:18:39 -07:00
Andrew Sikowitz
de587b2bfe
refactor(ingest): Minor cleanup of File, CsvEnricher, BusinessGlossary, and FileLineage sources ( #7718 )
...
- Adds auto_workunit_reporter to each source
- Standardizes comments around remote paths
- Adds back AuditStamp to FileLineage source
- Some generic refactoring
2023-03-31 15:49:24 -07:00
Tamas Nemeth
86960adf98
doc(redshift) - Adding Redshift ingestion quickstart guide ( #7700 )
2023-03-31 12:57:51 -07:00
Andrew Sikowitz
a2f8c76388
feat(ingest/bigquery): Capture all operation types when ingesting operational stats ( #7723 )
2023-03-31 16:01:28 +05:30
Harshal Sheth
f6d7e1a325
feat(ingest/snowflake): hide host_port from snowflake docs ( #7717 )
2023-03-31 15:58:52 +05:30
Aseem Bansal
f0a675f9aa
docs(okta): add how to use email in urns ( #7708 )
2023-03-31 15:55:22 +05:30
Hyejin Yoon
92ad7202c9
feat: add pre-commit ( #7680 )
...
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
2023-03-31 15:34:21 +09:00
xiphl
7d240c600a
feat(ingestion) Allow for ingestion to read files remotely ( #7552 )
...
Co-authored-by: xiphl <xiphlerl9@gmail.com>
Allows the CsvEnricher, BusinessGlossary, File, and LineageFile sources to read from URLs.
2023-03-29 18:10:46 -07:00
Harshal Sheth
575909e41c
feat(docs): support inlining code snippets from files ( #7712 )
2023-03-30 00:02:21 +00:00
