Navin Sharma
7c3872a2ed
Update Grafana Dashboard ( #6076 )
...
* Add Datasource as variable in dashboard
(cherry picked from commit e75b3f7333dd9436f7434eefa76ab9fbfb1babab)
* Update datahub_dashboard.json
(cherry picked from commit 701592697702a99ddf33f75d57826282df999c82)
* Bump docker compose version to 3.8
(cherry picked from commit ff6a97b1692ac21368eacc83a0daed30b0364d5d)
* Update grafana image tag from latest to 9.1.4
(cherry picked from commit 2c88e2a3041b9ddfa70bb92d13e80ca15be0ead2)
* Update old metric name in datahub_dashboard.json
(cherry picked from commit 21b502e25392f37c5053dcf00161fc5c7d35c94d)
* Add panel for new metrics
(cherry picked from commit 194452778bc825820dda87ab2e159b7064a360ef)
Co-authored-by: Peter Szalai <szalaipeti.vagyok@gmail.com>
2022-12-19 22:43:47 +01:00
Monica Senapati
5c366205f5
fix(bigquery-legacy): Fix for TypeError related failures in legacy plugin ( #6806 )
...
Co-authored-by: John Joyce <john@acryl.io>
2022-12-19 13:28:25 -08:00
Harshal Sheth
47be95689e
refactor(ingest/stateful): remove most remaining state classes ( #6791 )
2022-12-19 13:40:48 -05:00
Harshal Sheth
14a00f4098
chore(ingest): pin black version ( #6807 )
2022-12-19 19:35:49 +01:00
Tamas Nemeth
e41b455e14
fix(ingest): bigquery - sharded table support improvements ( #6789 )
2022-12-19 18:57:37 +01:00
John Joyce
807b50699d
refactor(ui): Miscellaneous caching improvements ( #6796 )
2022-12-19 09:55:56 -08:00
Harshal Sheth
54e04ba436
fix(ingest/dbt): remove unsupported usage indicator ( #6805 )
2022-12-19 09:34:49 -08:00
jx2lee
cdedc19c70
fix(docs): edit text to link ( #6798 )
2022-12-19 08:45:22 -08:00
danielli-ziprecruiter
7ca21a8e7c
fix(ingest): prevent NullPointerException when non-jdbc SaveIntoDataSourceCommand ( #6803 )
2022-12-19 08:41:06 -08:00
John Joyce
6f71c957d5
fix(ui): Fixing minor issues with Ingestion forms ( #6790 )
2022-12-19 07:50:14 -08:00
david-leifker
637b540fa6
fix(kafka-setup): fix return code check ( #6782 )
...
* fix(kafka-setup): parallelize topic creation
* Remove -setup from docker compose (not services)
2022-12-16 13:39:18 -06:00
Aditya Radhakrishnan
d48e44499e
fix(tutorial): skip getting steps if there is no user ( #6786 )
2022-12-16 11:18:43 -08:00
Mayuri Nehate
9716a49067
fix(ingest): correct external url for account identifier with account name ( #6715 )
2022-12-16 14:00:42 -05:00
Harshal Sheth
5c8a3659db
fix(smoke-test): remove stateful ingestion config check ( #6781 )
2022-12-16 13:04:48 -05:00
Shirshanka Das
b236d0958c
feat(ci): adding github security reporting to trivy scans ( #6773 )
2022-12-15 21:28:07 -08:00
Harshal Sheth
22081f5ecc
feat(ingest): lookml - add unreachable views to report ( #6779 )
2022-12-15 20:26:30 -08:00
david-leifker
cca3639848
Optimize kafka setup ( #6778 )
...
* fix(kafka-setup): parallelize topic creation
2022-12-15 20:09:29 -06:00
Maggie Hays
2d0188c7ed
docs(snowflake) Snowflake quick ingestion guide ( #6750 )
2022-12-15 17:01:38 -08:00
John Joyce
0215245aa3
refactor(ui): Caching Ingestion Secrets ( #6772 )
2022-12-15 16:37:07 -08:00
Harshal Sheth
8a537b0559
feat(ingest): add datahub state inspect command ( #6763 )
2022-12-15 18:55:36 -05:00
Harshal Sheth
798d82fe60
docs(ingest): fix error in custom tags transformer example ( #6767 )
2022-12-15 15:31:12 -08:00
Aseem Bansal
1350bb010c
docs(docker): add section for adding community images ( #6770 )
2022-12-15 15:26:31 -08:00
Tamas Nemeth
b7bc1e9116
fix(ingest): bigquery - handling custom sql errors as warning ( #6777 )
2022-12-15 23:40:32 +01:00
Harshal Sheth
6152b5e9f7
feat(ingest): simplify more stateful ingestion state ( #6762 )
2022-12-15 11:33:29 -05:00
Harshal Sheth
7d7da15742
docs(ingest/airflow): clarify Airflow 1.x docs for airflow plugin ( #6761 )
2022-12-14 23:48:06 +01:00
John Joyce
0e614d110b
fix(): Fix the datahub-web-react build ( #6764 )
2022-12-14 12:58:54 -08:00
Shirshanka Das
db182e4639
fix(python-sdk): DataHubGraph get_aspect should accept empty responses ( #6760 )
2022-12-14 10:40:16 -08:00
Harshal Sheth
2f95719dba
feat(ingest): remove source config from DatahubIngestionCheckpoint ( #6722 )
2022-12-14 12:39:21 -05:00
jakobhanna
8109b8b567
docs(): Added build failed yarn error ( #6757 )
...
docs: add build failed yarn error message and how to deal with it
I encountere this error and with the help of the community i could deal with it (https://datahubspace.slack.com/archives/CV2UVAPPG/p1670608619404699 ).
2022-12-14 09:30:45 -08:00
John Joyce
fd6d12f84a
refactor(ux): Misc UX Improvements (tutorial copy, caching, filters) ( #6743 )
2022-12-14 09:11:51 -08:00
Patrick Franco Braz
f0a371941e
refactor(ingest): bigquery-lineage - allow tables and datasets in uppercase ( #6739 )
2022-12-14 14:58:03 +01:00
Harshal Sheth
68fd802881
fix(ingest/lookml): fix directory handling and a github_info resolution bug ( #6751 )
2022-12-14 14:55:38 +01:00
Pedro Silva
3e274dc186
fix(auth): Renames metadata-auth archive name to not conflict with other modules. ( #6749 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2022-12-13 19:38:48 -08:00
Harshal Sheth
b8560abd5a
fix(smoke-test): fix stateful ingestion test regression ( #6753 )
2022-12-13 19:35:37 -08:00
fully
7080c3e605
fix(actions): fix mistype slack/teams base url ( #6754 )
2022-12-13 19:34:34 -08:00
cccs-seb
3c2982c02c
fix(ingest): support airflow mapped operators ( #6738 )
2022-12-13 22:31:53 -05:00
Harshal Sheth
8c14dfc617
ci: fix ingestion gradle retry ( #6752 )
2022-12-13 20:16:59 -05:00
RyanHolstien
f85fd157e9
fix(elasticsearch): build in resilience against IO exceptions on httpclient ( #6680 )
...
* fix(elasticsearch): build in resilience against IO exceptions on http client
2022-12-13 18:11:02 -06:00
mohdsiddique
b7a2ce5c00
fix(): Add auth-api as compileOnly dependency ( #6747 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-12-13 09:22:52 -08:00
Harshal Sheth
cf3db168ac
feat(ingest): start simplifying stateful ingestion state ( #6740 )
2022-12-13 10:05:57 +01:00
Harshal Sheth
7d63399d00
fix(ingest): fix serde for empty dicts in unions with null ( #6745 )
...
The code changes in https://github.com/acryldata/avro_gen/pull/16 , but tests are written here.
2022-12-13 08:17:24 +01:00
Dmitry Bryazgin
551ef1b335
feat(ingest): add stateful ingestion to the ldap source ( #6127 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-13 01:13:39 -05:00
Aseem Bansal
1da27edcbc
fix(ci): remove warnings due to deprecated action ( #6735 )
2022-12-13 10:42:21 +05:30
Tamas Nemeth
43f95d2b5c
Initial commit for bigquery ingestion guide ( #6587 )
...
* Initial commit for bigquery ingestion guide
* Addressing PR review comments
* Fixing lint error
* Shorten titles
* Removing images
* update copy on overview.md
* update to setup steps with additional roles
* update configuration.md
* lowcasing overview.md filename
* lowcasing setup.md
* lowcasing configuration.md
* update reference to setup.md
* update reference to setup.md
* update reference to configuration.md
* lowcase bigquery ingestion guide filenames
* Update location of ingestion guides in sidebar
* renaming ingestion quickstart guide sidebar
* remove old files
* Update docs-website/sidebars.js
* tweak
Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-12 18:43:43 -08:00
Harshal Sheth
85bb1f5030
test(ingest): make hive/trino test more reliable ( #6741 )
2022-12-12 21:02:52 -05:00
Tamas Nemeth
5658fd5a54
feat(ingest): bigquery - external url support and a small profiling filter fix ( #6714 )
2022-12-12 16:25:32 -08:00
John Joyce
54230a8d81
feat(): Views Feature Milestone 1 ( #6666 )
2022-12-12 12:30:09 -08:00
Aseem Bansal
574bc85c73
doc(restore): document restore indices API endpoint ( #6737 )
2022-12-12 10:45:11 -08:00
cccs-Dustin
2cc64742e0
feat(ingest/iceberg): add stateful ingestion ( #6344 )
2022-12-12 13:06:03 -05:00
John Joyce
621974e559
feat(ui): Support DataBricks Unity Catalog Source in Ui Ingestion ( #6707 )
2022-12-12 09:14:06 -08:00
