Ravindra Lanka
ab633d0047
fix(ingest): snowflake - handle external S3 bucket lineage for "External Tables". ( #4192 )
2022-02-18 15:52:13 -08:00
John Joyce
e09542d3e8
Show profile image on list users ( #4195 )
2022-02-18 15:39:48 -08:00
MugdhaHardikar-GSLab
a894424dc6
refactor(spark-lineage): enhance logging and documentation ( #4113 )
2022-02-18 12:54:26 -08:00
John Joyce
71c2b664de
WARN on 400 from elasticsearch ( #4193 )
2022-02-18 12:48:43 -08:00
John Joyce
b08784e27a
minor fixes(ui): Small UI display fixes ( #4190 )
2022-02-18 10:12:30 -08:00
Swaroop Jagadish
eaf7b02b2a
docs(model): auto-generated docs and hand-written docs for the metadata model ( #4189 )
2022-02-18 09:45:45 -08:00
Dexter Lee
db8c215c0b
feat(analytics): Improve analytics page by adding more charts regarding metadata ingested ( #4176 )
2022-02-18 09:38:17 -08:00
Tamas Nemeth
8cb312c4be
fix(ci): pinning markup_safe ( #4188 )
2022-02-18 08:53:28 -08:00
John Joyce
93befda8cf
feat(groups): Adding editable group properties in the backend ( #4166 )
2022-02-17 22:47:59 -08:00
Shubham Thakre
8167cbd432
minor ui fixes ( #4181 )
2022-02-17 21:08:12 -08:00
John Joyce
74ebbbf94f
fixes(ui): Misc UI fixes + Adding Owners to Search Filters ( #4175 )
2022-02-17 18:48:29 -08:00
RyanHolstien
6177a07244
bug(glossaryTermLabels): fix glossary term labels missing and add cypress test ( #4171 )
...
* bug(glossaryTermLabels): fix glossary term labels missing and add cypress test
* review comment
* fix cypress test
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-02-17 16:50:59 -08:00
RyanHolstien
dc40998d62
bugfix(logging): reduce log noise from authentication chain ( #4173 )
2022-02-17 15:26:09 -08:00
Harshal Sheth
c89a1f20b3
chore(docs): various cleanup for docs-website ( #4143 )
2022-02-17 12:15:39 -08:00
Shubham Thakre
413990d3e8
Feature/users and groups UI updated as per new design ( #4134 )
2022-02-17 10:27:07 -08:00
Tamas Nemeth
585aad1aac
Fix for wrong containers on Athena ( #4167 )
2022-02-17 01:34:02 -08:00
Tamas Nemeth
2e7f3ae6f3
Removing sql_common dep from glue ( #4168 )
2022-02-17 01:33:29 -08:00
Harshal Sheth
75d2ec2a39
ci(ingestion): fix airflow 1 deps for tox ( #4083 )
2022-02-17 00:33:28 -08:00
Harshal Sheth
6f37ddfee2
chore(ingestion): upgrade mypy ( #4141 )
2022-02-17 00:31:20 -08:00
Ravindra Lanka
6c75185445
fix(ingest): Use lower-case dataset names in the dataset urns for all SQL-styled datasets. ( #4140 )
2022-02-16 19:45:07 -08:00
cuong-pham
ede6d91534
Update the doc to including options to include Views ( #4164 )
2022-02-16 19:42:09 -08:00
Ravindra Lanka
51d72c6a29
feat(ingestion): Add support for snowflake view lineage. ( #4163 )
...
* Add support for snowflake view lineage.
* Add a config flag. Sepearate upstream & downstream view lineage computation. Update documentation.
2022-02-16 18:27:40 -08:00
stephenp-gr
fb80e6b7bc
Common ElasticsearchContainer creation ( #4152 )
2022-02-16 16:10:10 -08:00
buggythepirate
292dcf34e4
Update querying-entities.md ( #4157 )
2022-02-16 16:08:29 -08:00
John Joyce
da74943485
feat(ui): Edit glossary term descriptions via UI ( #4156 )
2022-02-16 15:01:22 -08:00
Ankit keshari
e3599c521c
UI Fix: Modal close on Enter press, autofocus on modal, added split panel, alignment of button ( #4155 )
2022-02-16 15:00:54 -08:00
RyanHolstien
f37bdad78e
bug(seedData): adds a key to the root user seed data and fixes corner case check for missing key aspects ( #4162 )
...
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-02-16 14:23:20 -08:00
Amanda Ng
d17f2bf014
feat(ui): Host platform images on datahub-web-react ( #4118 )
...
* feat(react-images): host platform images on datahub-web-react
* feat(react-images): update data_platforms logoUrl
* feat(react-images): add explanation for CopyWebpackPlugin
Co-authored-by: Amanda Ng <amanda.ng@grabtaxi.com>
2022-02-16 11:28:06 -08:00
Tamas Nemeth
b2664916e3
feat(ingest): Glue - Support for domains and containers ( #4110 )
...
* Add container and domain support for Glue.
Adding option to set aws profile for Glue.
* Adding domain doc for Glue
* Making get_workunits less complex
* Updating golden file
* Addressing pr review comments
* Remove unneded empty line
2022-02-16 08:29:14 -08:00
John Joyce
5640999670
fix(ui): Fix cutoff profiling axis labels ( #4154 )
2022-02-15 16:25:01 -08:00
Aseem Bansal
d33a868f19
fix(docs): fix example of delta lake ( #4149 )
2022-02-15 14:44:37 -08:00
Aseem Bansal
68c840824f
chore(cli): update default cli version pinned in the UI based ingestion ( #4150 )
2022-02-15 14:43:18 -08:00
Aseem Bansal
c6c71ac8bf
fix(cli): add timeout for telemetry calls ( #4135 )
2022-02-15 14:39:46 -08:00
RyanHolstien
a251d589ed
Feature/oss/update to v2 endpoints ( #4128 )
2022-02-15 14:37:05 -08:00
Gabe Lyons
3a537189e8
Update README.md ( #4139 )
2022-02-15 09:28:16 -08:00
Claudio Benfatto
aeefde4fa1
feat(ingestion): Kafka stateful ingestion ( #4028 )
...
* test: test stateful ingestion for kafka
test: some more advancement
test: some improvements
refactoring
* refactor: remove some linter modifications
* tests: add unit tests for kafka state
* refactor: minor changes
* tests: improve test coverage
* fix: fix naming
* style: fix format with black
* fix: fix broken test
* revert: revert smoke tests to master
* feat: add reporting to kafka source
* tests: add smoke tests for kafka reporting
* revert: revert changes to the smoke tests
* test: add kafka integration test for stateful ingestion
* docs: update documentation on kafka source
* fix: return empty string when no platform instance
* revert: remove unwanted file
* fix: solve problem with platform instance
* chore: use console sink instead of file
* fix: disable complexity check for _extract_record
* fix: remove if condition in get_platform_instance_id
* chore: remove unneeded integration test
* test: test platform instance in kafka source unit tests
2022-02-15 07:18:36 -08:00
Satyam Krishna
0dd2a7b753
docs : markdown fixes for db retention table ( #4148 )
2022-02-15 07:17:40 -08:00
Satyam Krishna
ecfe8a2649
Fix the markdown for tables ( #4133 )
2022-02-14 22:03:22 -08:00
Dexter Lee
ae6f5a8dfa
Fix logging ( #4136 )
2022-02-14 13:52:21 -08:00
Tamas Nemeth
bfaec300b6
feat(ingest) Athena: Getting table properties for Athena datasets ( #4123 )
...
* Getting table properties for Athena datasets
* Isorting
* Fixing mypy error
* Addressing pr review comments
Adding tests
* Adding missing import
* black
* Fixing test run
* fixing flake8
* Adding athen to tox tests as well
* Not running athena tests on python < 3.7
* Adressing more pr comments
2022-02-14 13:51:45 -08:00
Gabe Lyons
06bb03387a
fix(cypress): force clicks on tag mutation test ( #4102 )
...
* fix detached from dom issue in modal clicks
* warm up ES cache
* warm up ES cache
* trying to connect cypress w/ dashboard
* fix spacing
* record the run
* reverting cypress cli stuff
2022-02-11 16:20:03 -08:00
David Haglund
6c214add36
fix(docs) Fix doc on modelDocUpload ( #4112 )
...
Update the doc to use the same environment variable as the script
to configure which Datahub server to upload the model doc to.
2022-02-11 13:43:59 -08:00
Aditya Radhakrishnan
368b20878c
fix(ui) - move book logo to right of glossary term ( #4125 )
...
* fix(ui) - move book logo to right of glossary term
* Flip book on top glossary terms
2022-02-11 13:43:37 -08:00
Tamas Nemeth
d24c52828b
fix(ingest) Athena: db filter was not applied ( #4127 )
...
* Fix for db filter on Athena
* Black formatting
* Addressing pr comments
* Remove unneeded imports
2022-02-11 13:42:41 -08:00
Aseem Bansal
7fcc71ed81
fix(docs): make intro to metadata ingestion easier for beginners ( #4039 )
...
* fix(docs): fix sidebar titles for clarity
* re-arrange docs to make Intro to Metadata ingestion easier for beginners
* minor changes for readability
* add heading
* docs: add note for common question
2022-02-11 09:03:01 -08:00
Aseem Bansal
25a426a06f
docs(backup): add doc for taking backup ( #3917 )
...
* docs(backup): add doc for taking backup
* change file name
2022-02-11 08:57:05 -08:00
John Joyce
f2f5443d04
feat(Tags/Terms): Backend support for tag & term mutations ( #4096 )
2022-02-11 07:00:46 -08:00
Swaroop Jagadish
4dba8fe6e7
fix(ci): fix formatting for action yaml ( #4122 )
2022-02-10 23:09:23 -08:00
Swaroop Jagadish
8716d7345c
fix(ci): fix fomatting in doc generation action yaml ( #4121 )
2022-02-10 23:01:24 -08:00
Swaroop Jagadish
d1a14abb53
fix(docs): fixing metadata model doc generation script and updating png ( #4120 )
2022-02-10 22:56:28 -08:00
