Ankit keshari
e572af62ea
feat(ui): Add support for Deprecating an entity via the UI ( #4633 )
2022-04-15 15:10:44 -07:00
Aditya Radhakrishnan
d9aedcaaf9
fix(cypress): enable retries for failed tests to minimize flaking ( #4680 )
2022-04-15 12:30:10 -07:00
Shubham Thakre
72046bf43d
fix(ui): Fixing modal validations for multiple language support ( #4673 )
2022-04-15 10:33:25 -07:00
John Joyce
7db6b0a03f
fix(docs): improve the add users doc ( #4679 )
2022-04-15 10:33:01 -07:00
Atul Saurav
e8e0067f23
fix(cli):Supress printing variables to logs during ingestion failure ( #4566 )
...
Currently when ingestion while running pipeline, stackprinter prints all vars to logs.
This may contain sensitive information. To prevent this from happening, a optional `safe`
flag is added to cli. If this flag is set while running ingestion, no variables are logged in
case of unexpected failures.
2022-04-15 10:30:48 -07:00
Aditya Radhakrishnan
30b5b4c632
docs(tags): add tags usage guide ( #4677 )
2022-04-15 10:25:51 -07:00
Dexter Lee
0f669d5622
refactor(authorization): Add authorizedActor function to Authorizer interface ( #4678 )
2022-04-15 10:24:59 -07:00
Dexter Lee
b9a0f3c60e
Add more platforms ( #4676 )
2022-04-15 09:54:40 -07:00
Gabe Lyons
0c61dee07b
set custom logo without rebuilding ( #4674 )
2022-04-15 09:37:08 -07:00
Aseem Bansal
8e2bd00059
chore(ingestion): update example recipes ( #4660 )
2022-04-14 16:09:19 -07:00
Dexter Lee
46c15ef0a7
fix(search): Fix urn component settings ( #4672 )
...
* Fix urn component settings
* Add keyword subfield to all fields
* Fix tests
2022-04-14 15:40:03 -07:00
Gabe Lyons
d468208fc8
feat(ml): some machine learning followups ( #4669 )
...
* make ml features searchable, add lineage tab, remove 500 exception
* fix lint
2022-04-14 15:14:44 -07:00
Maggie Hays
2534221d5d
remove source summary table ( #4670 )
2022-04-14 16:28:05 -05:00
Tamas Nemeth
61dc6e8723
fix(ingestion): airflow - import emitters indirectly to avoid unneeded dependency ( #4668 )
2022-04-14 10:22:16 -07:00
Ankit keshari
8f6718104b
fix(ui): Adding relative path routing on the Users & Groups screen ( #4664 )
2022-04-14 10:16:41 -07:00
Fernanda de Camargo
d508f5c036
fix(ingestion): tableau - validate datasource before creating its upstream ( #4613 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-04-13 23:08:01 -07:00
Aseem Bansal
73d69510f8
fix(sqlparser): fix sqlparser breaking due to # sign ( #4662 )
...
* fix(sqlparser): fix sqlparser breaking due to # sign
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-13 17:15:38 -07:00
Arun Vasudevan
5aa3da5c9c
feat(ingestion) dbt: Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern ( #4587 )
...
* Fixing issue with strip_user_ids_from_email and adding owner_extraction_pattern
Co-authored-by: BZ <93607724+BoyuanZhangDE@users.noreply.github.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-13 16:58:36 -07:00
Gabe Lyons
4d7684bae7
show fqn in autocomplete ( #4663 )
2022-04-13 12:25:35 -07:00
Aditya Radhakrishnan
cb45d67b46
feat(ci) - add cypress dashboard view to CI ( #4654 )
2022-04-13 07:30:24 -07:00
Aseem Bansal
53d357b4eb
fix(bigquery-usage): missing dependency ( #4661 )
2022-04-13 14:29:31 +02:00
Aseem Bansal
5a59d5a1dd
fix(ingestion): Adding missing init.py ( #4659 )
2022-04-13 11:02:57 +02:00
Aseem Bansal
155209f0e1
fix(ingestion): add missing workunit ids ( #4657 )
2022-04-13 10:19:37 +02:00
Tamas Nemeth
f99d27fd8c
feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk ( #4615 )
...
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2022-04-12 23:19:39 -07:00
Gabe Lyons
c92990d32b
feat(ml): bringing ml screens up to date w/ the modern ui layout & improving ml lineage ( #4651 )
...
* backend ml changes
* updating ml model UI
* more work on the UI
* ml primary key joining the party
* more progress on UI
* making progress on lineage
* finalizing UI experience
* remove irrelevant test
* fixing lint
* fixups
* add tests and fix what the issues they discovered
* internal > core
2022-04-12 22:42:12 -07:00
Kevin Hu
08c34bfe15
feat(ingest): capture MSSQL table+column descriptions ( #4579 )
...
* feat(ingest): capture MSSQL table+column descriptions
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-12 17:49:56 -07:00
David Sanchez
9a950ef231
fix(tableau): avoid duplicate schema in URNs for upstream tables ( #4645 )
...
* fix(tableau): avoid duplicate schema in URNs for upstream tables
* Fix(lint)
2022-04-12 16:26:52 -07:00
Dexter Lee
c9f2c453d2
Fix issue where browse cards are missing ( #4652 )
2022-04-12 16:19:05 -07:00
Meenakshi Kamalaseshan Radha
e75e2f8bbf
fix(ingest): Fix snowflake KEY_PAIR auth ( #4638 )
...
* fix(ingest): Fix snowflake KEY_PAIR auth to work with stateful ingestion.
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-12 15:58:53 -07:00
Zach Bluhm
ff685b7feb
feat: Enable the ingestion of bigquery audit logs to parse usage info… ( #4441 )
...
* feat: Enable the ingestion of bigquery audit logs to parse usage information
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-12 14:58:34 -07:00
Ravindra Lanka
9226e3e27f
Enable lower-casing of the name part of dataset urn via an environment vairable. ( #4649 )
2022-04-12 12:54:22 -07:00
Dyana Rose
5b22d96e04
fix(ingestion): looker - extract explore views from join name ( #4627 )
...
Co-authored-by: Dyana Rose <dyanarose@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-04-12 08:20:10 -07:00
Aseem Bansal
23ece3b1a4
fix(ingestion): ensure source/sink reports are always logged ( #4592 )
2022-04-12 05:00:59 -07:00
Xu Wang
7b1487135a
feat(ingest): add Urn python library for DataJob, DataFlow, Domain and Tag ( #4618 )
...
* feat(ingest): add python library for DataJobUrn
* add DataFlowUrn lib and fix DataJobUrn
* fix create_from_str method
* fix lint error and unit test
* add DomainUrn and TagUrn
Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-04-12 09:02:28 +02:00
Tamas Nemeth
902f525307
[model]: Dataprocess instance entity to model datajob/jobflow runs ( #4459 )
...
* Initial model for dataprocess instance to model datajob/jobflow runs
* Fixing typos
* Removing dataprocessinstance from entity registry
* Add dataprocessinstance to entity registry
Adding DataprocessInstancekey aspect
* Fixing relationships
* Updating the model
* Removing EditableDataProcessInstanceProperties
* Makint try number optional
* Updating model
* Fixing typo
* visualizing job runs for a task
* add pagination
* show utc time on hover
* add dataset side
* dataprocessinstance > dataprocessinst
* add cypress test
* Removing jobs from DataFlowInfo.pdl as it should be part of another change if we really want it
* Adding missing files
* Fix moved import
* Remove duplicate import
* fixing yarn test
* Update DatasetRunsResolver.java
* Update TaskRunsResolver.java
* Update DatasetRunsResolver.java
* responding to comments
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2022-04-12 08:52:07 +02:00
Javier Sotelo
fa4cc3ad31
fix(metadata-service): stop overriding kafka registry props with empty values ( #4604 )
...
Co-authored-by: jsotelo <javier.sotelo@viasat.com>
2022-04-11 22:02:47 -07:00
Marcin Szymański
e7c5eb357c
feat(ingest): add trino platform for great expectations ( #4594 )
2022-04-11 19:48:15 -07:00
jchen0824
524d183d93
feat: add presto-on-hive metadata ingestion source ( #4625 )
...
* feat(metadata ingestion source): add presto-on-hive metadata ingestion source
Co-authored-by: Houren Chen <houren.chen@grabtaxi.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-11 17:46:44 -07:00
Dexter Lee
90bc00c697
feat(search): Only reindex if the mappings for an existing field changed ( #4629 )
...
* Just update mappings as much as possible
* Fix checkstyle
2022-04-11 16:06:41 -07:00
Dexter Lee
2a8ae27261
Revert "feat: adding gradle, pip cache via gh cache, docker cache via dockerhub ( #4387 )" ( #4637 )
...
This reverts commit b6de051d9a5240cefa1a7b217690cfe3a85a70f5.
2022-04-11 16:00:16 -07:00
Aditya Radhakrishnan
80001d2206
fix(cypress) - add waits for cypress search test to remove flakiness ( #4640 )
2022-04-11 15:56:43 -07:00
Tamas Nemeth
e2a617f183
Restricting pytest docker version ( #4639 )
2022-04-11 23:35:34 +02:00
Aseem Bansal
04fd8fcbe8
doc(cli): add env variables and options for ingest command ( #4598 )
2022-04-11 09:18:51 +02:00
BZ
5637e73ca5
feat(glue): add CatalogId parameter for cross-account access ( #4608 )
...
* Update glue.py
* Update glue.md
* Update glue.py
2022-04-11 09:08:25 +02:00
Aseem Bansal
aa0fe3636a
doc(scheduling): make it easier to find ui ingestion ( #4610 )
2022-04-08 10:26:41 -07:00
Aseem Bansal
b6de051d9a
feat: adding gradle, pip cache via gh cache, docker cache via dockerhub ( #4387 )
...
* attempt cache
* change cache keys
* use docker repository for caching
* change buildcache tag
* change tag
* fix cache key
* take docker cache from head buildcache
* try not pushing when not publishing
* change to use templating
* change docker caching
* test change org name
* check using cache
* revert changes
* remove gradle cache from build and test workflow
2022-04-08 09:19:58 -07:00
Aseem Bansal
61a95f41ae
chore: fix lint and remove incorrect integration mark from unit tests ( #4621 )
...
* chore: fix lint and remove incorrect integration mark from unit tests
* add to test requirements
* revert athena source tests
2022-04-08 17:18:48 +02:00
Abhiram98
cd43a4a543
doc(redshift): Add grant statements ( #4559 )
2022-04-08 16:30:43 +02:00
Marcin Szymański
7c3ad3d293
feat(ingest): enable connection string for all sqlalchemy datasources ( #4508 )
...
* feat(ingest): enable connection string for all sqlalchemy datasources
* Update sql_common.py
* fix types
* update docs
* rename variable to sqlalchemy_uri
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-04-07 23:11:52 -04:00
John Joyce
45e09ca824
feat(ui): Adding GraphQL queries to fetch entity deprecation status ( #4614 )
2022-04-07 19:17:24 -07:00
