Harshal Sheth
abddc01877
fix(ingest): fix doc generation import ordering issue with postgres ( #5846 )
...
Relying on the correct import directly, rather than going through
SQLAlchemy's import wrapper (in their dialect.py) allows us to bypass
this strange error in doc generation.
2022-09-07 21:44:33 +05:30
Harshal Sheth
13e411e796
chore(smoke): add additional logs in smoke test ( #5842 )
...
Will help debug flakes like this one: https://github.com/datahub-project/datahub/runs/8213344841?check_suite_focus=true
2022-09-07 09:56:13 +05:30
Harshal Sheth
08622f25ef
feat(ingest): add utility for converting MCEs to MCPs ( #5812 )
2022-09-06 15:25:48 -07:00
Gabe Lyons
29a6f91b61
refactor(ui); update input display for dashboards ( #5841 )
2022-09-06 14:52:58 -07:00
Aseem Bansal
055dd27015
feat(ci): auto label PRs ( #5839 )
2022-09-06 14:46:34 -07:00
mohdsiddique
2f65e2f226
feat(transformers): Add semantics & transform_aspect support in transformers ( #5514 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-06 14:44:14 -07:00
Pedro Silva
9434afc78a
feat(hooks): Add toggle for enabling/disabling platform event hook ( #5840 )
2022-09-06 14:53:58 -05:00
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 ( #5827 )
...
* fix(standalone-consumers) Removes Solr from spring boot application config
* Adds standalone consumer option to datahub quickstart cli
* Rename files
* Make dockerize platform agnostic & change docker compose utility to work with M1
* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers
* Fix identation
* Use master code
* Adds ARM image publishing for consumers
* Fix linter
* Fix lint
2022-09-06 13:55:31 -05:00
Peter Szalai
aa146db611
feat(monitoring): enable JMX and OTEL for frontend pods ( #5834 )
2022-09-06 17:14:53 +05:30
Shirshanka Das
f4eea5dfd5
fix(ingest): profiling - memory usage reduction ( #5830 )
2022-09-05 23:37:19 -07:00
Mayuri Nehate
a8c1397e5e
feat(ingest): tableau - improve lineage, workbooks query, fix pagination ( #5756 )
2022-09-05 23:19:22 -07:00
Harshal Sheth
7e16ce0126
feat(ingest): looker - add test connection ( #5768 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-05 21:11:34 -07:00
Harshal Sheth
bee27e8468
fix(ingest): use AwsConnectionConfig
instead of AwsSourceConfig
( #5813 )
2022-09-05 21:10:33 -07:00
Harshal Sheth
6d83eb9449
refactor(ingest): prefer as
imports instead of pegasus2avro files ( #5820 )
2022-09-05 21:09:07 -07:00
David Sanchez
a092a770a3
docs(ingest): bigquery - add needed delete role to list ( #5826 )
2022-09-05 21:04:33 -07:00
Tamas Nemeth
d283e2b588
fix(ingest): presto-on-hive - customize filter query for postgres ( #5825 )
2022-09-05 21:01:55 -07:00
Shirshanka Das
23b929ea10
feat(cli): report memory usage during ingest ( #5828 )
2022-09-05 11:53:39 -07:00
Shirshanka Das
172441beae
fix(ingest): looker - report dashboard scanning correctly ( #5829 )
2022-09-05 11:10:47 -07:00
Harshal Sheth
13f20ad2c3
fix(docker): add missing port mappings for non-neo4j quickstart ( #5799 )
...
* fix(docker): add missing port mappings for non-neo4j quickstart
* undo cassandra
2022-09-05 15:32:19 +05:30
Tamas Nemeth
caec2ed235
fix(ingest): spark-lineage - Adding additional debug logs to spark lineage ( #5772 )
2022-09-04 22:43:03 -07:00
Harshal Sheth
c44fd626d8
chore: cleanup references to the old ember app ( #5797 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-04 22:42:09 -07:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker ( #5819 )
2022-09-04 22:39:08 -07:00
Mayuri Nehate
4bf4236e29
feat(ingest): snowflake-beta - populate size, add table level profiles for large tables ( #5774 )
2022-09-04 22:37:57 -07:00
Shirshanka Das
84b279a933
feat(ingest):looker - reduce mem usage, misc reporting improvements ( #5823 )
2022-09-04 15:43:57 -07:00
David Haglund
3cd1feb3a6
doc: Make Airflow link clickable ( #5803 )
...
* style: Cleanup windows line endings
* doc: make url to local Airflow instance clickable in the docs
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-03 17:15:59 -04:00
Peter Szalai
5d619249bc
fix(frontend): download node only when USE_SYSTEM_NODE is set to false ( #5817 )
2022-09-02 16:02:46 +02:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph ( #5805 )
2022-09-02 15:24:40 +05:30
Shirshanka Das
ae4fb7c2e1
feat(ingest): looker - reduce memory requirements ( #5815 )
2022-09-02 10:45:51 +02:00
Tamas Nemeth
c91e29b052
fix(ingest): bigquery-beta - Fixing dependencies ( #5814 )
...
* Fixing bigquery beta dependencies
* Removing unneded comment
2022-09-02 13:47:14 +05:30
Harshal Sheth
2a95248f6a
test(smoke-test): check debug arg in executor requests ( #5811 )
2022-09-02 10:43:12 +05:30
Gabe Lyons
d75b2e8c9f
power favicon via env var ( #5810 )
2022-09-01 17:06:30 -07:00
Maggie Hays
4956f5a165
docs(feature-guide) Impact Analysis ( #5765 )
...
* update sidebar titles to remove About DataHub
* move impact analysis guide to new folder; update links
* update copy in Understand Data in Context section
* adding feature guide template to sidebar
* adding feature guide template
* update docs readme to link to feature guide template
* enhance docs-website readme
* add comments to feature guide template
* add links to graphql and lineage resources
* linter cleanup
* updating reference links
* update to graphql reference links
* add image and gif best practices
* update feature guide template with image details
* fix link
* update template from YouTube -> Videos
* Update docs-website/README.md
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
* update feature to Lineage Impact Analysis
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-01 18:11:14 -05:00
Maggie Hays
91f6084473
docs(refactor): Refactor Tags Feature Guide ( #5781 )
...
* docs(refactor): Refactor Tags Feature Guide
* update graphql links
* remove unneeded WIP tag guide doc
* update tags guide to match template
2022-09-01 18:10:44 -05:00
Shirshanka Das
9afda47085
feat(cli): add support for sampled reporting to keep logs manageable ( #5800 )
2022-09-01 14:47:28 -07:00
Harshal Sheth
c05f3970fd
feat(ingest): cli - add rewrite option for metadata file check ( #5763 )
2022-09-01 14:30:00 -07:00
Harshal Sheth
e884b69b0e
chore(ingest): remove archived docs ( #5793 )
2022-09-01 12:10:03 -07:00
RyanHolstien
1c0080df5b
fix(javadocs): remove ampersand from pdl causing issue in doc generation for openapi ( #5808 )
2022-09-01 13:32:29 -05:00
Chris Collins
b0fc67b926
fix(privileges) Add Term Groups as targetable entities for privileges ( #5806 )
2022-09-01 09:08:41 -07:00
Gabe Lyons
5bf5fc2d66
feat(previews): add previews for glossary terms, tags, and domains ( #5784 )
...
* add graphql for chart glossary terms
* add placeholder tab component
* continued progress
* finished rendering of other tooltips
* fix tests
* add null check
* force more clicks
* fix analytics test
v0.8.44
2022-08-31 20:48:32 -07:00
John Joyce
ca29f8b679
fix(bootstrap): Creating dedicated thread pool for executing async bootstrap steps + misc fixes ( #5798 )
2022-08-31 19:34:17 -07:00
Ravindra Lanka
af1fc8d91d
fix(ingest): snowflake - fix oauth config validation ( #5796 )
2022-08-31 17:51:13 -07:00
mohdsiddique
dbcd3099d4
fix(ingestion): looker - fix dashboard and chart-usage calculations ( #5791 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-31 16:22:11 -07:00
Chris Collins
3059d9d0e1
feat(ingestion-ui) Add test connection button to Looker form ( #5794 )
2022-08-31 15:32:59 -07:00
Chris Collins
951bca096a
fix(audit logs) Set actor urn on audit stamp through Java Entity Client ( #5788 )
2022-08-31 10:26:47 -07:00
Gabe Lyons
570367ce4a
docs(lookml): updating github_info in lookml docs ( #5779 )
2022-08-31 10:23:10 -07:00
Chris Collins
23275a14d0
fix(tags) Add creator of tag as the owner of it ( #5787 )
2022-08-31 10:21:51 -07:00
John Joyce
c0a69eb2eb
fix(ci): Attempting to fix failing smoke tests ( #5760 )
2022-08-31 10:19:00 -07:00
John Joyce
7cfae0d7a3
fix(ui): Remove add limit on Entity Profile for glossary terms and tags ( #5780 )
2022-08-31 08:51:08 -07:00
Aditya Radhakrishnan
9bffad5a9e
docs(roles): add documentation about roles ( #5778 )
2022-08-30 21:16:01 -07:00
Shirshanka Das
4cbb79665e
feat(model): add storage size to dataset profiles ( #5777 )
2022-08-30 18:32:04 -07:00