16 Commits

Author SHA1 Message Date
Onkar Ravgan
5d6e18dc28
Fix 10642: Mark delete entities and tags toggle (#10695)
* Added mark delete logic

* Final test and optimization

* After merge fixes

* Added include tags for dash pipelines dbt

* added docs and fixed test

* Fixed py tests

* Added UI changes for following newly added fields:
- markDeletedDashboards
- markDeletedMlModels
- markDeletedPipelines
- markDeletedTopics
- includeTags

* Fixed failing unit tests

* updated json files of localization for other languages

* Improved localization changes

* added localization changes for other languages

* Updated mark deleted desc

* updated the ingestion fields descriptions in the ingestion form for UI

* automated localization changes for other languages

* updated descriptions for includeTags field for dbtPipeline and databaseServiceMetadataPipeline json

* fixed issue where includeTags field was being sent in the dbtConfigSource

* Added flow to input taxonomy while adding BigQuery service.

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2023-03-29 12:41:44 +05:30
Milan Bariya
fadefff3e1
Fix databricks timeout issue (#10613)
* Fix databricks timeout issue

* Change based on comments

* Change timeOut word to connectionTimeout
2023-03-16 16:13:49 +01:00
NiharDoshi99
1ff76f5e65
pii tagging using spacy (#10256)
* WIP: pii tagging using spacy

* added test cases and changes as per comment

* fix python checkstyle

* fix python checkstyle

* added score, test_cases and docs update

* solved merge conflict

* fix python checkstyle

* remove pii tagging using regex

* fix python test

* lib changes and added some test case

* changed as per comment

* fix: python test

* fix: changes to get source_config

* fix: changes as per comment
2023-03-03 18:33:18 +05:30
Teddy
754074f1be
Fixes #7758 - Added Column value and Integer Range Partitionning (#10350)
* feat(profiler): renamed  module to

* feat(profiler): added dbt-artifacts-parser to test setup.py

* feat(profiler): refactor workflow and interface

* feat(profiler): linting

* feat(profiler): removed old profiler modules

* feat(profiler): added support for value and integer range partition

* feat(profiler): fixed linting

* feat(profiler): added partitionning support for datalake profiler

* feat(profiler): removed `ProfilerInterfaceArgs` class

* feat(profiler): address comments

* feat(profiler): Added `OTHER` as an `IntervalType` for UI type generation
2023-03-01 08:20:38 +01:00
Ayush Shah
4e0598db44
Fix Docs (#10035) 2023-01-31 21:26:26 +05:30
Ayush Shah
747fcf569b
Add docs - quicksight, lineage... (#10023) 2023-01-31 15:17:40 +00:00
Nahuel
da1f911581
Doc: Add missing source config types in connectors config examples (#9955) 2023-01-27 15:30:48 +01:00
Pere Miquel Brull
9160770a47
Docs cleanup for dbt YAML & Looker config (#9937)
* Update looker config

* cleanup dbt
2023-01-27 09:06:30 +01:00
Onkar Ravgan
14fa96958f
Added dbt workflow docs (#9493)
* Added dbt workflow docs

* added dbt small case

* Fixed review comments
2022-12-22 13:11:18 +00:00
Ayush Shah
ba94f78aaa
Add docs for data quality (#9457) 2022-12-21 13:41:37 +00:00
Milan Bariya
a3495c67f0
Databricks improve code and doc update (#9394)
* Databricks improve code and doc update

* Change base on comments

* Fix pytest fail
2022-12-19 18:53:10 +05:30
Teddy
69babdc309
Added data insights docs + update profiler CLI to include partition (#9010) 2022-11-25 14:19:26 +01:00
Milan Bariya
158bd4b9cd
Add: databricks troubleshoot page (#8523) 2022-11-03 14:27:50 +01:00
Milan Bariya
23e4967eda
FIX: Add Databricks usage and lineage details (#8130) 2022-10-14 06:37:57 +02:00
Nahuel
0b74d3456d
Fix Profiler documentation (#8136) 2022-10-13 07:53:00 -07:00
Sriharsha Chintalapani
538e827f5f
Fix Menu , Connectors should've its own section after deployment (#7950)
* Fix Menu

* Fix broken links

* Fix config values

* Fix config values
2022-10-06 06:54:02 +02:00