15 Commits

Author SHA1 Message Date
Sachin Chaurasiya
0a92a897a1
chore(ui): add support for service documentation (part-1) (#10668)
* chore(ui): add support for service documentation md file

* sync local

* chore: add method for fetching markdown file

* chore(ui): add support for service documentation

* chore: move fields to connections

* chore: update logic to fetch requirements

* chore: right panel component for service

* fix: key prop is not present in the skeleton component

* chore: only fetch md files when required fields are present

* chore: use hook for fetching airflow status

* chore: refactor add service component

* chore: remove id prefix and id separator prop from form builder

* fix: fieldName issue on right panel

* fix: active Field name issue

* fix:unit test

* test: add unit test

* chore: handle edit service form

* chore: add fallback logic

* fix: cy test

* chore: update service doc md files/folder structure,

* chore: push image example

* Athena docs

* Add glue docs

* Add hive related changes

* chore: take last field for fetching field doc

* add datalake

* Added connection information for oracle and redshift (english + french)

* fix: fallback logic

* Bigquery & Snowflake Requirements

* mysql and amundsen requirements (#10752)

* Revert removal of descriptions

* Add Doc For Mssql and Postgres

* Added powerbi conn md files

* Align requirements files

* Add Kafka and Redpanda

* refined powerbi docs

* Add Tableu requirements, move Athena and Glue fields, change footer some connectors

* Add missing connectors fields descriptions default

* re: datalake

* Add Tableau field descriptions

* fix: markdown styling

* chore: improve button styling

* chore: rename right panel to service right panel and move it to common

* fix: doc for select and list field , cy test.

* fix: unit test

* fix: test connection service type issue

* Added powerbi docs link in req

* Add info on hive

* Remove unused markdowns

* Add req for datalake

* add hive requirements header

* Snowflake & Biguqery

* Update Mssql and Postgres

* mysql and amundsen requirements updated

* Update Mssql and Postgres

* added username

* chore: fix cy expression issue

* chore: reset active field state on step change.

* fix: affix target container issue

* fix: unit test

* fix: cypress for postgres and glue

---------

Co-authored-by: Milan Bariya <52292922+MilanBariya@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: NiharDoshi99 <51595473+NiharDoshi99@users.noreply.github.com>
Co-authored-by: Milan Bariya <milanbariya12@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
Co-authored-by: Nihar Doshi <nihardoshi16@gmail.com>
2023-03-29 14:18:17 +05:30
Onkar Ravgan
5d6e18dc28
Fix 10642: Mark delete entities and tags toggle (#10695)
* Added mark delete logic

* Final test and optimization

* After merge fixes

* Added include tags for dash pipelines dbt

* added docs and fixed test

* Fixed py tests

* Added UI changes for following newly added fields:
- markDeletedDashboards
- markDeletedMlModels
- markDeletedPipelines
- markDeletedTopics
- includeTags

* Fixed failing unit tests

* updated json files of localization for other languages

* Improved localization changes

* added localization changes for other languages

* Updated mark deleted desc

* updated the ingestion fields descriptions in the ingestion form for UI

* automated localization changes for other languages

* updated descriptions for includeTags field for dbtPipeline and databaseServiceMetadataPipeline json

* fixed issue where includeTags field was being sent in the dbtConfigSource

* Added flow to input taxonomy while adding BigQuery service.

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2023-03-29 12:41:44 +05:30
NiharDoshi99
1ff76f5e65
pii tagging using spacy (#10256)
* WIP: pii tagging using spacy

* added test cases and changes as per comment

* fix python checkstyle

* fix python checkstyle

* added score, test_cases and docs update

* solved merge conflict

* fix python checkstyle

* remove pii tagging using regex

* fix python test

* lib changes and added some test case

* changed as per comment

* fix: python test

* fix: changes to get source_config

* fix: changes as per comment
2023-03-03 18:33:18 +05:30
Ayush Shah
4e0598db44
Fix Docs (#10035) 2023-01-31 21:26:26 +05:30
Ayush Shah
747fcf569b
Add docs - quicksight, lineage... (#10023) 2023-01-31 15:17:40 +00:00
Nahuel
da1f911581
Doc: Add missing source config types in connectors config examples (#9955) 2023-01-27 15:30:48 +01:00
Onkar Ravgan
14fa96958f
Added dbt workflow docs (#9493)
* Added dbt workflow docs

* added dbt small case

* Fixed review comments
2022-12-22 13:11:18 +00:00
Ayush Shah
b3d7719289
Add Azure Datalake to the list (#9487)
* Add Azure Datalake to the list

* Put Yaml configs under the relevant sections
2022-12-22 11:15:57 +01:00
Ayush Shah
ba94f78aaa
Add docs for data quality (#9457) 2022-12-21 13:41:37 +00:00
NiharDoshi99
9a3d599f30
Azure datalake minor changes (#9407) 2022-12-21 10:28:41 +05:30
NiharDoshi99
4619ade3b5
Fix: updated docs for datalake-azure (#9358)
* Fix: updated docs for datalake-azure

* Fix: as per comment
2022-12-17 16:22:03 +05:30
Mayur Singal
625b0551b1
Added File Types in Databrick Docs (#8865) 2022-11-19 21:07:48 -08:00
Pere Miquel Brull
fe16dea584
Fix #8794 - Separate DL requirements and lazy imports (#8806) 2022-11-17 09:11:54 +00:00
Mayur Singal
45adf285ba
Snoflake & S3 permission update in docs (#8296) 2022-10-20 10:56:13 -07:00
Sriharsha Chintalapani
538e827f5f
Fix Menu , Connectors should've its own section after deployment (#7950)
* Fix Menu

* Fix broken links

* Fix config values

* Fix config values
2022-10-06 06:54:02 +02:00