1530 Commits

Author SHA1 Message Date
Pere Miquel Brull
c6f31ed406
Docs - Ingestion Framework Debug settings (#11009) 2023-04-12 11:23:31 +02:00
Milan Bariya
ff3e19498a
Doc update for Data-insight (#10985) 2023-04-11 12:18:00 +02:00
Sriharsha Chintalapani
7c6b9b3c56
Update python sdk client connection details (#10963)
* Update python sdk client connection details

* Update index.md
2023-04-06 20:44:36 -07:00
NiharDoshi99
325480fb2e
added migration scripts for druid and postgres docs update (#10920)
* added migration scripts for druid and postgres docs update

* postgres docs update
2023-04-04 22:45:19 +05:30
Teddy
9b4e9132ae
fixed #9656 - Add support for date type to column values to be between (#10890)
* fix: renamed  to  submodule

* fix: linting

* fix: columnValuesToBeBetween test for date column type
2023-04-04 17:16:44 +02:00
Sriharsha Chintalapani
e6ac7af49d
Fix roadmap dates and features (#10922) 2023-04-04 16:48:11 +02:00
Onkar Ravgan
608bf51b6a
Added non admin apis support for PowerBI (#10910)
* Added non admin apis support

* addressed review comments
2023-04-04 18:25:48 +05:30
Suresh Srinivas
c8b640674b
10041 part2 - Refactor and cleanup APIs (#10900)
* Use @Tag annotation to group APIs in the swagger documentation.

* Hide internal APIs

* Change API path events/subscription to events/subscriptions

* Change API path from automations/workflow to automations/workflows

* Change API path v1/testCase to v1/testCases

* Change API path v1/testDefinition to v1/testDefinitions

* Change API path v1/testSuite to v1/testSuites

* Rename Kpi and kpi in the documentation to KPI

* Change API path v1/testConnectionDefinition to v1/testConnectionDefinitions

* Update API section in the API documentation

* Fix test failures

* Correctly capitalize Test Cases and Test Suites in API docs
2023-04-03 13:03:48 -07:00
Mayur Singal
69729ac8eb
Fix #10320: Add Athena Usage & Lineage (#10879) 2023-04-03 11:21:55 +00:00
Sachin Chaurasiya
ae5e7a3d98
doc: update rule doc to include conditions (#10845) 2023-03-31 18:36:09 +05:30
Chirag Madlani
f7f5040008
update node version in prerequisites (#10844) 2023-03-30 13:07:49 +00:00
Sachin Chaurasiya
0a92a897a1
chore(ui): add support for service documentation (part-1) (#10668)
* chore(ui): add support for service documentation md file

* sync local

* chore: add method for fetching markdown file

* chore(ui): add support for service documentation

* chore: move fields to connections

* chore: update logic to fetch requirements

* chore: right panel component for service

* fix: key prop is not present in the skeleton component

* chore: only fetch md files when required fields are present

* chore: use hook for fetching airflow status

* chore: refactor add service component

* chore: remove id prefix and id separator prop from form builder

* fix: fieldName issue on right panel

* fix: active Field name issue

* fix:unit test

* test: add unit test

* chore: handle edit service form

* chore: add fallback logic

* fix: cy test

* chore: update service doc md files/folder structure,

* chore: push image example

* Athena docs

* Add glue docs

* Add hive related changes

* chore: take last field for fetching field doc

* add datalake

* Added connection information for oracle and redshift (english + french)

* fix: fallback logic

* Bigquery & Snowflake Requirements

* mysql and amundsen requirements (#10752)

* Revert removal of descriptions

* Add Doc For Mssql and Postgres

* Added powerbi conn md files

* Align requirements files

* Add Kafka and Redpanda

* refined powerbi docs

* Add Tableu requirements, move Athena and Glue fields, change footer some connectors

* Add missing connectors fields descriptions default

* re: datalake

* Add Tableau field descriptions

* fix: markdown styling

* chore: improve button styling

* chore: rename right panel to service right panel and move it to common

* fix: doc for select and list field , cy test.

* fix: unit test

* fix: test connection service type issue

* Added powerbi docs link in req

* Add info on hive

* Remove unused markdowns

* Add req for datalake

* add hive requirements header

* Snowflake & Biguqery

* Update Mssql and Postgres

* mysql and amundsen requirements updated

* Update Mssql and Postgres

* added username

* chore: fix cy expression issue

* chore: reset active field state on step change.

* fix: affix target container issue

* fix: unit test

* fix: cypress for postgres and glue

---------

Co-authored-by: Milan Bariya <52292922+MilanBariya@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: NiharDoshi99 <51595473+NiharDoshi99@users.noreply.github.com>
Co-authored-by: Milan Bariya <milanbariya12@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
Co-authored-by: Nihar Doshi <nihardoshi16@gmail.com>
2023-03-29 14:18:17 +05:30
Onkar Ravgan
5d6e18dc28
Fix 10642: Mark delete entities and tags toggle (#10695)
* Added mark delete logic

* Final test and optimization

* After merge fixes

* Added include tags for dash pipelines dbt

* added docs and fixed test

* Fixed py tests

* Added UI changes for following newly added fields:
- markDeletedDashboards
- markDeletedMlModels
- markDeletedPipelines
- markDeletedTopics
- includeTags

* Fixed failing unit tests

* updated json files of localization for other languages

* Improved localization changes

* added localization changes for other languages

* Updated mark deleted desc

* updated the ingestion fields descriptions in the ingestion form for UI

* automated localization changes for other languages

* updated descriptions for includeTags field for dbtPipeline and databaseServiceMetadataPipeline json

* fixed issue where includeTags field was being sent in the dbtConfigSource

* Added flow to input taxonomy while adding BigQuery service.

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2023-03-29 12:41:44 +05:30
Milan Bariya
3d1bbb1037
Add a configurationto skip Snowflake transient and tmp tables (#10665)
* Add a configurationto skip  Snowflake transient and tmp tables

* Fix Python checkstyle

* add separate query for transient tables

* Move skipTempTables into SnowflakeConnection

* Fix merge conflict

* change skip word to include

* Add title in json file

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-28 06:29:59 +02:00
Mohit Yadav
29119dda89
Add docs for SAMl and AWS saml setup (#10787) 2023-03-28 01:05:21 +05:30
Sachin Chaurasiya
0f3e929b75
doc: update doc for how to add new language support (#10734)
* doc: update doc for how to add new language support

* chore: minor fix

* address comments
2023-03-25 13:08:17 +05:30
Jan-Pieter van den Heuvel
c46732a4ff
Fix year of latest release in releases documentation page (#10664) 2023-03-24 17:08:21 +01:00
Pere Miquel Brull
4913aeb53b
Docs - Add Airflow version support (#10707) 2023-03-24 06:31:38 +01:00
NiharDoshi99
bfa0905093
update druid docs (#10735) 2023-03-23 22:16:14 +05:30
Teddy
b2e1eed842
doc: added best practice section to profiler (#10712)
* doc: added best practice section to profiler

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-22 19:36:42 +01:00
Mayur Singal
9f99296ea0
Bigquery Docs Fix (#10692)
* Bigquery Docs Fix

* typo fix

* keycloak sso

* GCP Create Custom Role
2023-03-21 16:55:57 +01:00
Ayush Shah
133bdfbf64
Add Okta Doc fix, Athena lineage fix, quicksight permissions (#10683) 2023-03-21 12:44:58 +05:30
Parth Panchal
796fb8e768
Added ldap docker documentation (#10641) 2023-03-17 14:23:02 +05:30
Onkar Ravgan
aeec285901
Added s3 and gcs examples for dbt (#10639) 2023-03-17 12:19:34 +05:30
Milan Bariya
fadefff3e1
Fix databricks timeout issue (#10613)
* Fix databricks timeout issue

* Change based on comments

* Change timeOut word to connectionTimeout
2023-03-16 16:13:49 +01:00
dhruvinmaniar123
144b611933
Update eks.md (#10625)
* Update eks.md

Added AWS document to create directories under EFS in AWS.

* Update eks.md
2023-03-16 11:57:50 +01:00
Pere Miquel Brull
47585e035a
Update MWAA docs (#10588) 2023-03-15 09:22:04 +01:00
Ayush Shah
7e4ba4567b
Fix Quicksight URL (#10592) 2023-03-15 08:05:38 +00:00
Nahuel
ff2190036f
Fix misleading date in documentation (#10593) 2023-03-15 07:47:49 +00:00
Sachin Chaurasiya
cde1d36570
doc: Add doc for "how to add language support" (#10585)
* doc: Add doc for "how to add language support"

* fix: build
2023-03-14 23:25:03 +05:30
Onkar Ravgan
93e554ae67
Fixed Redash Source Issues (#10570)
* Imporved redash source

* Added docs

* Addressed review comments
2023-03-14 23:00:49 +05:30
NiharDoshi99
9b0b06fe25
Added flag for overriding owners (#10425)
* added flag for overriding owners

* docs update

* adding owners in patch call

* adding owners in patch call

* fix: python test case

* changes as per comment

* changes as per comment

* ui changes
2023-03-10 15:01:56 +05:30
Suresh Srinivas
4c6d184ef5
Fixes #10480 Glossary rename results in rename of Classification with… (#10486)
* Fixes #10480 Glossary rename results in rename of Classification with the same name

* Rename TagSource Tag to Classification
2023-03-09 00:30:36 -08:00
Sriharsha Chintalapani
de10cd254b
New docker structure (#10438)
* Adding the different docker-compose file openmetadata and ingestion

* Added two different env files for mysql and postgres

* Updated the docker file path

* Updated the path of docker folder structure

* Fix docker

* Updating the PR with necessary changes required

---------

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-03-06 08:58:53 -08:00
Nahuel
f2e1a87b5a
Fix#10377: service connection not overwritten as expected (#10445) 2023-03-06 16:32:10 +01:00
Nahuel
5be1a77f94
Add Java SDK examples to the documentation (#10444) 2023-03-06 13:17:33 +01:00
Sriharsha Chintalapani
b47fa2e818
Update Roadmap (#10427) 2023-03-03 12:09:11 -08:00
Sriharsha Chintalapani
e6aa672072
Update Roadmap (#10426)
* Update Roadmap

* Update Roadmap

* Update Roadmap
2023-03-03 11:58:13 -08:00
Akash Jain
783219495f
[DOCS] Add key pairs configurations for docker and kubernetes (#10418)
* fix: docs for k8s jwt key pair configurations

* fix: docs for docker jwt key pair configurations
2023-03-03 11:44:10 -08:00
NiharDoshi99
1ff76f5e65
pii tagging using spacy (#10256)
* WIP: pii tagging using spacy

* added test cases and changes as per comment

* fix python checkstyle

* fix python checkstyle

* added score, test_cases and docs update

* solved merge conflict

* fix python checkstyle

* remove pii tagging using regex

* fix python test

* lib changes and added some test case

* changed as per comment

* fix: python test

* fix: changes to get source_config

* fix: changes as per comment
2023-03-03 18:33:18 +05:30
Nahuel
6e6722b5e1
Fix: broken image link in Kafka doc (#10400) 2023-03-03 10:29:41 +05:30
charliemenke
7a41bd37c2
fix service name typo in docs (#10385) 2023-03-02 12:51:10 +05:30
Akash Jain
197e931a00
fix: docs for k8s publicKeys (#10371)
* fix: docs for k8s publicKeys

* Update kubernetes.md
2023-03-01 18:03:58 +05:30
Sachin Chaurasiya
4ce038557e
feat(ui)#10274: UI - allow to configure OM logo (#10316)
* feat(ui)#10274: UI - allow to configure OM logo

* chore: use logo config to render the brand and login page logo

* fix : cy tests

* doc: update the doc

* chore: remove check for filePath logo location type

* test: add unit test

* - removed FilePath
- Added configs to docker

* address comment

* remove config from test yaml

* update logo aspect ratio

* remove type

* chore: update ui logic as per backend config

* update doc

* address comments

* Revert "address comments"

This reverts commit c4f9da88918343cab08cd5e603cba29bd05b2ec9.

* address comments

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-03-01 14:09:44 +05:30
Teddy
754074f1be
Fixes #7758 - Added Column value and Integer Range Partitionning (#10350)
* feat(profiler): renamed  module to

* feat(profiler): added dbt-artifacts-parser to test setup.py

* feat(profiler): refactor workflow and interface

* feat(profiler): linting

* feat(profiler): removed old profiler modules

* feat(profiler): added support for value and integer range partition

* feat(profiler): fixed linting

* feat(profiler): added partitionning support for datalake profiler

* feat(profiler): removed `ProfilerInterfaceArgs` class

* feat(profiler): address comments

* feat(profiler): Added `OTHER` as an `IntervalType` for UI type generation
2023-03-01 08:20:38 +01:00
kcd83
c0f06191b0
Tips on how to format and private key for the UI and in YAML (#10370)
Co-authored-by: kcd <1108143-kcd@users.noreply.gitlab.com>
2023-02-28 12:18:21 -08:00
Mohit Yadav
61c896964e
How to guide for custom logo (#10293)
* How to guide for custom logo

* add to menu
2023-02-23 12:54:54 +05:30
Onkar Ravgan
0f3536f973
updated tableau req (#10268) 2023-02-22 19:03:06 +05:30
Parth Panchal
9bd22369d7
Fixed#10211: Enable LDAP configuration to be configured via environment variable (#10252)
* Fixed#10211: Enable LDAP configuration to be configured via environment variable

* Fixed#10211: Enable LDAP configuration to be configured via environment variable
2023-02-22 12:53:24 +05:30
Akash Jain
cae284d8d7
Docs for fixing helm upgrades for MySQL (#10239) 2023-02-21 20:37:05 +05:30