388 Commits

Author SHA1 Message Date
Imri Paran
f060d60c1b
MINOR: Added docs for failed rows sample in data quality (#16218)
* Added failed row sample docs

* title
2024-05-10 12:45:00 +02:00
Sachin Chaurasiya
e24e7cfd4b
doc: update custom property doc (#16213) 2024-05-10 08:03:02 +05:30
Prajwal214
78a53f2a9b
Minor: Updated the IntelliJ Dependency For Openmetadata-UI (#16179) 2024-05-09 16:59:09 +05:30
Prajwal214
43c205ae00
Minor: Updated the document for Airflow DAGs Deployed as Examples (#16182) 2024-05-09 16:58:02 +05:30
Suman Maharana
6915c1a1b6
Fix #15090 [1.4] Added dbt existing glossary and tier ingestion (#15833)
* Added dbt glossary and tier ingestion

* changed elif to if condition:pylint

* Added dbtMeta model for glossary and tier

* removed source

* Optimization: Reused the dtb_tags

* pylint format

* py_format

* Removed unnecessary models and minor changes

* Removed empty string assignment
2024-04-17 17:10:20 +02:00
Onkar Ravgan
370abda43f
dbt docs revamp (#15787) 2024-04-03 20:42:30 +05:30
Shilpa Vernekar
f28214e0c0
Missing docs added (#15763) 2024-04-03 09:03:08 +00:00
Harsh Vador
1db15dc840
Change connectors images format to webp (#15781)
* Change connectors images format to webp

* compress connectors images
2024-04-03 11:50:50 +05:30
Suman Maharana
a8d288cc32
Fix #11351 Added Kafka Connect connector docs (#15747)
* Added Kafka Connect JSON Schemas

* Added Kafka Connect Documentation

* Revert "Added Kafka Connect JSON Schemas"

This reverts commit 89cf700e93f1391f24156a1235e5d5e70b067704.

* Added webp image formats for kafkaconnect docs

---------

Co-authored-by: Suman Maharana <suman@Reyna.local>
2024-04-01 11:34:38 +05:30
harshsoni2024
884029f031
Fix #14089: Add QlikCloud connector support (#15610) 2024-03-28 20:15:22 +05:30
IceS2
ce3f124a33
MINOR: Add Multithread Documentation (#15706)
* Add Multithread Documentation

* Add general considerations
2024-03-27 08:30:16 +01:00
Aniket Katkar
dcbb1dd0f8
Docs: Fix the wrong image references for connector details pages (#15559)
* fix the wrong image references for connector details pages

* Add ADLS and GCS Pages

* Add adls and gcs logos

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2024-03-14 11:00:31 +05:30
Ayush Shah
1c2fbdd9f4
MINOR: Add / Fix GCS and ADLS - docs, bugs (#15502)
Add GCS and ADLS docs
2024-03-12 21:13:24 +05:30
mgorsk1
98850ab5cc
feat: OpenLineage integration (#15317)
* 🎉 Init OpenLineage connector

Co-authored-by: dechoma <dominik.choma@gmail.com>

* MLH - make linter happy

* review fixes

* 🐛 Fix path for ol event in tests

* 🐛 Fix path for ol event in tests

* Update ingestion/setup.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/metadata.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/models.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* review fixes 2

* linter

* review

* review

* make linter happy

* fix test_yield_pipeline_lineage_details test

* make linter happy

* fix tests

* fix tests 2

---------

Co-authored-by: dechoma <dominik.choma@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-03-12 08:39:25 +01:00
Imri Paran
67c57ec4f0
docs: 1.4.x-SNAPSHOT (#15506)
* docs: 1.4.x-SNAPSHOT
added partials
added images
updated paths
2024-03-11 09:42:26 +00:00
Aniket Katkar
6a0750eb0c
Docs: Update connectors in the documentation (#15384)
* update the connectors lists in documentation pages

* add missing connector images
2024-02-28 08:14:11 +00:00
Imri Paran
7036b3cbf7
MINOR: BigTable connector docs (#15145)
* feat(connector): add BigTable

* bigtable work

1. docstrings
2. tests
3. created a Row BaseModel
4. implemented a ClassConverter

* docs moved to separate PR

* format files

* docs(bigtable): added docs

* fix after merge
2024-02-19 08:11:29 +01:00
Mayur Singal
e6c2c36f11
MINOR: Add databricks configuration docs for spark agent (#15182) 2024-02-14 21:16:34 +05:30
Pere Miquel Brull
eb501c1996
MINOR - Breaking change for alerts docs (#15026) 2024-02-05 11:54:59 +01:00
Ayush Shah
6838fadec6
MINOR: Fix Docs ( Security, DBT ) (#14980) 2024-02-01 13:08:48 +05:30
IceS2
373cafcda2
Fixes #5448: Implement initial Iceberg Connector using PyIceberg (#14825)
* Create the iceberg connection schema

* Link the IcebergConnection configuration with the forms on the UI

* Add the pyiceberg dependency on the ingestion package

* Create the get_connection and test_connection functions

* First iteration on the iceberg ingestion logic

* Add A more comprehensive implementation of the Iceberg Source

* Add UnitTests

* Update icebergConnection definition

* Update the iceberg souce code based on new schema

* Updated icebergConnecgtion schema for simplicity and to be able to configure Converters

* Updated setup dependencies to be more flexible

* Updated get_owner_ref logic

* Fix formatting

* Changed the icebergConnection json schema structure to enable the ClassConverters

* Add the IcebergCatalog and IcebergFileSystem ClassConverters

* Refactor the code to take into account the new jsonSchema structure

* Fix formatting

* Add Documentation for the Iceberg Connector

* Fix Menu order for Iceberg

* ui: add Iceberg service icon and constant

* Fix DynamoDb Catalog issue due to how PyIceberg instantes it

* Changed uri title to URI

* Fix ClassConverter for Iceberg

* Fix GetSecretValue for password types

* Fix formatting

* Fix formatting

* Add Iceberg Connector Images for the docs

* Add pylint disable for Hacky super() call

* Add Iceberg.md for the UI docs

* Fix pylint complaint

* Fix pylint complaint

* Fix UnitTests

* fix type error and unit tests

* update pipeline type checks

* Fix Sonar Cloud complaints

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-01-29 06:32:58 +01:00
Shiyang Xiao
9f5a70bd71
MINOR - update docs & added unit test for SAS Connector (#14743)
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
2024-01-23 14:55:29 -08:00
Shilpa Vernekar
d7f4172416
DOCS: Knowledge Center Article and other changes (#14795) 2024-01-19 10:44:05 +00:00
Shiyang Xiao
241f3c68d7
Fixes #14413: Add SAS connector (#14415)
* feat: SAS Viya connector

* refactor SASCatalog to SAS

* add SAS logo to UI and connection documentation

* doc changes

* modify ingestion logic

* revert original changes

* added support for dataflow & perfect logic for reports/datatables

* add filter doc

* more updates to perfect ingestion for each asset type

* fix a bug with table lineage not created properly

* Delete ingestion/pipelines/sasCatalog.yaml

* precomit fix

* Conversion to database connector

* minor fixes

* make custom properties type generic

* Add SAS javaEnum

* add dummy variable for sas.yaml

---------

Co-authored-by: lizmc <liz.mcintosh@sas.com>
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
2024-01-11 06:46:57 -08:00
Sriharsha Chintalapani
182a19f3cc
Add docs on where to get the API token (#14633) 2024-01-09 07:55:40 -08:00
Mayur Singal
2832bbcc8c
Fix #14362: Spark Pipeline Connector & Docs (#14626) 2024-01-09 12:40:43 +05:30
Aniket Katkar
5527336b9c
added images for the new connectors (#14564) 2024-01-03 19:29:12 +05:30
Onkar Ravgan
e4ea06834f
Added redploy docs (#14526) 2023-12-29 10:04:18 +01:00
Aniket Katkar
cbf86e7d4e
added missing connector images (#14397) 2023-12-15 09:27:46 +05:30
Shilpa Vernekar
91899233f9
Docs: Updated v1.3 & changed to How-to Guides (#14380) 2023-12-13 09:28:06 -08:00
Pere Miquel Brull
9d5c3a490f
MINOR - Prepare 1.3 docs directories (#14357) 2023-12-13 18:33:08 +05:30
Shilpa Vernekar
a40b651cc0
Docs: Changes in Admin Guide & How-to Guides home page (#14374) 2023-12-13 18:23:53 +05:30
chyueyi
bfe64e0075
[Docs]- add ui doc for doris connector (#14147) 2023-12-13 18:13:13 +05:30
Shilpa Vernekar
ab1bebba3c
Glossary article updates (#14232) 2023-12-05 05:23:15 +00:00
Mayur Singal
389ae79d3c
#14115: Separate Unity Catalog From Databricks (#14138) 2023-12-04 11:22:46 +05:30
Shilpa Vernekar
39c113ceb2
changes to docs arrangement and new articles (#14193) 2023-12-01 12:11:11 +05:30
Mayur Singal
a8bca817b4
Sample Data Storage & External Profiler Docs (#13960)
* rename title from S3 to Storage config

* Sample Data Storage & External Profiler Docs

* Some changes

* Some changes

* Some changes

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-11-14 08:59:32 +01:00
Akash Jain
0c31dc4641
docs: 1.2.1 Breaking Changes and miscellaneous fixes (#13955)
* Remove Deprecated docs of docker volume

* fix(docs): Update Kubernetes Docs from 1.1.X

* docs: Add 1.2.1 breaking changes

* docs: Update Helm Values

* 1.2.1 docs

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-11-14 07:32:20 +01:00
Sachin Chaurasiya
167c3e8cfe
doc: update the bots doc (#13941) 2023-11-10 14:50:01 +01:00
Sachin Chaurasiya
de74e1a516
doc: update the custom logo docs (#13938)
* doc: update the custom logo docs

* minor fix
2023-11-10 17:59:47 +05:30
Onkar Ravgan
c4d13f4615
Cost Analysis Documentation (#13739)
* cost analysis docs

* fixed typos

* Update openmetadata-docs/content/v1.2.x/features/data-insight/cost-analaysis.md

Co-authored-by: Teddy <teddy.crepineau@gmail.com>

* Update openmetadata-docs/content/v1.2.x/features/data-insight/cost-analaysis.md

Co-authored-by: Teddy <teddy.crepineau@gmail.com>

* Update openmetadata-docs/content/v1.2.x/features/data-insight/cost-analaysis.md

Co-authored-by: Teddy <teddy.crepineau@gmail.com>

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-10-27 14:39:49 +02:00
Pere Miquel Brull
ed138170c0
[Docs] - Release 1.2.0 and upgrades (#13724)
* Align quickstart docs to 1.2

* Upgrade prerequisites

* Version bump

* Release updates

* Release updates

* Release updates
2023-10-26 14:12:36 +02:00
Mayur Singal
e7f3218459
Add greenplum docs & fix couchbase docs (#13722) 2023-10-26 12:34:03 +02:00
Shilpa Vernekar
513b632633
data quality articles (#13621) 2023-10-17 11:56:23 -07:00
Shilpa Vernekar
02a3bc334f
Data insights Docs (#13509)
* Data Insights Docs

* Data Insights Docs
2023-10-10 08:48:50 -07:00
Pere Miquel Brull
f5e10c4a5f
Fix #7272 - BaseWorkflow docs and cleanup (#13471)
* DQ BaseWorkflow

* Test suite runner

* test Suite workflow

* Refactor DQ for BaseWorkflow

* Lint

* Fix source

* Fix source

* Fix source

* Fix source

* Fix test

* Prepare docs

* Clean sink

* Clean legacy classes

* typo

* ProcessorStatus
2023-10-09 07:05:05 +02:00
Shilpa Vernekar
b23ab9fe19
docs-new (#13461) 2023-10-06 14:25:44 -07:00
Shilpa Vernekar
7cfcd56970
lineage-docs (#13472) 2023-10-06 14:25:22 -07:00
Shilpa Vernekar
351c20e23a
Added overview docs to activate the section links (#13353) 2023-09-28 15:13:23 +05:30
Shilpa Vernekar
520f8c34ea
Data Governance Docs (#13231) 2023-09-17 22:24:45 -07:00