680 Commits

Author SHA1 Message Date
Ayush Shah
6838fadec6
MINOR: Fix Docs ( Security, DBT ) (#14980) 2024-02-01 13:08:48 +05:30
Mayur Singal
2b53ff5b46
MINOR: Docs - Lineage Breaking Change (#14967) 2024-01-31 16:40:24 +05:30
Ayush Shah
53d4511c8d
Fix #12461: Azure SSO Docs (#14963) 2024-01-31 13:21:07 +05:30
Aniket Katkar
88c7f99617
fix the menu item url (#14965) 2024-01-31 07:43:17 +01:00
Pere Miquel Brull
ce15728327
MINOR - Docs 1.3 BETA & Slack Alert (#14961)
* MINOR - Docs 1.3 BETA & Slack Alert

* MINOR - Docs 1.3 BETA & Slack Alert
2024-01-31 07:16:22 +01:00
IceS2
373cafcda2
Fixes #5448: Implement initial Iceberg Connector using PyIceberg (#14825)
* Create the iceberg connection schema

* Link the IcebergConnection configuration with the forms on the UI

* Add the pyiceberg dependency on the ingestion package

* Create the get_connection and test_connection functions

* First iteration on the iceberg ingestion logic

* Add A more comprehensive implementation of the Iceberg Source

* Add UnitTests

* Update icebergConnection definition

* Update the iceberg souce code based on new schema

* Updated icebergConnecgtion schema for simplicity and to be able to configure Converters

* Updated setup dependencies to be more flexible

* Updated get_owner_ref logic

* Fix formatting

* Changed the icebergConnection json schema structure to enable the ClassConverters

* Add the IcebergCatalog and IcebergFileSystem ClassConverters

* Refactor the code to take into account the new jsonSchema structure

* Fix formatting

* Add Documentation for the Iceberg Connector

* Fix Menu order for Iceberg

* ui: add Iceberg service icon and constant

* Fix DynamoDb Catalog issue due to how PyIceberg instantes it

* Changed uri title to URI

* Fix ClassConverter for Iceberg

* Fix GetSecretValue for password types

* Fix formatting

* Fix formatting

* Add Iceberg Connector Images for the docs

* Add pylint disable for Hacky super() call

* Add Iceberg.md for the UI docs

* Fix pylint complaint

* Fix pylint complaint

* Fix UnitTests

* fix type error and unit tests

* update pipeline type checks

* Fix Sonar Cloud complaints

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-01-29 06:32:58 +01:00
Teddy
0f80ee2cbc
MINOR - Go client documentation (#14628)
* feat: primitive OpenMetadata Go client

* chore: make command for Go client

* fix: add retry wait logic

* doc: added go documentation

* fix: moved openmetadata-go-client to https://github.com/open-metadata/openmetadata-sdk

* fix: added new line back in Makefile file
2024-01-28 10:28:00 -08:00
NiharDoshi99
c1d62186df
MINOR - metadata tag extraction for Databricks (#14874)
* metadata tag extraction for databaricks

* fix python test

* changes as per comment

* fix python test

* fix python checkstyle
2024-01-26 07:09:24 +01:00
Mayur Singal
59d97357c6
MINOR: Fix hive yaml docs (#14842) 2024-01-25 15:35:33 +05:30
Dhruvin Maniar
951917bf6d
Minor: Docs update for 1.2.5 release (#14863) 2024-01-25 15:02:35 +05:30
Shiyang Xiao
9f5a70bd71
MINOR - update docs & added unit test for SAS Connector (#14743)
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
2024-01-23 14:55:29 -08:00
Mayur Singal
2c068dd876
Minor: Docs add compute metric config in docs (#14798) 2024-01-19 23:02:13 +05:30
Shilpa Vernekar
d7f4172416
DOCS: Knowledge Center Article and other changes (#14795) 2024-01-19 10:44:05 +00:00
Pere Miquel Brull
05038cc99c
MINOR - Add notes on external ingestion docs (#14756)
* MINOR - Add notes on external ingestion docs

* GCS Composer
2024-01-18 11:07:34 +01:00
IceS2
69bf469a76
MINOR - Update Developers documentation to make it easier to follow (#14754)
* chore(docs): Changed the structure of the file to facilitate following it

* fix(docs): Add missing cd command before starting the server from script
2024-01-18 08:50:50 +01:00
Pere Miquel Brull
ddf7a0d30f
MINOR - Run ingestion externally docs (#14751)
* add docs

* MINOR - Run Ingestion Externally docs
2024-01-17 08:21:34 +01:00
NiharDoshi99
c120ae98a4
#14727 change all all_ query to dba_ query (#14748) 2024-01-17 12:38:42 +05:30
Mayur Singal
9694e19599
Minor: Docs - MSSQL Usage & Lineage Requirements (#14746) 2024-01-17 11:41:50 +05:30
Onkar Ravgan
64a4e1afce
Fix 12180, 14158: Added LF tags to Athena (#14718)
* Added LF tags to athena

* fixed pytests

* Added docs
2024-01-16 14:24:31 +05:30
Mayur Singal
d1a1003a9d
Minor: Docs - Backup & Restore Troubleshooting steps (#14710) 2024-01-15 10:11:23 -08:00
Mayur Singal
d6b90ff459
Minor: Added feature table to pipelines & messaging connectors (#14707) 2024-01-15 15:26:11 +05:30
Shilpa Vernekar
7eeaa05279
Docs: Change Glossary Video Link (#14703) 2024-01-12 22:03:55 +05:30
Shiyang Xiao
241f3c68d7
Fixes #14413: Add SAS connector (#14415)
* feat: SAS Viya connector

* refactor SASCatalog to SAS

* add SAS logo to UI and connection documentation

* doc changes

* modify ingestion logic

* revert original changes

* added support for dataflow & perfect logic for reports/datatables

* add filter doc

* more updates to perfect ingestion for each asset type

* fix a bug with table lineage not created properly

* Delete ingestion/pipelines/sasCatalog.yaml

* precomit fix

* Conversion to database connector

* minor fixes

* make custom properties type generic

* Add SAS javaEnum

* add dummy variable for sas.yaml

---------

Co-authored-by: lizmc <liz.mcintosh@sas.com>
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
2024-01-11 06:46:57 -08:00
Mayur Singal
190212c8ac
Fix #11556: Add support for Db2 for IBM i (#14680) 2024-01-11 12:35:52 +05:30
Shilpa Vernekar
befba918d8
Docs: Minor change - Glossary Import Video added (#14675) 2024-01-10 18:58:31 +00:00
Mayur Singal
616e3bd89c
Minor: Fix postgres version on docs (#14642) 2024-01-10 22:53:05 +05:30
Mayur Singal
9288620c29
Minor: Fix Feature Tables of Connectors (#14658) 2024-01-10 12:48:42 +05:30
Sriharsha Chintalapani
182a19f3cc
Add docs on where to get the API token (#14633) 2024-01-09 07:55:40 -08:00
Mohit Yadav
dbd9f1381a
[DOCS] Update Troublesbooting docs for SSL to new env and keys (#14654)
* Update Troublesbooting docs for SSL to new env and keys in openmetadata.yaml

* Update PipelineServiceClientConfig
2024-01-09 07:54:56 -08:00
Mayur Singal
2832bbcc8c
Fix #14362: Spark Pipeline Connector & Docs (#14626) 2024-01-09 12:40:43 +05:30
Onkar Ravgan
2c539f912d
Added alation connector docs (#14614) 2024-01-08 12:28:25 +05:30
Sriharsha Chintalapani
a92fedf544
DB2 connector docs, call out db2 package installation (#14605)
* DB2 connector docs, call out db2 package installation

* DB2 connector docs, call out db2 package installation
2024-01-06 19:25:58 -08:00
Mayur Singal
a789fc86d6
Fix #13053: Remove Connection URI config MongoDB (#14584)
* Fix #13053: Remove Connection URI cofig MongoDB

* pyformat & test fixes
2024-01-05 10:51:12 -08:00
Trs
c8f7fc486f
fix yaml typo (#14588) 2024-01-05 07:03:38 -08:00
Dhruvin Maniar
85091dc94c
docs-update: change release to 1.2.4 (#14596) 2024-01-05 19:38:46 +05:30
Preet Shah
55ddac3259
Update helm-values documentation for v1.2.4 (#14485) 2024-01-05 19:09:26 +05:30
Akash Jain
ec32d9c573
docs: Fix documented API Endpoint url for PublicKeys (#14594) 2024-01-05 17:30:17 +05:30
Dhruvin Maniar
ac39e3e262
Docs: Fixing release version for docker deployment (#14587) 2024-01-05 11:25:38 +05:30
Aniket Katkar
4b1befacaf
added sample content for the api and sdk pages. (#14543) 2024-01-04 21:26:56 +05:30
Shilpa Vernekar
8a1c75b7e9
Docs: Links corrected + Added webinar link (#14579)
* Docs: Link Corrected

* Links changed
2024-01-04 20:08:28 +05:30
Sriharsha Chintalapani
06524b6a1c
Update Roadmap (#14532) 2023-12-30 09:12:12 -08:00
Onkar Ravgan
e4ea06834f
Added redploy docs (#14526) 2023-12-29 10:04:18 +01:00
Shilpa Vernekar
0dfa1e2de1
Broken links corrected (#14489) 2023-12-22 13:32:47 -08:00
Pere Miquel Brull
b786064bc2
#11857 - Store workflow status in the Ingestion Pipeline Status (#14462)
* Register StackTraceError in spec

* Register StackTraceError in spec

* Register StackTraceError in spec

* Add todos

* Update status

* docs

* format

* Fix tests

* Fix tests

* Fix tests

* Ignore generated

* Fix tests

* Fix tests

* Tests

* Try constants

* Try constants

* Print

* Print

* Print

* order

* Fix service name

* fix ui error

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-12-22 15:43:50 +01:00
Akash Jain
3a51f0b7c2
fix: SSL Docs for OPENMETADATA_OPTS (#14465)
* fix: SSL Docs for `OPENMETADATA_OPTS`

* fix(docs): update the files in 1.3.0 docs section as well
2023-12-21 10:42:06 +05:30
Ayush Shah
c3fac5e97e
Fix Adls connection typo (#14449) 2023-12-20 14:25:54 +01:00
NiharDoshi99
492092720d
#12908 support for table owner in postgres (#14289)
* support pick up postgres table owner

* added owner wrapper

* optimize the code

* remove pylint error

* minor fix

* changes as per comments

* fix python checksytyle and comments

* moved process owner to database service

* update docs for version 1.3

---------

Co-authored-by: Vanshika Kabra <vanshikakabra@Vanshikas-MacBook-Pro.local>
2023-12-20 18:42:59 +05:30
Shilpa Vernekar
1dc79bfd3c
Docs: Links corrected (#14459) 2023-12-20 18:20:33 +05:30
Onkar Ravgan
7d032977d7
Fix 14084: Removed Airflow Mssql backend connection (#14420)
* Removed Airflow Mssql backend conn

* added breaking changes docs
2023-12-20 12:28:28 +05:30
Shilpa Vernekar
cce059d98f
Docs: Link Corrected (#14452) 2023-12-20 06:14:43 +00:00