IceS2 373cafcda2
Fixes #5448: Implement initial Iceberg Connector using PyIceberg (#14825)
* Create the iceberg connection schema

* Link the IcebergConnection configuration with the forms on the UI

* Add the pyiceberg dependency on the ingestion package

* Create the get_connection and test_connection functions

* First iteration on the iceberg ingestion logic

* Add A more comprehensive implementation of the Iceberg Source

* Add UnitTests

* Update icebergConnection definition

* Update the iceberg souce code based on new schema

* Updated icebergConnecgtion schema for simplicity and to be able to configure Converters

* Updated setup dependencies to be more flexible

* Updated get_owner_ref logic

* Fix formatting

* Changed the icebergConnection json schema structure to enable the ClassConverters

* Add the IcebergCatalog and IcebergFileSystem ClassConverters

* Refactor the code to take into account the new jsonSchema structure

* Fix formatting

* Add Documentation for the Iceberg Connector

* Fix Menu order for Iceberg

* ui: add Iceberg service icon and constant

* Fix DynamoDb Catalog issue due to how PyIceberg instantes it

* Changed uri title to URI

* Fix ClassConverter for Iceberg

* Fix GetSecretValue for password types

* Fix formatting

* Fix formatting

* Add Iceberg Connector Images for the docs

* Add pylint disable for Hacky super() call

* Add Iceberg.md for the UI docs

* Fix pylint complaint

* Fix pylint complaint

* Fix UnitTests

* fix type error and unit tests

* update pipeline type checks

* Fix Sonar Cloud complaints

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-01-29 06:32:58 +01:00

42 lines
1.6 KiB
Markdown

---
title: Database Services
slug: /connectors/database
---
# Database Services
This is the supported list of connectors for Database Services:
- [Athena](/connectors/database/athena)
- [AzureSQL](/connectors/database/azuresql)
- [BigQuery](/connectors/database/bigquery)
- [Clickhouse](/connectors/database/clickhouse)
- [Databricks](/connectors/database/databricks)
- [Datalake](/connectors/database/datalake)
- [DB2](/connectors/database/db2)
- [DeltaLake](/connectors/database/deltalake)
- [Domo Database](/connectors/database/domo-database)
- [Druid](/connectors/database/druid)
- [DynamoDB](/connectors/database/dynamodb)
- [Glue](/connectors/database/glue)
- [Greenplum](/connectors/database/greenplum)
- [Hive](/connectors/database/hive)
- [Iceberg](/connectors/database/iceberg)
- [MariaDB](/connectors/database/mariadb)
- [MSSQL](/connectors/database/mssql)
- [MySQL](/connectors/database/mysql)
- [Oracle](/connectors/database/oracle)
- [Postgres](/connectors/database/postgres)
- [Presto](/connectors/database/presto)
- [Redshift](/connectors/database/redshift)
- [Salesforce](/connectors/database/salesforce)
- [SAS](/connectors/database/sas)
- [SingleStore](/connectors/database/singlestore)
- [Snowflake](/connectors/database/snowflake)
- [Trino](/connectors/database/trino)
- [Unity Catalog](/connectors/database/unity-catalog)
- [Vertica](/connectors/database/vertica)
If you have a request for a new connector, don't hesitate to reach out in [Slack](https://slack.open-metadata.org/) or
open a [feature request](https://github.com/open-metadata/OpenMetadata/issues/new/choose) in our GitHub repo.