Implementation details
I have decided to rename schema_name to database and make it mandatory. Without database there is an error while scanning all available tables. The connector doesn't support multiple databases at the moment. It has to be tested with passwords. Trino requires SSL if you use passwords. It has to be tested with impersonation. I have removed quote_plus because I don't think it's needed.
- [x] Support username
- [ ] There is an integration test
- [ ] Support impersonation
- [ ] Support passwords
- [ ] Support tokens
- [ ] Support multiple databases
* Prepare infra
* Store experiment information in MySQL & MinIO
* Use CreateMlModelEntityRequest instead of MlModel for PUT operations
* Update MlFlow infra
* Prepare MlFlow source
* Prepare Mlflow workflow
* Simplify test and prepare README
* Revert compose
* Fix compose
* Prepare warnings and fix features
* Use non-default port for integration test
* Use mlflow-skinny for the client application
- Glue works with columns containing dots.
- Glue works with temporary credentials.
- Fix bug in TableRepository, the EntityType was database instead of table.
- only region_name is mandatory in Glue config.
- first integration test for Glue. The CI integration with AWS is still missing.
* migrated all usages of models.MetadataUser & models.User classes to generated.schema.teams.user.User classes instead.
* formatted file with black
Co-authored-by: omri.alon <omri.alon@myheritage.com>
* Update ML model naming for generated python src
* Update MlModel id and title
* Update MlModel descriptions
* Generate pydantic models
* Update OpenMetadata with new MlModel naming
* Update MlModel naming
* Update MlModel naming
* Update MlModel namings for backend sources
* fixed issue with not being able to load config file; cleaned up unused code
* fixed test case to test configuration error
Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
* fixed bug that was setting to lowercase property names that were already in camelCase
* added datetime prefix to allow integration tests to be run repeatedly
* fixed test to use the ldap entries from ldap service in docker to test the service
* updated instructions for ldap test
* added comments to clarify the fix done in snake_to_camel method
Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
* ISSUE-960: fixed test cases and updated documented with list of pip install
* using requests package for testing http port responsiveness and socket for non-http ports
* use healthcheck api instead of just service endpoint
Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
* Rename docstring
* Fix typo
* Prepare linage API
* Centralise GET API
* Fix delete test by FQDN
* Add hints
* Add lineage tests
* Migrate lineage ops to OpenMetadata API
* update arg name for fqdn
* fix suite setup and teardown
* Update list logic
* Add Chart tests
* Add Dashboard tests
* Add pipeline tests
* Add table tests
* Simplify create API
* Formatting tests
* Update create API
* Add Tasks and Topics tests
* Rename OpenMetadata
* Add client close
* Use Optional for GET id and name
* Fix#931 fetching dashboards using client
* Add tests
* Fix sample users ingestion
* Remove lineage test
* Rename services for independence
* Issue 898 (#905)
* ISSUE-898: additional information in the prerequisities for building and running code
* ISSUE-898: removed unreachable old doc
* ISSUE-898: added new docker compose to expose MySQL and ES ports to host machines
* ISSUE-898: changed jdbc connect url to allow Public Key Retrieval
* ISSUE-898: fixed log name to openmetadata.log
Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
* Fixes#906 Remove unused methods lingering from #899
* Update pull_request_template.md
* Update pull_request_template.md
* ISSUE-861: add elasticsearch username & password (#894)
* ISSUE-861: add elasticsearch username & password
* ISSUE-861: python elasticsearch sink add username & password
* ISSUE-861: bugfix
* format code
* format code
* updated instructions to run integration tests
* fixed api call to metadata server; changed test to cover both database as well as table operations everytime
Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
Co-authored-by: sureshms <suresh@getcollate.io>
Co-authored-by: Suresh Srinivas <srini30005@gmail.com>
Co-authored-by: rong fengliang <1141591465@qq.com>
* For hive's complex data types parse raw type
* Complex Data type logic modification
* Complex Data Type parsing implemented
* Raw Data type helper modification
* handling unnamed/anonymous struct
* Complex Nested structure implementation
* print statements removed and reverted to raw_data_type
* Complex Structure Array & MAP logic implemented
* Raw Data Type Logic revamped
* Redshift Integration
* MAP and UnionType support added
* Redshift Pypi package updated
* dataLength validationError fix
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* added unit tests to helper and workflow classes in ingestion
* Addressing comments
* Adressing comments
* Adressing comments
* Failing Unit tests fixed
* Workflow test and config file modified
Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
