* Add logic to initialize relationships from seed data during application startup
* Remove ingestion related code for access control policies
* Move PolicyEvaluator init to PolicyResource
* Fix#1994: Add support for marking dataset entities as deleted
* Fix#1994: Add support for marking dataset entities as deleted
* Fix#1994: Add support for marking dataset entities as deleted
- Support Delete Action for S3
- Add Example s3.json
- Create AWSClient util
- Use AWSClient util in S3 ingestion source
- Remove ambiguity in policy filters by removing array with different types
Implementation details
I have decided to rename schema_name to database and make it mandatory. Without database there is an error while scanning all available tables. The connector doesn't support multiple databases at the moment. It has to be tested with passwords. Trino requires SSL if you use passwords. It has to be tested with impersonation. I have removed quote_plus because I don't think it's needed.
- [x] Support username
- [ ] There is an integration test
- [ ] Support impersonation
- [ ] Support passwords
- [ ] Support tokens
- [ ] Support multiple databases
* Prepare infra
* Store experiment information in MySQL & MinIO
* Use CreateMlModelEntityRequest instead of MlModel for PUT operations
* Update MlFlow infra
* Prepare MlFlow source
* Prepare Mlflow workflow
* Simplify test and prepare README
* Revert compose
* Fix compose
* Prepare warnings and fix features
* Use non-default port for integration test
* Use mlflow-skinny for the client application
* Fix#1665: Oracle connector add an option to configure oracle service name
* Fixed removal of semi colon
Fixes SQL Command Warning while ingesting
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
* Fix#1658: Ingestion changes to add dbtModel as part of Table entity
* Fixes#1652 Remove DBTModel as top level entity and capture information from DBT in existing Table entity
Co-authored-by: sureshms <suresh@getcollate.io>
- Glue works with columns containing dots.
- Glue works with temporary credentials.
- Fix bug in TableRepository, the EntityType was database instead of table.
- only region_name is mandatory in Glue config.
- first integration test for Glue. The CI integration with AWS is still missing.
* issue-696: Added trino support for Openmetadata
* issue-696: fixed linting issues
* issue-696: not mentioning Trino for now as it will be part of 0.5 release
Co-authored-by: jbuoncri <jbuoncri@cisco.com>
* 1M entities to test scalability
* 1M entities to test scalability
* 1M entities test
* column name modification
* Fix service add and tags
* Add sample entity generation
Co-authored-by: parthp2107 <parth@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* Removed serviceType as a configuration option from workflow configs
* Removed serviceType as a configuration option from workflow configs
Co-authored-by: parthp2107 <parth.panchal@deuexsoultions.com>
