1088 Commits

Author SHA1 Message Date
Mayur Singal
76e36e812d
0.9 to 0.10 Metadata Migration Script (#4572)
0.9 to 0.10 Metadata Migration Script (#4572)
2022-05-10 09:33:27 +02:00
Sriharsha Chintalapani
a774a67ffa
Fix #4812: UserResources patch operation resetting inheritedRoles and AuthenticationMechanism (#4814) 2022-05-09 23:59:04 -07:00
Pere Miquel Brull
6fdd1c4691
Fix #4780 & #4739 - ConnectionArguments with inner dict (#4798) 2022-05-09 11:28:47 -07:00
Pere Miquel Brull
1b003f9e79
Update account description (#4809) 2022-05-09 18:27:05 +02:00
Ayush Shah
a4212ec356
Revamp Snowflake (#4653)
Revamp Snowflake (#4653)
2022-05-09 15:54:36 +02:00
Sriharsha Chintalapani
34858f3b32
Topics: Add Sample data (#4787)
* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data
2022-05-09 12:50:54 +02:00
Mayur Singal
fd521763d4
Fix #4590: Usage through query log file (#4719)
* Usage through query log file

* Pick fileds if available in file

* Created Usage Souce
2022-05-09 11:37:52 +02:00
Pere Miquel Brull
04421901c0
[WIP] Fix #4610 - Pipeline Tasks removal (#4615)
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-05-07 21:10:35 -07:00
Pere Miquel Brull
5700f6d68e
Fix #4768 - Add Location path (#4770)
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-05-07 21:10:13 -07:00
Vivek Ratnavel Subramanian
ae51a49ce1
Fix #4746. UI: Connection Arguments and Connection Options should support inner dicts (#4779) 2022-05-07 14:51:40 -07:00
Pere Miquel Brull
a22ff4627f
Fix #4728 - Fix Kafka test connection (#4730)
* Fix Kafka connection

* Update defaults and required values

* Update test connection

* Add filter tests

* Fix kafka tests
2022-05-06 08:59:05 +02:00
Sriharsha Chintalapani
ebf329dd7e
Fix Allowed Fields (#4756) 2022-05-06 07:56:26 +02:00
codingwithabhi
ee1dda5366
postgres-selecting-multiple-databases-per-service (#4736) 2022-05-06 06:31:07 +02:00
Suresh Srinivas
e6abd86797
Fixes #4749 Add all the required APIs for Bot entity along with tests (#4750) 2022-05-05 15:09:06 -07:00
Suresh Srinivas
9138b85913
Fixes #4720 Upgrade dependency version of OpenMetadata for 0.10.1 (#4721) 2022-05-05 14:11:45 -07:00
Sriharsha Chintalapani
b0a744507f
Fix #4739: Connection Arguments with inner dicts (#4742) 2022-05-05 09:54:44 -07:00
Sriharsha Chintalapani
4531190af6
Fix #4637: Support JWT Token generation for bot accounts (#4647)
* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts
2022-05-05 15:32:33 +05:30
Vivek Ratnavel Subramanian
1c68748618
Fix #4542. Tables with a slash (/) in their name aren't appearing (#4717) 2022-05-04 23:30:39 -07:00
Onkar Ravgan
6f97b25175
Added prefix while parsing bucket objects (#4665)
* Added prefix to s3 bucket objects

* Added support for prefixes in gcs and s3 for DBT

* implented review comments

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-05-05 10:49:10 +05:30
codingwithabhi
4aa5fbce04
tableau-test-connection-added (#4673)
* tableau-test-connection-added

* tableau-test-connection-fixed

* test-connection-optimised

* test-connection-optimised
2022-05-05 06:47:08 +02:00
codingwithabhi
fb03a324ce
mssql-usage-added-on-ui (#4635) 2022-05-04 22:31:35 +05:30
Sriharsha Chintalapani
a5f7a69a2d
Fix #4675: Ingestion deployment from UI is broken (#4676) 2022-05-03 22:10:01 -07:00
Ayush Shah
5cf9799578
Modify redshift schema (#4624) 2022-05-03 16:27:07 +05:30
Suresh Srinivas
f8d4eb6f25
Fixes #4638 - Separate assigned roles and inherited roles for user entity (#4639) 2022-05-02 19:10:16 -07:00
Pere Miquel Brull
f442764036
Check task properly removed (#4619) 2022-05-02 15:09:54 -07:00
Suresh Srinivas
05eb0e60f9
Fixes 4628 - Delete airflow ingestion pipeline when the database service corresponding to it is hard deleted (#4631) 2022-05-02 10:27:55 -07:00
Pere Miquel Brull
3f8f1d1c05
Fix #4589 - Check Airflow REST status; Fix #4525 - Clean REST deps (#4606)
* Add rest status

* Check REST status

* Clean REST deps
2022-05-02 12:27:20 +02:00
Sriharsha Chintalapani
dd27da2121
Fix #4597: Log audit events into a separate log file (#4598)
* Fix #4597: Log audit events into a separate log file

* Fix #4597: Log audit events into a separate log file
2022-04-29 11:06:46 -07:00
Pere Miquel Brull
34b90de388
Remove default logger from ingestionpipeline (#4584)
* Remove default logger from ingestionpipeline

* Format
2022-04-29 09:40:05 +02:00
Suresh Srinivas
f0139c3ea5
Make bootstrap sql files for mysql and postgres consistent with each other (#4541)
* Make mysql bootstrap file consistent with postgres

* Adding a java code change to trigger all the precommit checks

* Set test container reuse flag to true

* Make Postgres bootstrap files consistent with MySQL

* Test pagination using random jump of limit between 1-5 instead of 1 to reduce test time

* Starting the test container outside @BeforeAll in a static block for container reuse

* Comment printing out list output in pagination tests

* Move starting the test container to @BeforeAll setup method instead of static initialization

* Remove unnecessary tests in PolicyResourceTest to speed up tests

* Add test container reuse for github workflows

* Add test container reuse for github workflows

* Add test container reuse for github workflows

* Change timeouts for the TestContainer

* Add test container reuse for github workflows

* Add test container reuse for github workflows (#4563)

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2022-04-28 07:30:56 -07:00
Pere Miquel Brull
a7328ccf1b
Fix #4491 - PipelineIngestion to support debug (#4564) 2022-04-28 15:50:03 +05:30
mosiac1
c6e8181fa9
Add postgres support (#3952)
* Add postgres support

* Add testing for postgresql databases

Split surefire tests into: unit-tests, postgres-integration-tests, mysql-integration-tests
Integration tests get db information from system properties
All tests ending in ResourceTests.java are integration tests, all other are unit tests
Move to using testscointainers, remove embeded mysql

* Fix some tests

* Fix webhook and table tests

* Fix random name generation in tests, remove parallelism

* Fix style

* Add headers, fix config files

* Apply formatting

* Fix tag ussage query for postgres

* Replace references to mysql with generic database

* Fix postgres migration file

* Fix postgres migration script
2022-04-27 10:58:44 -07:00
Suresh Srinivas
5ccd8ddbbf
Fixes #4478 PUT method for /api/v1/users gives 409 (#4539) 2022-04-27 10:22:06 -07:00
Sriharsha Chintalapani
55c91b2a27
Fix #4509: Ingestion Pipeline changes are not getting stored (#4510) 2022-04-27 00:00:19 -07:00
Suresh Srinivas
bb772d4140
Fixes #4503 - GET lineage by ID returns no nodes (#4506) 2022-04-26 12:54:00 -07:00
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505)
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
2022-04-27 00:41:17 +05:30
Pere Miquel Brull
b863d91360
Fix trino params for UI (#4498) 2022-04-26 14:13:03 +02:00
Onkar Ravgan
148d7f47ec
Refactor DBT for schema changes (#4497)
Refactor DBT for schema changes (#4497)
2022-04-26 14:10:47 +02:00
codingwithabhi
897e4ff765
snowflake-private-key-fix-via-ui (#4492)
* snowflake-private-key-fix-via-ui

* removed-overriding-test-connection

* code-formatted
2022-04-26 17:10:10 +05:30
Sriharsha Chintalapani
81f8be0b58
Fix #4493: ElasticSearch publisher goes into pause mode if a document missing exception thrown (#4494) 2022-04-25 23:47:58 -07:00
Mayur Singal
355e6dc6b0
Fixed Druid Source Connector (#4476) 2022-04-25 06:46:35 -07:00
Ayush Shah
8fe1c79913
Implemented Json Logger (#4475) 2022-04-25 18:23:19 +05:30
Pere Miquel Brull
bd150d8124
Fix #4457 - BigQuery requirements to handle keys (#4464)
* Add defaults

* Add crypto req for bigquery

* Crypto is in base
2022-04-25 11:54:45 +02:00
Onkar Ravgan
12b5bda2fb
schema changes for dbt (#4462)
schema changes for dbt (#4462)
2022-04-25 10:44:05 +02:00
Sriharsha Chintalapani
b7e1f4db5a
Fix #2684: Pipeline without tasks breaks ES updates (#4454) 2022-04-24 23:42:11 -07:00
Vivek Ratnavel Subramanian
e82cd76e1c
UI: Fix miscellaneous UI issues (#4451) 2022-04-24 17:53:46 -07:00
Sriharsha Chintalapani
feafa448e6
Fix #4446: Fix Glossary Deletion to update ES Index (#4447) 2022-04-24 12:09:12 -07:00
Suresh Srinivas
9c09aeef41
Minor changes to API docs - fix grouping of delete policy and consistent documentation (#4442) 2022-04-24 09:42:22 -07:00
Sriharsha Chintalapani
c3bbeb9e93
Fix Ingestion ElasticSearch indexing (#4435) 2022-04-24 00:18:06 -07:00
Vivek Ratnavel Subramanian
2a51148eee
Fix #4312: team instance for <TEAM_ID> not found (#4431) 2022-04-23 22:03:54 -07:00