95 Commits

Author SHA1 Message Date
Suresh Srinivas
9d25596227
Fixes #5122 Add backend and API support for column-level lineage (#5123)
* Fixes #5122 Add backend and API support for column-level lineage

* amend

* Fix test failures
2022-05-24 16:00:12 -07:00
Ayush Shah
8511f9f0b2
fix core_generate / validate pipeline (#5048) 2022-05-20 09:53:31 +05:30
darth-coder00
9fc612e013
Optimising generation of typescripts from schema and as prebuild script (#5037)
* Adding json2ts as prebuild script

* Add generated TS to gitignore

* Fixing CI errors

* Fix Sonar CI

* Bumping metadata version

* Fixing sonar CI

* Fix json2ts script

* Revert gitignore

* prettify

* Fix CI build failures

* Removing unnecessary changes

* Add pre-script for coverage
2022-05-19 21:23:39 +05:30
Suresh Srinivas
5b57db3e55
Fixes #5010 Entity extension - Add support for storing JSON schema compliant extended fields in entities (#5011) 2022-05-18 09:52:27 -07:00
Ayush Shah
93c32ad801
Removed Ingestion Core dependency (#5006) 2022-05-18 00:01:20 +05:30
Ayush Shah
a74047c8a0
Modified workflows and ingestion-core package (#5005) 2022-05-17 21:46:49 +05:30
darth-coder00
b2e517f846
Fix: invalid schema and removed typescript references (#4979) 2022-05-17 15:11:44 +05:30
Suresh Srinivas
399e44e8d3
Fixes #4957 Use jsonschema2pojo JavaInterfaces functionality to remove manual implementation of EntityInterface (#4958) 2022-05-15 11:10:26 -07:00
Suresh Srinivas
6ce528d70a
Fixes #4921 Add support for type system (#4922) 2022-05-14 10:57:19 -07:00
Sriharsha Chintalapani
a774a67ffa
Fix #4812: UserResources patch operation resetting inheritedRoles and AuthenticationMechanism (#4814) 2022-05-09 23:59:04 -07:00
Sriharsha Chintalapani
34858f3b32
Topics: Add Sample data (#4787)
* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data
2022-05-09 12:50:54 +02:00
Sriharsha Chintalapani
4531190af6
Fix #4637: Support JWT Token generation for bot accounts (#4647)
* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts
2022-05-05 15:32:33 +05:30
codingwithabhi
fb03a324ce
mssql-usage-added-on-ui (#4635) 2022-05-04 22:31:35 +05:30
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505)
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
2022-04-27 00:41:17 +05:30
codingwithabhi
897e4ff765
snowflake-private-key-fix-via-ui (#4492)
* snowflake-private-key-fix-via-ui

* removed-overriding-test-connection

* code-formatted
2022-04-26 17:10:10 +05:30
codingwithabhi
c09dc3bff7
athena-source-connection-fixed (#4278)
* athena-source-connection-fixed

* ran-core_bump_version_dev

* aws-cred-json-schema-support-added-in-athena

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-04-21 16:07:29 +02:00
Suresh Srinivas
14fce51749
Fixes #4255 Move associated tags functionality from Tags to GlossaryT… (#4256) 2022-04-19 15:29:28 -07:00
Akash Jain
540f5ca3b5
Fix: Prepare 0.10.0 snapshot (#4190)
* update pom versions to 0.10.0-SNAPSHOT

* fix version to latest release 0.9.1

* fix ingestion core version to 0.10.0
2022-04-19 17:40:42 +05:30
codingwithabhi
8115c2ece4
issue-4135: updated-mysql-connection-json (#4136) 2022-04-14 14:16:09 -07:00
Suresh Srinivas
339968c71e
Issue4113 (#4114) 2022-04-13 19:51:04 -07:00
Sriharsha Chintalapani
be836e5404
Fix #4071: PUT IngestionPipeline missing property & error message (#4085)
Fix #4071: PUT IngestionPipeline missing property & error message (#4085)
2022-04-13 08:40:21 +02:00
Sriharsha Chintalapani
966cedd17f Fix #4042: Ingestion: Sample data ingestion is failing 2022-04-11 16:23:00 -07:00
Sriharsha Chintalapani
2e870669e3 Fix #4042: Ingestion: Sample data ingestion is failing 2022-04-11 16:12:01 -07:00
Sriharsha Chintalapani
bd4bcaf876 Fix #4044: Service connection supportedPipelineType to be a common type 2022-04-11 14:22:58 -07:00
Sriharsha Chintalapani
8067103a1d Fix #4044: Service connection supportedPipelineType to be a common type 2022-04-11 14:22:30 -07:00
Sriharsha Chintalapani
5f47b66742 Fix #4044: Service connection supportedPipelineType to be a common type 2022-04-11 14:22:30 -07:00
codingwithabhi
01336853ef
Snowflake private key fix (#4031)
* snowflake-private-key-fixed

* ran-core_bump_version_dev
2022-04-11 19:27:50 +05:30
Sriharsha Chintalapani
afd7d1b9a7 Fix #3721: Typo in table.json schema 2022-04-10 17:04:12 -07:00
codingwithabhi
c6bd06944b
glue-connector-fixed (#3980)
* glue-connector-fixed

* code-formatted

* ran-make-core_bump_version_dev

* config-stored-in-variable
2022-04-09 18:28:53 +05:30
codingwithabhi
a92dff15e6
multiple-database-support-added (#3777)
* multiple-database-support-added

* FQDN_SEPARATOR-added

* code-formatted

* code-formatted
2022-04-09 15:11:11 +05:30
codingwithabhi
0e0c3459a8
postgres-connector-fixed (#3970) 2022-04-08 13:28:00 -07:00
codingwithabhi
bb76a2f11b
salesforce-connector-fixed (#3923)
* salesforce-connector-fixed

* salesforce-connection-updated

* ran-make-core_bump_version_dev

* code-formatted

* removed-get_connection_url

* code-formatted

* code-formatted

* code-formatted
2022-04-08 16:08:31 +05:30
codingwithabhi
300e8fec55
snowflake-connector-fix (#3885)
* snowflake-connector-fixed

* schema-filter-fixed

* updated-connection_arguments

* ran-py_format

* removed-FQN-computation

* ran-make-core_bump_version_dev-and-py_format

* ranpy_format
2022-04-08 13:28:54 +05:30
Mayur Singal
3651efd7f5
Databricks Source Fix (#3917)
Databricks Source Fix (#3917)
2022-04-07 16:40:50 +02:00
Mayur Singal
b709a8055e
Fixed MSSQL Source (#3877)
Fixed MSSQL Source (#3877)
2022-04-06 14:21:46 +02:00
codingwithabhi
dbfe488a9e
Schema support fix (#3856)
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-04-05 10:51:42 -07:00
Sriharsha Chintalapani
7b3e459eb3
Fix #3659 Refactor Service Connection String to be specific to per service (#3804)
* Fix #3659 Refactor Service Connection String to be specific to per service

* Simplify and centralize Airflow Pipeline info for REST (#3740)

* Remove code

* Modified Configs based on refactoring schema (#3816)

* Clean WorkflowContext


Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-04-04 12:46:09 -07:00
Sriharsha Chintalapani
f79b251509
Fix #3771: Main branch schemas and ingestion is failing; Fix #2992: Remove ChangeEvents log from ElasticSearch Indexes (#3772) 2022-03-30 18:26:57 -07:00
Pere Miquel Brull
e830f1787f
Fix #3726 - Remove mlmodel custom defs (#3728) 2022-03-29 10:01:36 +02:00
Suresh Srinivas
de6fb11927
Fixes #3653 - Variable based separator used for fullyQualifiedName instead of hardcoded "." (#3674)
* Use common entityName and fullyQualifiedEntityName type definition with DOT allowed

* Make EntityInterface abstract class and move building entity reference to the base class

* Entity separator is not longer hardcoded but uses a variable
2022-03-25 14:48:20 -07:00
Ayush Shah
07266b58f7
Fix: Added DeltaLake Service type (#3639)
* fix-deltalake

* added deltalake.json

* Bumped up version
2022-03-24 18:42:00 +05:30
Sriharsha Chintalapani
50ee11e6ca
Issue-3577: Add partitioning details to Table Entity (#3579) 2022-03-22 18:37:56 -07:00
Pere Miquel Brull
dfd6286cb4
Fix #3463 - Prepare Custom Metric definition (#3467)
Fix #3463 - Prepare Custom Metric definition (#3467)
2022-03-22 15:29:41 +01:00
Suresh Srinivas
eb74487985
Issue3536 (#3537) 2022-03-20 18:01:51 -07:00
Sriharsha Chintalapani
0b30c9f08d
Fix #3056: Introduce team owner and let them manage their own team; Fix #3516: Authorizer should expect an owner field to be populated before granting permissions. (#3517) 2022-03-18 18:33:24 -07:00
Pere Miquel Brull
16e82d45de
Fix #3371 - Run Profiler and Tests on a % of the data (#3424)
Fix #3371 - Run Profiler and Tests on a % of the data (#3424)
2022-03-16 06:05:59 +01:00
Ayush Shah
7c84f063e6
Minor Fixes - Ingestion - Datetime format, Looker fix (#3365)
* Minor Fixes - UTC timezone for usage, tag method modification, looker fix

* Modified core version

* Snowflake Usage Result limit and Makefile ignore env fix
2022-03-11 13:31:42 +05:30
Pere Miquel Brull
f0dd85b9f7
Fix #3356 - Vertica concat and len (#3358) 2022-03-10 08:01:47 -08:00
parthp2107
794cf64787
updated schema docs (#3329)
* updated schema docs

* addressing ingestion-core version bump
2022-03-10 12:55:35 +05:30
Sriharsha Chintalapani
65c4030fb1
Issue-3291: Fix upgrade from 0.8.4 to 0.9.0 (#3292)
* Issue-3291: Fix upgrade from 0.8.4 to 0.9.0
2022-03-08 23:07:24 -08:00