5395 Commits

Author SHA1 Message Date
parthp2107
a784bc217d
added periods to json schema descriptions (#2334) 2022-01-22 22:25:15 -08:00
Sriharsha Chintalapani
e5fdf77d8e
Fix #2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353: Add API to AirflowPipelines filter based on service (#2357)
* Fix #2340: Ingestion pipeline deployment refactor - update ingestion

* Fix #2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353: Add API to AirflowPipelines filter based on service

* Fix #2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353: Add API to AirflowPipelines filter based on service
2022-01-22 21:12:25 -08:00
darth-coder00
73a657ef3f
UI service revamp (#2350)
* Added UI changes to support service with ingestion

* Added new interfaces from schema

* Integration of new databaseService and airflowPipeline APIs
2022-01-23 03:12:50 +05:30
Pere Miquel Brull
1eb3f1ad41
[issue-2322] - Backup CLI (#2349)
* Prepare cli module

* Check call

* Prepare backup

* Run pytest on schema changes

* Remove traces

* Add backup plugin

* run generate during CI

* Install after generate

* Address logger hotspot
2022-01-22 12:08:14 -08:00
ulixius9
8fca53ec52
ISSUE-2048: Bigquery data profiler uses schema name instead of project id (#2335)
* ISSUE-2048: Bigquery data profiler uses schema name instead of project id

* Update bigquery.py

* Update bigquery.py

* Update profiler_runner.py

* Update profiler.py

Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-01-22 23:33:15 +05:30
Sriharsha Chintalapani
f390bac375
Fix 2270: Column Type Parser (#2271)
* Fix 2270: Column Type Parser

* Fix 2270: Column Type Parser

* Added checks to allow arrayDataType and dataTypeDisplay

* Modified - arrayDataType and dataTypeDisplay

* Update sql_source.py

* Update sql_source.py

* file formatted

* Modified according to column_type_parser.py

* modified / refactored / deleted the files

* Added Tests, modified sql_source

* file formatted

* Added missing datatypes

* Added Tests

* Added Tests

* Added Tests - refactored expected output into a json file

* file formatted

* Sample Data Updated

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-01-22 23:32:58 +05:30
darth-coder00
e2602b81fb
Deleted dataset UI support (#2333)
* Deleted dataset UI support

* Added API integration to get deleted tables

* Added deleted badge on search results

* Addressing comments

* Addressing comment

* Restrict Versions button for deleted entities
2022-01-22 22:43:39 +05:30
Sachin Chaurasiya
590a0ab624
UI: Adding Policy UI. (#2259)
* [WIP]UI: Adding Policy UI.

* Integrating API to get Roles and Policy.

* Adding API integration to create and update role

* Adding form for Rule

* changing types

* removing suggested rules

* Changing rule form modal layout.

* Adding support for adding rules

* Adding support for deleting rule

* Adding support for editing rules

* Adding validation for rules

* Adding isAdminOnly check for roles page

* Adding license to new file

* Minor Fix

* replacing break-all with break-words class.

* Addressing review comments
2022-01-22 20:46:45 +05:30
Pere Miquel Brull
6693b4ae40
[issue-2262] - Simplify sample data DAG (#2337)
* Simplify sample data DAG

* Remove mkdir

* Generate sources before running compose

* Generate sources to install models to ingestion image

* Add python-on-whales for docker --start

* Remove python-on-whales from base

* Install venv

* Setup python
2022-01-22 16:37:56 +05:30
Matt
8e5a9c1f0e
Set Access Control Rule default priority to 25000 (#2346) 2022-01-22 02:14:56 -08:00
Matt
319fde9207
Throw error if multiple rules within policy have same operation (#2344) 2022-01-22 01:09:51 -08:00
Sriharsha Chintalapani
10e71a7e09
Fix #2340: Ingestion pipeline deployment refactor (#2341)
* Fix #2340: Ingestion pipeline deployment refactor
2022-01-21 22:06:14 -08:00
Sachin Chaurasiya
69e7096650
Adding some Misc UI Changes (#2327) 2022-01-22 10:24:03 +05:30
Matt
2d44e11f8a
Update py-ingestion-core version control and publish workflows (#2330) 2022-01-21 08:58:24 -08:00
parthp2107
91767ee4cf
added tests for tags and description (#2332) 2022-01-21 21:37:25 +05:30
darth-coder00
9da9266c3a
Scrollable description (#2266)
* Scrollable description

* Scroll enhancement
2022-01-21 18:00:39 +05:30
codingwithabhi
ddf4ae261b
Bigquery credential configuration updated (#2041)
* bigquery-credentials-in-bigquery-json

* ui-changes-reverted

* credentials-moved-to-options

* Update bigquery.json

* Update bigquery.py

* delete-temp-code-added

* delete-temp-code-added

* removed-init-from-config

* Update datatypes_test.py

* Update column_helpers.py

* code-formatted

Co-authored-by: Abhishek <abhishek@Abhisheks-MacBook-Air.local>
Co-authored-by: = <=>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-01-21 17:23:02 +05:30
Sachin Chaurasiya
cd65037ac7
Fix: Fixing #2306 Links in team description is considered as a page. (#2329)
* Fix: Fixing #2306 Links in team description is considered as a page.

* Adding isValidURl util

* Checking falsy condition first
2022-01-21 14:06:17 +05:30
Matt
845b62d48d
Add Access Control Policy for DataConsumer role (#2328) 2022-01-21 00:26:06 -08:00
Matt
2a80caa8fe
Add logic to initialize relationships from seed data during application startup (#2307)
* Add logic to initialize relationships from seed data during application startup

* Remove ingestion related code for access control policies

* Move PolicyEvaluator init to PolicyResource
2022-01-20 22:18:03 -08:00
Pere Miquel Brull
979bad18d9
Update python checkstyle (#2315) 2022-01-20 16:18:18 -08:00
Sriharsha Chintalapani
7312aff270 Fix #2320: Fix DB migration scripts to upgrade to 0.8 from 0.7 2022-01-20 15:08:03 -08:00
Sriharsha Chintalapani
18f5c288fe Fix #2320: Fix DB migration scripts to upgrade to 0.8 from 0.7 2022-01-20 15:08:03 -08:00
Sriharsha Chintalapani
138fd0747d Fix #2320: Fix DB migration scripts to upgrade to 0.8 from 0.7 2022-01-20 15:08:03 -08:00
Sriharsha Chintalapani
20e6c4bc86 fix upgrade 2022-01-20 15:08:03 -08:00
Alberto Miorin
b6fee6cb1c
Fix #2209: Path error: bootstrap_storage.sh not able to find main class (#2319) 2022-01-20 21:28:26 +01:00
Sachin Chaurasiya
a41dd01aaa
Fix : Fixing #2299 Able to add the tag itself as it's associated tag and #2311 (#2310)
* Fix : Fixing #2299 Able to add the tag itself as it's associated tag.

* Fixing #2311 UI struct text in dataTypeDisplay looks like a link
2022-01-20 23:15:23 +05:30
Shannon Bradshaw
b0beac243b GitBook: [#89] Add docker-compose to list of requirements. 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
2e4e8c823c GitBook: [#88] No subject 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
43f1b8404d GitBook: [#87] Fix broken links in glue connector docs 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
c8acf54818 GitBook: [#86] No subject 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
ab14355936 GitBook: [#85] No subject 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
ccc2f045b3 GitBook: [#84] Update Glue with greater detail for service settings. 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
072dec0aaf GitBook: [#83] Clarified when to use different authentication methods. 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
393dc4fba8 GitBook: [#82] Make the need to choose from 3 templates more explicit in Snowflake docs. 2022-01-20 09:14:01 -08:00
OpenMetadata
a7b6c85e8a GitBook: [#81] No subject 2022-01-20 09:14:01 -08:00
Shilpa V
b045533f5f GitBook: [#79] MSSQL - Removed " around pyodbc false 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
5cdc0720a0 GitBook: [#78] A few edits to smooth out the language in the upgrade docs. 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
297900f17a GitBook: [#77] Upgrade production OpenMetadata deployment without losing data 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
3896a2df3a GitBook: [#76] Update SSO templates per latest round of feedback from community. 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
1a17316468 GitBook: [#74] No subject 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
2cda099d7d GitBook: [#73] No subject 2022-01-20 09:14:01 -08:00
Shilpa V
43af932982 GitBook: [#72] Trino, Vertica & Hive Updates 2022-01-20 09:14:01 -08:00
Ayush Shah
8e417266f2 GitBook: [#71] DBT Doc page removed 2022-01-20 09:14:01 -08:00
Shilpa V
7f3f19ca27 GitBook: [#70] Oracle Updates 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
76b42644eb GitBook: [#69] Remove pip requirement, because we now require upgrading pip in the procedure. 2022-01-20 09:14:01 -08:00
Shannon Bradshaw
56481b2529 GitBook: [#66] Upgrade docs for docker extra 2022-01-20 09:14:01 -08:00
Shilpa V
3a3ecd5cf9 GitBook: [#68] MSSQL Updates 2022-01-20 09:14:01 -08:00
Shilpa V
8cab6097cf GitBook: [#67] Redshift Usage & Snowflake Usage Edits 2022-01-20 09:14:01 -08:00
Shilpa V
d622dc940e GitBook: [#65] Salesforce updates 2022-01-20 09:14:01 -08:00