49 Commits

Author SHA1 Message Date
Pere Miquel Brull
0d9ec54b55
Ignore docs V1 in CI (#11272) 2023-04-25 18:02:30 +02:00
Pere Miquel Brull
e453593760
Rel to #10805 - Ingestion docs glue & Kerberos Dep (#11157)
* Glue

* Add kerberos system dep
2023-04-20 10:56:46 +02:00
Akash Jain
2e985c6f00
fix(CI): rate limit issue with lewagon/wait-on-check-action (#10833)
* fix(CI): rate limit issue with lewagon/wait-on-check-action

* updating wait-interval to 90 seconds
2023-03-29 19:03:30 +02:00
Nahuel
da808bbe75
Fix: Update when GH actions are triggered (#10777) 2023-03-27 12:16:10 +02:00
Sriharsha Chintalapani
de10cd254b
New docker structure (#10438)
* Adding the different docker-compose file openmetadata and ingestion

* Added two different env files for mysql and postgres

* Updated the docker file path

* Updated the path of docker folder structure

* Fix docker

* Updating the PR with necessary changes required

---------

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-03-06 08:58:53 -08:00
Vj-L
dfbee1a6bf
Updated the command for ubuntu dependencies (#10388)
* Updated the command for ubuntu dependencies

* Updated the command for ubuntu dependencies

* Updated the command for ubuntu dependencies

---------

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2023-03-02 15:46:21 +05:30
Nahuel
89fd0dfba7
Pytest CI should not skipped with changes on om-spec or om-service (#10094) 2023-02-02 18:54:55 +00:00
Nahuel
97f325d7bc
Fix: Update CI GitHub actions (#10075)
* Update CI GitHub actions

* Add missing matrix property to Maven CI
2023-02-02 12:26:13 +01:00
Nahuel
7c61c0ad6f
Fix: remove wretry.action from py-test and change retry approach (#9949) 2023-01-27 08:45:20 +01:00
Nahuel
4c91e80132
Fix: configuration of Push Results in PR to Sonar step on py-test GH (#9946) 2023-01-26 19:00:35 +01:00
Nahuel
d03d53a9bb
Fix: configuration of Push Results in PR to Sonar step on py-test GH (#9945) 2023-01-26 18:46:19 +01:00
Nahuel
c171aea11a
Fix: configuration of wretry.action (#9944) 2023-01-26 18:42:12 +01:00
Nahuel
5a143c0420
Feat: Retry CI steps when fail because of unexpected reasons (#9942) 2023-01-26 18:37:45 +01:00
Nahuel
5608c2fde0
Add E2E CLI tests coverage to Sonar (#9908) 2023-01-25 11:51:25 +01:00
dhruvinmaniar123
081aad5f5d
Updated all workflows for issue #9141 (#9147)
Co-authored-by: Dhruvin Maniar <dhruvinmaniar@Dhruvins-MacBook-Pro.local>
2022-12-05 22:32:13 +05:30
Vj-L
0a570c8585
Fixed the mounting of volumes (#8963)
* Fixed the mounting of volumes

* Update docker/local-metadata/docker-compose-postgres.yml

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Update docker/metadata/docker-compose-postgres.yml

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Added permission step

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
2022-11-23 14:37:53 +05:30
Vj-L
c48c8dcea9
Added flag with docker-compose down command (#8908)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-11-21 14:00:43 +05:30
Nahuel
a97a4ba6af
Downgrade version of wait-on-check-action to 1.0.0 (#8894) 2022-11-18 09:58:56 -08:00
Vj-L
2c055641be
Added host volumes for Database service (#8722)
* Added host volumes for Database service

* Formated the python file

* Done changes according to the comments on PR

* Changes done as per the comments on Draft PR

* Fix PyLint

* Changes done as per the comments on Draft PR

* Updated the path of volume for Database

* Added cleanup state in workflows

* Added cleanup state in workflows

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-11-18 14:05:33 +01:00
Pere Miquel Brull
c2983e8606
Trigger maven and py-tests on all PRs (#8791) 2022-11-16 08:48:55 +01:00
Pere Miquel Brull
11ad9192a4
Fix CI condition for gatekeeping (#8769) 2022-11-15 17:37:30 +01:00
Pere Miquel Brull
34ba9d95c5
Ingestion Pipeline deployed, Athena tests and pydantic extras (#8682)
* Always run python tests

* Fix athena tests and types

* Update deployed prop in IngestionPipeline

* Fix #8554

* Format

* Use true as default deployed migration

* Remove repeated req

* Pydantic wiggle room
2022-11-13 11:59:43 +01:00
Pere Miquel Brull
dae85e92bd
Do not check labels on push (#8672) 2022-11-11 12:13:23 +01:00
Pere Miquel Brull
03c1c005cf
Add Workflow label verification for CI (#8653)
* Add labeler

* Update verify with comment

* Add label verification

* Add label verification

* Update .github/teams.yml
2022-11-11 11:25:59 +01:00
Pere Miquel Brull
d5ac72c591
Revert "Add PR approval wait (#8640)" (#8644)
This reverts commit cc2973e61c231c5681d5fb29f387330600f2cbd4.
2022-11-10 11:21:59 +01:00
Pere Miquel Brull
cc2973e61c
Add PR approval wait (#8640) 2022-11-10 10:53:48 +01:00
Pere Miquel Brull
33b395a6f7
Remove approval check (#8637) 2022-11-10 09:19:04 +01:00
Pere Miquel Brull
f7cdd31a15
Fix Workflows approval permissions (#8636)
* Add permissions and approval flow

* Approval fmt
2022-11-10 09:12:56 +01:00
Pere Miquel Brull
8a73d7e855
Add permissions and approval flow (#8625) 2022-11-10 09:03:08 +01:00
Nahuel
dae7f8c5b4
Update py-test workflow (#8394) 2022-10-27 17:43:35 +02:00
Nahuel
e277392124
Fix sonar cloud python coverage (#8386) 2022-10-27 16:18:57 +02:00
Nahuel
37f06034dd
Sonar coverage test run only for Python 3.9 (#8151) 2022-10-14 17:39:29 +02:00
Nahuel
b69581299f
Fix SonarCloud coverage for Python code (#8144) 2022-10-14 15:17:40 +02:00
Nahuel
5c499d2a7a
Add CLI E2E tests for MySQL (#8041)
* Add CLI E2E tests for MySQL

* Fix setup.py and pylint

* Add missing doc and update code after pylint refactor
2022-10-10 11:36:20 +02:00
Ashok Mokshagundam
23f6e18a17
Running All the CI workflows on Release branches along with main branch (#7691)
* Update airflow-apis-tests-3_9.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-mysql.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-postgresql.yml

Updated workflows to run on main branch and also on all release branches

* Update docs-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update java-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update maven-build.yml

Updated workflows to run on main branch and also on all release branches

* Update openmetadata-ingestion-core-version-comment.yml

Updated workflows to run on main branch and also on all release branches

* Update py-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update py-generate.yml

Updated workflows to run on main branch and also on all release branche

* Update py-ingestion-core-publish.yml

Updated workflows to run on main branch and also on all release branches

* Update py-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update selenium-noIngestion-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update sync-docs.yml

Updated workflows to run on main branch and also on all release branches

* Update yarn-coverage.yml

Updated workflows to run on main branch and also on all release branches

* Update airflow-apis-tests-3_9.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-mysql.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-postgresql.yml

Updated workflows to run on main branch and also on all release branches

* Update docs-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update java-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update maven-build.yml

Updated workflows to run on main branch and also on all release branches

* Update openmetadata-ingestion-core-version-comment.yml

Updated workflows to run on main branch and also on all release branches

* Update py-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update py-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update selenium-noIngestion-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update sync-docs.yml

Updated workflows to run on main branch and also on all release branches
2022-09-26 16:47:35 +05:30
Mayur Singal
680a186209
Added Exception Handling for Bigquery Tags & Fix py-test CI (#7649) 2022-09-22 14:08:04 +05:30
Ashok Mokshagundam
0b0d1c51d9
Merging PyTests with Github Actions CI with matrix strategy into a single file (#7628)
* Delete py-tests-3_10.yml

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355

* Delete py-tests-3_8.yml

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355

* Delete py-tests-3_9.yml

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355

* Merging PyTest files into a single file

Merging PyTests with Github Actions CI with matrix strategy into a single file #7355
2022-09-21 17:51:39 +05:30
Ayush Shah
8cc91c3405
Modified Ingestion to support 3.6 and later (#5003) 2022-05-17 21:38:57 +05:30
Akash Jain
792c67a8f1
Arguments to provide ingestion depenedency. defaults to 'all' (#4613) 2022-05-02 16:09:44 +05:30
Vj-L
869a4a193f
Issue1421 (#4092) 2022-04-19 11:43:08 +05:30
Ayush Shah
2eccd711f1
Modifying Timeout for PyTests (#3587)
Tests are failing because of timeout being too near to the threshold
2022-03-22 18:37:30 +05:30
codingwithabhi
ccb96b3ea7
makefile-updated-to-install-all-packages-for-unittest (#3550) 2022-03-21 16:02:34 +05:30
Pere Miquel Brull
548a82aa22
[issue-2384] - Entity version return body (#2428) 2022-01-25 11:18:24 -08:00
Pere Miquel Brull
1eb3f1ad41
[issue-2322] - Backup CLI (#2349)
* Prepare cli module

* Check call

* Prepare backup

* Run pytest on schema changes

* Remove traces

* Add backup plugin

* run generate during CI

* Install after generate

* Address logger hotspot
2022-01-22 12:08:14 -08:00
Pere Miquel Brull
6693b4ae40
[issue-2262] - Simplify sample data DAG (#2337)
* Simplify sample data DAG

* Remove mkdir

* Generate sources before running compose

* Generate sources to install models to ingestion image

* Add python-on-whales for docker --start

* Remove python-on-whales from base

* Install venv

* Setup python
2022-01-22 16:37:56 +05:30
Pere Miquel Brull
de3b3e4abc
[issue-2239] - Update core publish to push (#2240)
* Update core publish to push

* Rename jobs to be py explicit

* Upload to testpypi
2022-01-17 10:29:55 -08:00
Pere Miquel Brull
9194b8e4ba
[issue-2108] - Fix PR base and add repo slug (#2109)
* Fix PR base and add repo slug

* Add SCM revision
2022-01-08 13:13:24 +01:00
Pere Miquel Brull
74e9038b92
[issue-997] - More pylint fixes (#2107)
* Update naming and disable false positives

* Rename for naming convention

* Fix linting issues

* Moved pylint to pylintrc

* Moved pylint to pylintrc

* Rename CI

* Check sonar properties

* Fix pull_request_target checkout
2022-01-07 19:50:53 +01:00
Pere Miquel Brull
48ebcffbd0
[issue-1976] - Ingestion SonarCloud (#2085)
* Update path

* Prepare sonar properties

* Prepare coverage recipes

* Add coverage

* Simplify pytest

* Organise integration tests

* Update path

* Use setup instead of reqs

* Update recipes

* Fix PR event to target

* Update event_name

* Prepare sonar

* Run tests & sonar

* Use sonarcloud host

* Fix compose

* Use ingestion token
2022-01-07 10:28:38 +01:00