605 Commits

Author SHA1 Message Date
Ayush Shah
a74047c8a0
Modified workflows and ingestion-core package (#5005) 2022-05-17 21:46:49 +05:30
Ayush Shah
8cc91c3405
Modified Ingestion to support 3.6 and later (#5003) 2022-05-17 21:38:57 +05:30
Vivek Ratnavel Subramanian
d3c7330692
Cypress: Add Kafka, Metabase, Superset, and Glue (#4955) 2022-05-14 15:44:02 -07:00
HabibRahman
cfab77c854
Issue-4790 (#4800) 2022-05-13 14:26:10 +05:30
Vivek Ratnavel Subramanian
2a380c39d3
Cypress: Add Bigquery and Redshift ingestions (#4903) 2022-05-11 23:35:13 -07:00
Vivek Ratnavel Subramanian
af8b95091a
Cypress Integration (#4859) 2022-05-10 22:47:04 -07:00
Akash Jain
18194e374e
Docker image and CI for Airflow Image (#4791) 2022-05-09 14:09:46 +02:00
Pere Miquel Brull
8aa88b1efc
Fix #4636 - CLI: Remove --skip-sample-data and add --ingest-sample-data (#4646) 2022-05-03 18:54:43 -07:00
Pere Miquel Brull
5751b8d75f
Issue template roadmap (#4625)
* Check project label

* Check project label

* Add GA to add issue to roadmap

* Add roadmap url
2022-05-02 16:56:31 +02:00
Pere Miquel Brull
0e3d1092ec
Issue template roadmap (#4622)
* Check project label

* Check project label
2022-05-02 15:58:56 +02:00
Pere Miquel Brull
97da48bcf0
Check project label (#4621) 2022-05-02 15:54:54 +02:00
Akash Jain
792c67a8f1
Arguments to provide ingestion depenedency. defaults to 'all' (#4613) 2022-05-02 16:09:44 +05:30
Akash Jain
81dc942370
fix: CI for Maven Builds on main branch (#4592) 2022-04-29 14:01:42 +02:00
Sriharsha Chintalapani
cf3fc89c27
Add test container reuse for github workflows (#4563) 2022-04-28 00:17:32 -07:00
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505)
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
2022-04-27 00:41:17 +05:30
Ayush Shah
cbcceea127
Modify PR template (#4411) 2022-04-23 21:19:35 +05:30
Vj-L
869a4a193f
Issue1421 (#4092) 2022-04-19 11:43:08 +05:30
Pere Miquel Brull
63da7c7556
Fix install (#4139) 2022-04-14 11:54:02 +02:00
Pere Miquel Brull
21f84b3f42
Prepare ingestion release workflow (#4127)
* Prepare ingestion release workflow

* Use manual trigger
2022-04-14 11:33:17 +02:00
Alberto Miorin
735cc54614
Bump nodejs to 16.x (#4132) 2022-04-14 14:39:19 +05:30
Akash Jain
954bbca383
fix: Ability to run CI from forked Repository (#3874)
* Ability to run CI from forked Repository

* Update yarn-coverage.yml
2022-04-06 11:34:03 +05:30
Akash Jain
f410a1b563
fix:SonarCloud UI builds on main branch (#3795) 2022-04-01 12:26:42 +05:30
Akash Jain
4e1b44d696
feat: Add Workflow CI for SonarCloud OpenMetadata UI (#3708)
* Adding Workflow CI for SonarCloud OpenMetadata UI

* Adding sonar project properties and reporter for UI

* Added mock and test exclusions

* Minor changes

* fix node version to 12.x in CI

* Test CI workflow

* fixed syntax

* remove yarn caching

* test docker on steps

* remove jobs container

* test out args

* update path

* check with yarn

* fix typo

* fix typo

* fix typo

* fix typo

* use npm -g command

* removed project base dir

Co-authored-by: darth-coder00 <aashit@getcollate.io>
2022-04-01 10:31:45 +05:30
Suresh Srinivas
c3154afd2d
Update pull_request_template.md 2022-03-27 13:10:04 -07:00
Ayush Shah
2eccd711f1
Modifying Timeout for PyTests (#3587)
Tests are failing because of timeout being too near to the threshold
2022-03-22 18:37:30 +05:30
codingwithabhi
ccb96b3ea7
makefile-updated-to-install-all-packages-for-unittest (#3550) 2022-03-21 16:02:34 +05:30
Akash Jain
211a8a55e8
feat: Prepare 0.9.1-SNAPSHOT (#3297)
* prepare snapshot version for 0.9.1

* prepare dev version for ingestion 0.9.1

* prepare dev version for ingestion-core 0.9.1

* prepare Docker CI workflows for 0.9.1
2022-03-09 12:08:42 +05:30
Matt
09082ec988
Publish mvn test report to PR (#3135) 2022-03-03 23:08:47 -08:00
Matt
6cdd90f7b2
Add mvn test report publish (#3086) 2022-03-03 22:24:08 -08:00
Pere Miquel Brull
e96ac838ff
Fix #3084 - Implement missing tests (#3117)
Fix #3084 - Implement missing tests
2022-03-04 06:59:47 +01:00
Pere Miquel Brull
1ddd2453e2
Prep feature task issue template (#2781) 2022-02-16 08:06:18 +01:00
Suresh Srinivas
f1740e5ec4
Create feature_task.md
Template for creating issues that capture a task from a larger feature
2022-02-15 21:59:56 -08:00
Suresh Srinivas
e4cbcd8788
Create feature_task 2022-02-15 21:57:57 -08:00
Pere Miquel Brull
768aa310eb
Fix #2514 - Revamp Github profile (#2515)
* Add CONTRIBUTING.md

* Update README.md

* Add ISSUE_TEMPLATE

* Add sonar status
2022-01-31 09:57:49 -08:00
Pere Miquel Brull
6ea6f0c43d
Fix #2383 - Multiple validation workflows (#2500)
* Clean duplicated validation

* Move black dep to dev

* Fix black version for ingestion core

* Validate core generated in the same workflow
2022-01-30 12:26:41 -08:00
Pere Miquel Brull
548a82aa22
[issue-2384] - Entity version return body (#2428) 2022-01-25 11:18:24 -08:00
Pere Miquel Brull
b39b698eb7
Fix #2345 - Make bump & unify (#2359)
* Add installing instructions

* Unify makefile and automate bump version setup

* Update submake call

* Mark targets as phony

* Add help to recipes

* Update core publish

* Do not trigger install from echo

* Run make from root

* Prepare py_format from isort and black

* Run py_format

* Check black and isort formatting

* Update comment msg
2022-01-23 09:47:06 -08:00
Pere Miquel Brull
1eb3f1ad41
[issue-2322] - Backup CLI (#2349)
* Prepare cli module

* Check call

* Prepare backup

* Run pytest on schema changes

* Remove traces

* Add backup plugin

* run generate during CI

* Install after generate

* Address logger hotspot
2022-01-22 12:08:14 -08:00
Pere Miquel Brull
6693b4ae40
[issue-2262] - Simplify sample data DAG (#2337)
* Simplify sample data DAG

* Remove mkdir

* Generate sources before running compose

* Generate sources to install models to ingestion image

* Add python-on-whales for docker --start

* Remove python-on-whales from base

* Install venv

* Setup python
2022-01-22 16:37:56 +05:30
Matt
2d44e11f8a
Update py-ingestion-core version control and publish workflows (#2330) 2022-01-21 08:58:24 -08:00
Pere Miquel Brull
979bad18d9
Update python checkstyle (#2315) 2022-01-20 16:18:18 -08:00
Akash Jain
14c7ae4af5
Run ingestion-core publish on version bump (#2273)
Ability to run ingestion-core publish on version bump as well.
2022-01-19 11:39:02 +05:30
Pere Miquel Brull
de3b3e4abc
[issue-2239] - Update core publish to push (#2240)
* Update core publish to push

* Rename jobs to be py explicit

* Upload to testpypi
2022-01-17 10:29:55 -08:00
Akash Jain
6350cbb68b
CI for py-ingestion-core comment workflow (#2252)
Part 1 of the py-ingestion-publish CI revamp. This will comment on PR's opened with schema changes and let the Pull requestor notify of version bump to publish dev package in test.pypi.org. See #2239  and #2240 for reference.
2022-01-17 20:35:45 +05:30
Pere Miquel Brull
9194b8e4ba
[issue-2108] - Fix PR base and add repo slug (#2109)
* Fix PR base and add repo slug

* Add SCM revision
2022-01-08 13:13:24 +01:00
Pere Miquel Brull
74e9038b92
[issue-997] - More pylint fixes (#2107)
* Update naming and disable false positives

* Rename for naming convention

* Fix linting issues

* Moved pylint to pylintrc

* Moved pylint to pylintrc

* Rename CI

* Check sonar properties

* Fix pull_request_target checkout
2022-01-07 19:50:53 +01:00
Pere Miquel Brull
48ebcffbd0
[issue-1976] - Ingestion SonarCloud (#2085)
* Update path

* Prepare sonar properties

* Prepare coverage recipes

* Add coverage

* Simplify pytest

* Organise integration tests

* Update path

* Use setup instead of reqs

* Update recipes

* Fix PR event to target

* Update event_name

* Prepare sonar

* Run tests & sonar

* Use sonarcloud host

* Fix compose

* Use ingestion token
2022-01-07 10:28:38 +01:00
Alberto Miorin
dd813a28f0
Fix #2088, fix #2089: Java checkstyle must run always AND Better naming for Github Actions Job names (#2090) 2022-01-07 05:04:29 +01:00
Alberto Miorin
51c1228b2a
Fix #2064: Use pull_request_target in java checkstyle (#2070) 2022-01-06 11:13:54 +01:00
Alberto Miorin
57b0da7acc
Fix #2060: java-checkstyle is not working anymore (#2061) 2022-01-05 20:10:37 -08:00