Pere Miquel Brull
6693b4ae40
[issue-2262] - Simplify sample data DAG ( #2337 )
...
* Simplify sample data DAG
* Remove mkdir
* Generate sources before running compose
* Generate sources to install models to ingestion image
* Add python-on-whales for docker --start
* Remove python-on-whales from base
* Install venv
* Setup python
2022-01-22 16:37:56 +05:30
Matt
2d44e11f8a
Update py-ingestion-core version control and publish workflows ( #2330 )
2022-01-21 08:58:24 -08:00
Pere Miquel Brull
979bad18d9
Update python checkstyle ( #2315 )
2022-01-20 16:18:18 -08:00
Akash Jain
14c7ae4af5
Run ingestion-core publish on version bump ( #2273 )
...
Ability to run ingestion-core publish on version bump as well.
2022-01-19 11:39:02 +05:30
Pere Miquel Brull
de3b3e4abc
[issue-2239] - Update core publish to push ( #2240 )
...
* Update core publish to push
* Rename jobs to be py explicit
* Upload to testpypi
2022-01-17 10:29:55 -08:00
Akash Jain
6350cbb68b
CI for py-ingestion-core comment workflow ( #2252 )
...
Part 1 of the py-ingestion-publish CI revamp. This will comment on PR's opened with schema changes and let the Pull requestor notify of version bump to publish dev package in test.pypi.org. See #2239 and #2240 for reference.
2022-01-17 20:35:45 +05:30
Pere Miquel Brull
9194b8e4ba
[issue-2108] - Fix PR base and add repo slug ( #2109 )
...
* Fix PR base and add repo slug
* Add SCM revision
2022-01-08 13:13:24 +01:00
Pere Miquel Brull
74e9038b92
[issue-997] - More pylint fixes ( #2107 )
...
* Update naming and disable false positives
* Rename for naming convention
* Fix linting issues
* Moved pylint to pylintrc
* Moved pylint to pylintrc
* Rename CI
* Check sonar properties
* Fix pull_request_target checkout
2022-01-07 19:50:53 +01:00
Pere Miquel Brull
48ebcffbd0
[issue-1976] - Ingestion SonarCloud ( #2085 )
...
* Update path
* Prepare sonar properties
* Prepare coverage recipes
* Add coverage
* Simplify pytest
* Organise integration tests
* Update path
* Use setup instead of reqs
* Update recipes
* Fix PR event to target
* Update event_name
* Prepare sonar
* Run tests & sonar
* Use sonarcloud host
* Fix compose
* Use ingestion token
2022-01-07 10:28:38 +01:00
Alberto Miorin
dd813a28f0
Fix #2088 , fix #2089 : Java checkstyle must run always AND Better naming for Github Actions Job names ( #2090 )
2022-01-07 05:04:29 +01:00
Alberto Miorin
51c1228b2a
Fix #2064 : Use pull_request_target in java checkstyle ( #2070 )
2022-01-06 11:13:54 +01:00
Alberto Miorin
57b0da7acc
Fix #2060 : java-checkstyle is not working anymore ( #2061 )
2022-01-05 20:10:37 -08:00
Alberto Miorin
34d8664693
Fix #2038 : Fix Java style tooling support for good ( #2051 )
2022-01-05 20:18:28 +01:00
Akash Jain
5685efd651
feat: openmetadata-ingestion-core pypi publish dev packages ( #2023 )
...
* update requirements-dev.txt
* integrate pypi incremental
* Add CI for #1875
* gitignore generated dir in ingestion-core
* update version to match ingestion package
2022-01-04 21:11:33 -08:00
Pere Miquel Brull
4bc41e2021
[issue-1990] - Add github token ( #1991 )
2022-01-04 19:05:09 +01:00
Akash Jain
348e23ca6f
fix/ci-workflows ( #1997 )
...
* add pytest and pytest-cov
* add timeout; update make command usages
2022-01-04 12:49:22 +05:30
parthp2107
59de16125d
added workflow for selenium tests without sample data ( #1999 )
...
* added workflow for selenium tests without sample data
* change in drop-create command
* using different approach to start server
* minor change
* minor change
* adding timeout to start server step
2022-01-03 16:36:32 +05:30
Pere Miquel Brull
256c25934b
[issue - 1894] - Run sonar during install ( #1918 )
...
* Run sonar during install
* Add exclusions
* Remove exclusions
* Remove activation
* Update CI for PR and Push
* Activate profile
* debug environment
* debug environment
* debug environment
* Add SCA to active profiles
* Remove profile from CI
* Activate SCA by default
* Use mvn install
* Update PR source branch
2021-12-30 08:31:25 -08:00
parthp2107
2c557f9f3d
added steps for pages with no data in selenium workflow ( #1934 )
...
* added steps for pages with no data in selenium workflow
* commit for testing workflow
2021-12-28 16:29:15 +05:30
Matt
f5c5acda66
Remove github build.yml for Sonar ( #1914 )
2021-12-23 20:11:19 -08:00
Sriharsha Chintalapani
9fe0726576
Issue-1894: Add SonarCloud ( #1899 )
...
* Issue-1894: Add SonarCloud
2021-12-23 11:05:50 -08:00
Alberto Miorin
c31ba9cf5b
Fix #1861 : Rename metadata-ingestion-generated to metadata-ingestion-core ( #1862 )
2021-12-20 22:29:07 -08:00
Alberto Miorin
09011d4259
Fix #1670 : Python generated code is missing when using pip install git+https ( #1799 )
2021-12-20 21:37:36 -08:00
Pere Miquel Brull
2ec32017bb
[issue-1698] - Airflow DockerOperator setup ( #1730 )
...
* Fix typo
* Clean setup
* Update ingestion local image to be barebone on connector dependencies
* Prepare ingestion connectors base image
* Add system dependencies
* Prepare docker CLI
* Add docker provider
* Prepare entrypoint for the image
* Remove DBT pipeline as per Issue 1658
* Add TODO for ingestion build
* Bind docker socket
* Update comment
* Update README
* Use DockerOperator in sample data
* Build images with latest tag
* Prepare symlink to pass the volume to the DockerOperator
* Update README
* Prepare Base image for CI
* COPY multiple files into dir
* COPY multiple files into dir
* Remove DBT source as is now part of table ingestion
* Build docker base in run_local_docker
2021-12-18 16:41:38 +01:00
Matt
f4c3947fc5
Add googleformatter to auto-format Java classes ( #1705 )
2021-12-16 16:13:50 +01:00
parthp2107
d069ab72e0
uncommented details page tests and corrected selenium workflow paths ( #1616 )
2021-12-08 11:54:44 +05:30
parthp2107
a9e70e6a89
License header update ( #1498 )
...
* updated liscense header
* updated license header
* updated license header
* updated license header
* addressing stylecheck findings
2021-12-01 12:46:28 +05:30
Akash-Jain
74add4c8eb
fixed paths
2021-11-29 19:25:53 +05:30
Akash-Jain
4032334a6b
adding paths for maven build
2021-11-29 19:17:44 +05:30
Akash-Jain
83e6e5aebc
Adding Paths for checkstyle jobs
2021-11-29 19:17:32 +05:30
parthp2107
6582f38a37
changed data-testids and commented code for recent api change ( #1401 )
...
* changed data-testids and commented code for recent api changes
* changing paths in selenium workflow
2021-11-26 17:02:04 +05:30
Akash Jain
e288a64781
feat: Adding CI for python integration tests ( #1368 )
...
* Adding CI for python integration tests
* Adding Paths
2021-11-24 22:20:36 -08:00
Akash Jain
d62b2c5a06
Merge pull request #1338 from open-metadata/selenium-paths
...
Selenium paths
2021-11-24 10:39:00 +05:30
parthp2107
f5ec367335
added git workflow for docs ( #1337 )
2021-11-23 17:24:42 +05:30
Parth Panchal
2da90a3c2f
adding paths in selenium workflow
2021-11-23 17:14:14 +05:30
Parth Panchal
f737a7ca1d
adding paths in selenium workflow
2021-11-23 17:12:42 +05:30
parthp2107
72f5320914
adding selenium tests for ingestion page ( #1333 )
...
* adding selenium tests for ingestion page
* adding few tests changes and addressing reviewdog findings
* testing selenium workflow
2021-11-23 14:58:11 +05:30
Parth Panchal
03057b8bc6
Revert "adding git workflow"
...
This reverts commit 2fd8a884f8d016820604232beaead05c973f91ce.
2021-11-23 14:45:05 +05:30
Parth Panchal
2fd8a884f8
adding git workflow
2021-11-23 14:37:58 +05:30
Pere Miquel Brull
67ac286f56
[Issue-1285] - Update ingestion package generation ( #1295 )
...
* Remove generated sources
* Ignore python generated sources
* Keep the generated dir
* Prepare publish recipe
* Simplify recipe
* Update README with generation
* Update docs with python local setup information
* Generate python sources in the CI
2021-11-21 08:02:31 -08:00
pmbrull
a2374e4289
Simplify action to just validate pydantic model generation
2021-11-20 15:28:56 +01:00
pmbrull
c83429fdf3
Validate on PR and push on main
2021-11-19 14:16:56 +01:00
pmbrull
076f7e306b
Update Python CI to run only for changes in ingestion
2021-11-19 14:03:28 +01:00
pmbrull
0a08394955
Prepare python dependencies
2021-11-19 10:38:23 +01:00
pmbrull
6b293da9c1
Prepare github action to generate pydantic models
2021-11-18 20:39:00 +01:00
Suresh Srinivas
0415983120
Fixes #1234 Upgrade project dependencies to the latest versions ( #1235 )
...
* Fixes #1234 Upgrade project dependencies to the latest versions
* Add libssl to github maven workflow
Co-authored-by: sureshms <suresh@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2021-11-17 11:24:19 -08:00
parthp2107
c6eac34c3e
changed script ( #1201 )
...
* changed script
* testing changes for failing tests
* testing changes for failing tests
* testing changes for failing tests
* testing changes for failing tests
2021-11-16 18:26:09 +05:30
Akash Jain
58cf1b012f
feat: Docker Image Push Workflow ( #1191 )
...
* copy command use path from root folder
* Add workflows for docker release to github
2021-11-15 09:36:57 -08:00
parthp2107
bfe3d86583
git workflow for selenium tests ( #945 )
...
* Create selenium-tests.yml
* Update selenium-tests.yml
* added dependency and configured testng.xml in pom
* removing testng config
* headless browers, testng to junit
* removed webDriverManager
* removed webDriverManager
* testing commit
* pushing all tests
* end-to-end tests
* changed workflow for proper test running order
* checking docker build
* printing logs for testing
* reformatted the code
* printing logs
* addressed null pointer exception
* addressing git worflow errows
* removing logs from start server test
* running .sh script directly from workflow
* testing script
* testing script
* addressing reviewdog findings
* updated chrome drivers
* addressing failing tests
* searchbar to searchBox
* testing
* cleaning code and added api test config in pom.xml
* commenting tests - functionality absent
* addressing reviewdog finding
* addressing reviewdog finding
* uncommenting search tests
* added condition for no service exists and added click event to leftout actions
* addressing reviewdog findings
2021-11-06 00:58:19 -07:00
Pere Miquel Brull
1804de6d73
[Issue-760] - Precommit & isort ( #772 )
...
* Update configs
* Update configs
* Update precommit black exclude
* Update precommit exclude isort
* Test precommit
* Revert test commit
* isort & black
* Test precommit
* Revert test precommit
* Update docs
* Apply recipe update
* Fix black_check recipe
* Grammar
2021-10-14 15:22:59 -07:00
