134 Commits

Author SHA1 Message Date
Aseem Bansal
b2ecd7f968
chore(ci): update dependencies, fix smoke image build (#7580) 2023-03-15 21:07:30 +05:30
Aseem Bansal
8df66ecaff
fix(ci): trivy code scanning fix (#7232) 2023-02-02 21:50:24 +05:30
Harshal Sheth
5d7246b151
ci(): fix datahub-upgrade quickstart regression (#7217)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-01 15:30:18 -08:00
Harshal Sheth
7e869cd1d6
feat(): add a linter for github actions workflows (#7178)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-30 13:13:41 -08:00
Amanda Ng
087b169b38
feat(editor): improve documentation editor using Remirror (#6631)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-01-17 18:00:39 -05:00
Aseem Bansal
10db6265c0
fix(ci): use trivy offline scanning (#7050) 2023-01-16 12:55:32 -06:00
Aseem Bansal
16c41b4778
fix(ci): only scan on master branch (#7047) 2023-01-16 09:34:37 -06:00
david-leifker
c845866521
test(misc): misc test updates (#6890) 2022-12-29 11:26:42 -06:00
Aseem Bansal
0bbe6d693e
fix(ci): reduce flakiness in add_users, siblings smoke test (#6883) 2022-12-29 21:47:25 +05:30
Peter Szalai
9c794af4a7
feat(CI): add venv caching (#6843)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-28 13:22:47 +01:00
Aseem Bansal
1bec1d87bd
fix(ci): reduce smoke test run time (#6841) 2022-12-27 00:08:01 +05:30
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Shirshanka Das
b236d0958c
feat(ci): adding github security reporting to trivy scans (#6773) 2022-12-15 21:28:07 -08:00
Aseem Bansal
0862a22632
fix(build): remove warnings in github actions (#6512) 2022-11-23 16:43:23 +05:30
Kevin Neville
3eae087a30
chore(ci): update actions versions addressing warnings in builds. (#6308) 2022-10-28 17:10:30 -07:00
Aseem Bansal
98eba90edc
fix(build): allow image tag via env, fix requirements (#6237) 2022-10-19 12:26:22 +05:30
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Pedro Silva
102754f138
feat(smoke-tests) Make smoke tests use standalone consumers (#5856) 2022-09-08 16:34:11 +05:30
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 (#5827)
* fix(standalone-consumers) Removes Solr from spring boot application config

* Adds standalone consumer option to datahub quickstart cli

* Rename files

* Make dockerize platform agnostic & change docker compose utility to work with M1

* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers

* Fix identation

* Use master code

* Adds ARM image publishing for consumers

* Fix linter

* Fix lint
2022-09-06 13:55:31 -05:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support (#5521) 2022-08-10 15:00:31 -07:00
Aseem Bansal
581765dd91
fix(ci): cancel docker-unified workflow only on PRs on new commits (#5608) 2022-08-10 16:22:56 +05:30
Harshal Sheth
2d68097ff4
refactor(ci): refactor Docker build-and-push workflows (#5494) 2022-07-27 22:27:31 +05:30
Aseem Bansal
252992f15e
fix(ci): intermittent failure in github actions (#5452) 2022-07-25 23:02:02 -07:00
Shirshanka Das
86012fd40c
feat(ci): datahub-upgrade - support multiplatform image (#5477) 2022-07-24 18:25:39 -07:00
Aseem Bansal
4541379024
feat(build): changes to decrease build time, cancel runs in case of multiple commits (#5187) 2022-06-17 18:05:10 +05:30
Dexter Lee
40d7071c00
fix(ci): docker - remove multiplatform builds for unsupported images (#4953) 2022-05-18 22:10:47 -07:00
Dexter Lee
37ae1ca4e6
fix(ci): add artifact cleaner, make docker publish sections consistent (#4950) 2022-05-18 20:15:20 -07:00
RyanHolstien
5b248e9375
fix(workflow): fix mysql credentials (#4947) 2022-05-18 18:14:07 -07:00
Dexter Lee
5879debd9b
Fix docker unified (#4948) 2022-05-18 13:19:46 -07:00
Shirshanka Das
b78aeaedf7
fix(ci): clean up docker workflow for multi-tags (#4889) 2022-05-10 14:24:54 -07:00
Shirshanka Das
c68260234e
fix(ci): docker - either load or push, don't do both (#4887) 2022-05-10 08:59:16 -07:00
Shirshanka Das
fbf35f430f
fix(ci): remove buildx and qemu for non multi-platform images (#4885) 2022-05-10 15:14:54 +02:00
Shirshanka Das
e697b89bee
fix(ci): remove multiplatform builds from containers that don't support it (#4883) 2022-05-09 21:48:42 -07:00
Shirshanka Das
f8171702f6
feat(ci): docker actions simplify, add vulnerability scanner, simplify smoke-tests (#4881)
co-authored-by: Dexter Lee <dexter@acryl.io>
2022-05-09 19:49:57 -07:00