394 Commits

Author SHA1 Message Date
Aseem Bansal
eca73c0524
feat(ci): exempt from stale label (#5964) 2022-09-16 11:34:41 -07:00
Aseem Bansal
ff04e0e0bd
fix(ci): process older issues first (#5926) 2022-09-14 14:46:41 +05:30
Shirshanka Das
15a33fadc8
feat(ingest): lookml - support for git checkout (#5924) 2022-09-13 16:40:59 -07:00
Shirshanka Das
5a0154f3fe
fix(ci): fix jar release action dependencies (#5884) 2022-09-09 10:16:09 -07:00
Shirshanka Das
083ab9bc0e
feat(jars): better jar versioning for datahub-client, spark-lineage and protobuf (#5883) 2022-09-08 23:36:15 -07:00
Shirshanka Das
fe30f54689
feat(datahub-protobuf): add support for shadow jar, publish (#5882) 2022-09-08 22:10:36 -07:00
Pedro Silva
102754f138
feat(smoke-tests) Make smoke tests use standalone consumers (#5856) 2022-09-08 16:34:11 +05:30
Harshal Sheth
6f09f1025e
ci(ingest): test with python 3.10 (#5863) 2022-09-07 17:08:49 -07:00
Aseem Bansal
055dd27015
feat(ci): auto label PRs (#5839) 2022-09-06 14:46:34 -07:00
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 (#5827)
* fix(standalone-consumers) Removes Solr from spring boot application config

* Adds standalone consumer option to datahub quickstart cli

* Rename files

* Make dockerize platform agnostic & change docker compose utility to work with M1

* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers

* Fix identation

* Use master code

* Adds ARM image publishing for consumers

* Fix linter

* Fix lint
2022-09-06 13:55:31 -05:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support (#5521) 2022-08-10 15:00:31 -07:00
Aseem Bansal
581765dd91
fix(ci): cancel docker-unified workflow only on PRs on new commits (#5608) 2022-08-10 16:22:56 +05:30
Aseem Bansal
fedf451668
fix(ci): use different image for smoke base image (#5607) 2022-08-10 14:53:30 +05:30
Aseem Bansal
006141ab2e
fix(ci): paths for github workflows (#5595) 2022-08-09 10:10:08 -07:00
Aseem Bansal
d20071ad91
fix(ci): smoke test less flaky, add src, dev dep in smoke image (#5594) 2022-08-09 19:07:12 +05:30
Aseem Bansal
8ea5295294
chore(build): tweak stale issue timing (#5571) 2022-08-04 10:40:05 -07:00
Aseem Bansal
120875f3fd
feat(ci): test quickstart works (#5518)
* feat(ci): test quickstart works

* do not fail fast

* remove macos

* add some debug information

* tweak triggers

* fix workflow file

* remove running on every PR

* Update .github/workflows/check-quickstart.yml

Co-authored-by: Harshal Sheth <hsheth2@gmail.com>

* Update .github/workflows/check-quickstart.yml

Co-authored-by: Harshal Sheth <hsheth2@gmail.com>

Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-08-02 17:38:54 -07:00
Aditya Radhakrishnan
d0f0fae431
chore(issues): reduce time for issues to be marked stale and then closed (#5537) 2022-08-01 15:53:18 -07:00
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms (#4999) 2022-08-01 09:47:08 -07:00
Harshal Sheth
2d68097ff4
refactor(ci): refactor Docker build-and-push workflows (#5494) 2022-07-27 22:27:31 +05:30
Harshal Sheth
44122d4e08
refactor(ci): use custom action for checking codegen status (#5493) 2022-07-26 18:04:57 -07:00
Aseem Bansal
639feafcfb
feat(build): automatically mark issues as stale to close inactive issues (#5482) 2022-07-26 09:30:40 -07:00
Aseem Bansal
252992f15e
fix(ci): intermittent failure in github actions (#5452) 2022-07-25 23:02:02 -07:00
Shirshanka Das
86012fd40c
feat(ci): datahub-upgrade - support multiplatform image (#5477) 2022-07-24 18:25:39 -07:00
Aseem Bansal
935b423452
fix(docs,build): remove base image not needed, cleanup docs (#5469) 2022-07-22 19:43:48 +05:30
Aseem Bansal
e21efbe9d2
fix(build): add base image with gradle wrapper cached (#5467) 2022-07-22 17:44:37 +05:30
Aseem Bansal
9fca5277dc
fix(build): tweak ingestion build (#5374) 2022-07-12 12:37:47 +05:30
Aseem Bansal
b73477f31e
feat(build): reduce build time for ingestion image (#5225) 2022-06-29 15:26:12 +05:30
Aseem Bansal
e2d849de4b
fix(build): use correct creds (#5261) 2022-06-27 20:31:51 +05:30
Aseem Bansal
60ca9580d1
feat(build): add base image for ingest (#5243) 2022-06-27 14:08:16 +05:30
Aseem Bansal
c942350e3c
feat(ci): split integration tests to reduce run time (#5205) 2022-06-20 21:08:37 +05:30
Aseem Bansal
4541379024
feat(build): changes to decrease build time, cancel runs in case of multiple commits (#5187) 2022-06-17 18:05:10 +05:30
Shirshanka Das
eca310fb05
feat(ci): datahub-client - add workflow, fix build (#5052) 2022-05-31 22:40:31 -07:00
buggythepirate
92338c7912
feat(ingest): Added new ingestion source SAP HANA (#4376)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:42:50 -07:00
Dexter Lee
fe637ef392
fix(ci): remove scheduled artifact deletion run to avoid api rate limiting (#4954) 2022-05-18 22:38:38 -07:00
Dexter Lee
40d7071c00
fix(ci): docker - remove multiplatform builds for unsupported images (#4953) 2022-05-18 22:10:47 -07:00
Dexter Lee
37ae1ca4e6
fix(ci): add artifact cleaner, make docker publish sections consistent (#4950) 2022-05-18 20:15:20 -07:00
RyanHolstien
5b248e9375
fix(workflow): fix mysql credentials (#4947) 2022-05-18 18:14:07 -07:00
Dexter Lee
5879debd9b
Fix docker unified (#4948) 2022-05-18 13:19:46 -07:00
Shirshanka Das
b78aeaedf7
fix(ci): clean up docker workflow for multi-tags (#4889) 2022-05-10 14:24:54 -07:00
Shirshanka Das
c68260234e
fix(ci): docker - either load or push, don't do both (#4887) 2022-05-10 08:59:16 -07:00
Shirshanka Das
fbf35f430f
fix(ci): remove buildx and qemu for non multi-platform images (#4885) 2022-05-10 15:14:54 +02:00
Shirshanka Das
e697b89bee
fix(ci): remove multiplatform builds from containers that don't support it (#4883) 2022-05-09 21:48:42 -07:00
Shirshanka Das
f8171702f6
feat(ci): docker actions simplify, add vulnerability scanner, simplify smoke-tests (#4881)
co-authored-by: Dexter Lee <dexter@acryl.io>
2022-05-09 19:49:57 -07:00
RyanHolstien
9422578e41
Revert "chore(deps): upgrade play to remove CVEs (#4864)" (#4868)
This reverts commit 84a026b1263ab91cd4010d905129a279523f413e.
2022-05-06 15:08:35 -07:00
RyanHolstien
84a026b126
chore(deps): upgrade play to remove CVEs (#4864) 2022-05-06 13:42:03 -07:00
Shirshanka Das
bfed6b8029
fix(ci): split out expensive build steps, increase memory (#4825) 2022-05-04 22:21:56 -07:00
Aditya Radhakrishnan
cb45d67b46
feat(ci) - add cypress dashboard view to CI (#4654) 2022-04-13 07:30:24 -07:00
Dexter Lee
2a8ae27261
Revert "feat: adding gradle, pip cache via gh cache, docker cache via dockerhub (#4387)" (#4637)
This reverts commit b6de051d9a5240cefa1a7b217690cfe3a85a70f5.
2022-04-11 16:00:16 -07:00
Aseem Bansal
b6de051d9a
feat: adding gradle, pip cache via gh cache, docker cache via dockerhub (#4387)
* attempt cache

* change cache keys

* use docker repository for caching

* change buildcache tag

* change tag

* fix cache key

* take docker cache from head buildcache

* try not pushing when not publishing

* change to use templating

* change docker caching

* test change org name

* check using cache

* revert changes

* remove gradle cache from build and test workflow
2022-04-08 09:19:58 -07:00