david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
John Joyce
cc0b6019fb
chore(0.9.5): Bump defaults for release v0.9.5 ( #6856 )
2022-12-26 15:40:26 +05:30
John Joyce
180a993e09
chore(release): Updating default CLI version, update updating-datahub ( #6590 )
2022-12-01 11:59:58 +05:30
Harshal Sheth
43f7b568e3
build: upgrade gradle wrapper ( #6203 )
2022-10-14 17:04:11 -07:00
Peter Szalai
773917c817
feat(release): bump CLI version to 0.9.0 ( #6195 )
...
* feat(release): bump CLI version to 0.9.0
* update breaking changes section
* add graphql breaking change
* typo
2022-10-14 17:14:26 +02:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version ( #6075 )
2022-10-02 16:46:34 -07:00
leifker
8bd1db8c1f
feat(build): upgrade to gradle 6 for toolchain to support java 11 ( #4340 )
2022-03-09 13:31:16 -08:00
Mars Lan
d6fcefb75b
style: add checkstyle and IDEA code style config ( #1662 )
...
Currently allow checkstyle warnings until all violations have been fixed
2020-05-07 15:59:16 -07:00
Kerem Sahin
b17b91f24a
Bump gradle to 5.6.4 and pegasus to 27.7.18
2020-02-12 17:10:49 -08:00
Kerem Sahin
23339df23a
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
Kerem Sahin
5fe7d1e5ee
Switch to https links for extraLibs
2019-05-29 16:20:36 -07:00
Mars Lan
5b98156aa2
Update the build system to work with the new open source process ( #1438 )
2018-10-05 22:01:40 -07:00
Mars Lan
ed8088ae1c
Move ember.gradle from gradle/scripts to wherehows-web ( #1437 )
...
Fix version of node & yarn
2018-10-04 13:38:36 -07:00
Ignacio Bona
41cf965400
Bumped a bunch of dependencies. Mirage needed some work. Added ember and yarn scripts that runs same version of node as prod
2018-08-30 15:54:14 -07:00
Ignacio Bona
632a9f6409
Removing bower from build steps
2018-08-28 11:09:17 -07:00
Yi (Alan) Wang
999ab051ee
Update Scala to 2.11, fix travis build ( #1316 )
2018-08-13 09:45:52 -07:00
Mars Lan
d18595f39d
Update Gralde to 4.9 & Scala to 2.11 ( #1315 )
...
* Update Gralde to 4.9 & Scala to 2.11
* Update play.gradle
* Update repositories.gradle
2018-08-10 17:51:30 -07:00
Seyi Adebajo
db1ff5ae1d
fixes issue with unhandled error event in travis builds
2018-08-07 00:50:51 -07:00
Yi (Alan) Wang
fdc3ba03d1
Refactor MIE consumer to be used in Samza ( #1203 )
2018-06-12 15:58:33 -07:00
ziveo
8655c407c9
Update build.gradle ( #1202 )
...
* Update build.gradle
Updating Gradle version to at the moment lates 4.8
* Updating gradle-wrapper.properties and gradle-wrapper.jar files
2018-06-08 07:33:23 -07:00
ziveo
8a075a9cae
Update ember.gradle
...
Updating to the latest current version of Node v8.11.2 LTS
2018-05-18 17:56:58 -04:00
Yi (Alan) Wang
3b88be4a30
Modify dependencies and versions, tune log for MLE ( #1157 )
...
* Modify dependencies and versions
* Tune the log for MLE
2018-05-14 13:46:53 -07:00
Yi (Alan) Wang
06ccf1c99d
Fix MCE null pointer when dataset is null ( #955 )
2018-02-01 14:24:44 -08:00
Seyi Adebajo
7e5485bbdd
adds tmp dir to gradle clean script. updates build version of node to 8.9.4
2018-01-22 09:45:21 -08:00
Seyi Adebajo
6f388d89fe
removes unneeded manual yarnpkg install: gradle-node-plugin preferred. upgrades node version
2017-11-27 13:21:20 -08:00
Seyi Adebajo
5d41f06731
fix task reference and refactor code-cov path
2017-11-27 13:09:29 -08:00
Seyi Adebajo
05022f5f2c
adds code coverage support to ci: uses code-cov for static analysis, adds forked version for e-c-code-coverage with support for transpiled sources. updates gradle build to run ember test with coverage. removes custom yarn version. removes broken fancy tree dep. minor refactor to WIP fetch wrapper: adds doc and exports
2017-11-27 10:44:00 -08:00
Shridhar Sattur
f1b61d6773
Migrating to apache commons configuration 1.10 for parsing ETL jobs configurations. ( #851 )
2017-11-13 16:59:12 -08:00
Andrew Park
c870d598ce
Added a metadata lineage processor and a MetadataLineageEvent.avsc ( #841 )
...
* adding MLE processor and rely on operators
* Added Lineage Processor impl. and Kafka Event avro schema
2017-11-08 11:06:22 -08:00
Yi (Alan) Wang
48c274ede3
Include findbugs plugin, add nullable annotation to DAO functions ( #797 )
2017-10-16 16:57:52 -07:00
Mars Lan
98a3a0ea4f
Move various constants into Constant class ( #780 )
2017-10-03 14:52:31 -07:00
Mars Lan
9f7341f542
Clean up the log4j vs slf4j mess and consolidate the dependency resolution into a gradle script ( #745 )
2017-09-13 15:37:29 -07:00
Yi (Alan) Wang
f015d66fd2
Remove obsolete kafka code in wherehows-common ( #739 )
2017-09-11 18:13:31 -07:00
Yi (Alan) Wang
d2a3fe58db
Add schema and generated java to data model, refactor Gobblin audit processor ( #732 )
2017-09-11 15:26:06 -07:00
Yi (Alan) Wang
d1e53c765f
Rewrite Kafka client master and worker ( #731 )
2017-09-07 17:48:39 -07:00
Mars Lan
b715df4e91
Move the dummy source set from play to license gradle scripts so we don't need to do overrides internally ( #713 )
2017-08-28 16:31:41 -07:00
Hang Zhang(hzhang2)
03d533e3c2
Merge pull request #693 from hangzhang925/master
...
Refactor KAFKA processor to wherehows-kafka module
2017-08-23 14:16:52 -07:00
Mars Lan
da41ebacad
Fix typo
2017-08-23 14:12:52 -07:00
hzhang2
2ca851753a
remove backend changes for this PR
2017-08-22 22:35:27 -07:00
Mars Lan
03ba2bc85e
Move license header to wherehows-docs & update documentation ( #698 )
...
Fix license checking for Play-based projects and fix violated files
2017-08-22 21:32:53 -07:00
Jennifer Zheng
a7581d30ed
Changing hive_exec dependency to :core ( #687 )
2017-08-18 15:25:42 -07:00
Mars Lan
447bbb23bc
Update node & yarn versions ( #650 )
2017-08-08 17:37:33 -07:00
Mars Lan
93e56bb95d
Clean up gitignore, typos, and unneeded file ( #647 )
2017-08-08 17:29:20 -07:00
hzhang2
c8dcd2ef83
submit hibernate cfg ( #636 )
2017-08-03 15:04:56 -07:00
Yi (Alan) Wang
73406f5685
Bump up minor version: play 2.4.11, jackson 2.8.9 ( #628 )
2017-07-30 11:58:41 -07:00
Yi (Alan) Wang
db31dd6f11
Update gradle version to 4.0.2 ( #627 )
2017-07-30 11:07:14 -07:00
Mars Lan
cd80307463
Fix broken build due to bad merge.
2017-07-10 17:05:14 -07:00
Mars Lan
c7b6fd1688
Move TMS restli related code out of open source. ( #587 )
...
Add skeleton for a generalized DAO framework.
2017-07-10 13:44:35 -07:00
Mars Lan
d75ae54b4b
Rename data-model to wherehows-data-model. ( #492 )
2017-07-10 13:42:57 -07:00
Mars Lan
5f5c0937d1
Rename web, backend-service ( #490 )
...
* Rename web to wherehows-api and update README.
* Rename backend-service to wherehows-backend
* Rename metadata-etl to wherehows-etl
* Rename hadoop-dataset-extractor-standalone to wherehows-hadoop
2017-07-10 13:42:56 -07:00
