27 Commits

Author SHA1 Message Date
Mars Lan
d1e644a7ec Add gradle support for building and packaging the ember web app (#409)
* Add gradle support for building and packaging the ember web app, alleviating the manual instlalation of node/npm/bower/ember.

* Remove generated files under web/public

* Update ember.gradle
2017-07-10 09:55:15 -07:00
Mars Lan
1efa4eef16 Add hooks for LI-specific adaptation of the build script. 2017-07-10 09:54:09 -07:00
Mars Lan
a589abbd76 Split the root build script into multiple scripts. (#348)
Split the root build script into multiple scripts
Add coveralls support.
2017-07-10 09:54:08 -07:00
Mars Lan
5a999f29b1 Revert "Split the root build script into multiple scripts."
This reverts commit 4b8a6f86577739209b09ec8cc8cb09c2808f4aa7.
2017-07-10 09:54:08 -07:00
Mars Lan
edf5c54de3 Split the root build script into multiple scripts.
Add support for coveralls.
2017-07-10 09:54:08 -07:00
Mars Lan
e36a40cd65 Generate code coverage reports (#334)
* Add playCoverage task to run code coverage using JaCoco for backend and web.

* Add jacocoTestReport task to run code coverage for testNG-based tests in wherehows-common & metadata-etl.
2017-07-10 09:53:28 -07:00
Shuya Tsukamoto
e0f324c8e4 Implement ParquetFileAnalyzer for hadoop-dataset-extractor-standalone (#483)
* Implement ParquetFileAnalyzer for hadoop-dataset-extractor-standalone

* Move location

* Update build.gradle
2017-05-04 10:08:51 -07:00
Eric Sun
7b36d09b58 Add get_schema_literal_from_url() to fetch schema literal based on schema url (#268)
* use schema_url_helper to fetch avro schema from hdfs or http location

* trim space

* add dfs.namenode.kerberos.principal.pattern; include htrace for SchemaUrlHelper
2016-11-07 08:14:45 -08:00
Yi Wang
664e4072bb Upgrade to play 2.4.8 2016-10-19 17:42:28 -07:00
Yi Wang
5049c847fa Update Kafka consumer actors to reduce memory usage 2016-10-10 14:49:14 -07:00
Eric Sun
1cd5872369 temp fix for hdfs_schema_crawler getRuntime().exec() hangs problem; exclude log4j 2016-08-03 15:50:00 -07:00
Eric Sun
67479eac58 log_dataset_instance_load_status 2016-08-01 13:00:39 -07:00
Yi Wang
6d4706bc62 Ingest Gobblin tracking events into wherehows using Kafka consumer client 2016-07-25 15:03:29 -07:00
jbai
e8ee8897e4 change the akka dependency to version 2.2.5 2016-07-11 11:18:52 -07:00
jbai
442b39ca2f change the akka version to 2.3.5 to fix the no such method issue 2016-07-01 15:14:20 -07:00
Eric Sun
35fe1532be more excludes for [licenseFormatMain] task 2016-06-28 23:28:06 -07:00
Eric Sun
1573fdb212 rename hive dependency to hive_exec; reuse metadata-etl/extralibs; test travis ci; 2016-06-28 18:03:02 -07:00
Eric Sun
56cebd0d9c add dict_dataset_instance and cfg_object_name_map to track dataset on multiple clusters and their replication dependency and view dependency 2016-06-22 19:40:05 -07:00
Rafal Kluszczynski
b28f7d924f adding gradle wrapper instead of manually downloded gradle distribution 2016-05-16 14:58:28 +02:00
SunZhaonan
4b3b344b96 enable travis 2016-03-15 16:20:04 -07:00
SunZhaonan
b5d7c38b7d Eclipse integration. Resolve circular dependency. wherehows-common-test configure. 2016-02-09 15:50:49 -08:00
SunZhaonan
0eddd8accf close connection appropriatly, minior fix 2015-12-21 12:07:08 -08:00
SunZhaonan
05d54b3070 Add Hive metadata ETL process 2015-12-21 12:07:08 -08:00
Zhen Chen
d6f77a6f06 fix ldap org hierachy is empty bug and minor changes 2015-12-16 17:01:55 -08:00
Zhen Chen
af04ff6efc add git file commit history etl 2015-12-11 11:02:29 -08:00
SunZhaonan
b83c0a4322 Exclude tests that need configurations 2015-11-19 14:56:20 -08:00
SunZhaonan
d5c3d87d00 Initial commit 2015-11-19 14:39:21 -08:00