12076 Commits

Author SHA1 Message Date
jerrybai2009
e7c7175cba Merge pull request #188 from jerrybai2009/master
load the teradata and hadoop data into table dict_dataset_instance
2016-08-03 18:13:06 -07:00
Eric Sun
ca7542ca40 remove duplicate section 2016-08-03 17:52:49 -07:00
Eric Sun
53d40c8392 add a few new hdfs directory patterns 2016-08-03 16:16:58 -07:00
Eric Sun
1cd5872369 temp fix for hdfs_schema_crawler getRuntime().exec() hangs problem; exclude log4j 2016-08-03 15:50:00 -07:00
jerrybai2009
42431fea4b Merge pull request #192 from ericsun2/master
add log_dataset_instance_load_status
2016-08-01 15:07:06 -07:00
Eric Sun
8c9cb99ba4 primary_dataset_type for cfg_database 2016-08-01 13:20:04 -07:00
Eric Sun
67479eac58 log_dataset_instance_load_status 2016-08-01 13:00:39 -07:00
Eric Sun
3553ad6a38 Merge pull request #189 from ericsun2/master
add python module [requests] for simple REST client
2016-07-29 23:17:28 -07:00
Eric Sun
6355ccc039 add python module [requests] for simple REST client 2016-07-29 23:10:33 -07:00
jbai
ea1ac0da9f load the teradata and hadoop data into table dict_dataset_instance 2016-07-29 10:59:33 -07:00
Eric Sun
9d2c803f0c Merge pull request #187 from ericsun2/master
Add datacenter, deploymenttier, cluster info to better describe dataset instance
2016-07-28 17:22:32 -07:00
Eric Sun
6f32bae81a Merge pull request #186 from alyiwang/master
Add basic Oracle dataset metadata ETL job
2016-07-28 17:21:59 -07:00
jerrybai2009
32d5b7b3df Merge pull request #184 from jerrybai2009/master
merge the commit of wherehows datasets properties styling
2016-07-28 17:21:07 -07:00
Eric Sun
50c222d478 Avro schema for Kafka topics 2016-07-28 16:55:47 -07:00
Eric Sun
f745642212 add datacenter, deploymenttier, cluster to describe dataset instance 2016-07-28 16:38:03 -07:00
Yi Wang
74ed769bab add Oracle dataset metadata ETL job 2016-07-28 14:07:07 -07:00
jbai
6d9d571ed3 merge the commit of wherehows datasets properties styling 2016-07-27 16:44:18 -07:00
jerrybai2009
6eae923387 Merge pull request #183 from jerrybai2009/master
update the dataset versions when selected instance changed
2016-07-27 16:41:04 -07:00
jbai
6a1f6e6654 fix the cross web browser issue of button text 2016-07-26 18:23:14 -07:00
jbai
c1d6d8fd68 update the backgroud the version and instance buttons 2016-07-26 17:23:15 -07:00
jbai
85bc2db85c add try catch to catch the exception when reading the config properties 2016-07-26 16:53:30 -07:00
jbai
c0f261190b update the dataset versions when selected instance changed 2016-07-26 16:50:27 -07:00
Yi (Alan) Wang
4b1903abee Merge pull request #179 from alyiwang/master
Ingest Gobblin tracking events into wherehows by Kafka consumer client
2016-07-26 14:13:25 -07:00
Yi Wang
629eb04d92 Merge branch 'master' of https://github.com/linkedin/WhereHows 2016-07-26 12:22:47 -07:00
Yi Wang
7edacc9a9f get kafka config from wh_etl_job_property 2016-07-26 12:16:34 -07:00
jerrybai2009
e0dc182377 Merge pull request #181 from jerrybai2009/master
fix the issue which dataset api returns empty schema when user is not logged in
2016-07-26 11:16:46 -07:00
jbai
cbedae7916 fix the issue which dataset api returns empty schema when user is not logged in 2016-07-26 10:46:05 -07:00
jerrybai2009
27e3962a6f Merge pull request #180 from jerrybai2009/master
show dataset instance when it is availalbe
2016-07-26 10:37:40 -07:00
jbai
6de4945478 show dataset instance when it is availalbe 2016-07-25 17:19:12 -07:00
Yi Wang
6d4706bc62 Ingest Gobblin tracking events into wherehows using Kafka consumer client 2016-07-25 15:03:29 -07:00
jbai
97a68b9291 update the dataset schema json view as selected version of dataset changed 2016-07-22 16:06:24 -07:00
jbai
0f5124579c fix the issue of datasetSchemaRecord expected 11 args but got 9 2016-07-21 17:39:22 -07:00
jbai
bafb45f3b1 update the get relations code since info stored by version instead of dataset 2016-07-21 16:21:46 -07:00
jbai
7a77aba4b7 merge the pull request 165 to master branch 2016-07-21 10:38:36 -07:00
Eric Sun
0b1a7a444d Merge pull request #175 from nvemuri1/master
Query Dataset properties to retrieve datasetUrns
2016-07-21 07:48:29 -07:00
Naga Srinivas Vemuri
97370ed2e1 Query Dataset properties to retrieve datasetUrns 2016-07-21 11:54:47 +05:30
jerrybai2009
c952624a1d Merge pull request #174 from jerrybai2009/master
update dependency property name and fix the duplicated key issue
2016-07-20 19:09:45 -07:00
jbai
9fb5b09bd2 update dependency property name and fix the duplicated key issue when update cfg_object_name_map table 2016-07-20 19:07:16 -07:00
jerrybai2009
45f333a27e Merge pull request #173 from jerrybai2009/master
tracking the dalids schema and expanded text by versions
2016-07-20 18:04:03 -07:00
jbai
f3c299480f update the column names from schema to schema_text and view_expanded_text to ddl_text 2016-07-20 18:01:25 -07:00
jbai
33b05cde4b tracking the dalids schema and expanded text by versions 2016-07-20 15:59:11 -07:00
jerrybai2009
ad4ba5f005 Merge pull request #171 from jerrybai2009/master
implemented the referred by feature for dataset detail
2016-07-20 15:13:35 -07:00
jbai
0264ad3e3d implemented the referred by feature for dataset detail 2016-07-19 10:48:38 -07:00
jerrybai2009
e3b4b1bfc4 Merge pull request #170 from jerrybai2009/master
Show available versions for dataset
2016-07-18 15:49:46 -07:00
jbai
ff599a88f5 add the unit test for api getDatasetVersions 2016-07-18 10:58:10 -07:00
jbai
ceb623f30e show available versions for dataset 2016-07-18 10:54:32 -07:00
jerrybai2009
adc7b2fb65 Merge pull request #169 from jerrybai2009/master
update the sql query to improve the page loading performance
2016-07-14 22:14:38 -07:00
jbai
657e80c0da reimplemented the flow ember routing to workaroud the ember issue 2016-07-14 21:15:56 -07:00
jbai
ddaffe43c6 fix the count issue after change the sql 2016-07-13 10:59:00 -07:00
jbai
f174a90947 update the sql query to improve the page loading performance 2016-07-12 18:21:04 -07:00