1664 Commits

Author SHA1 Message Date
Yi (Alan) Wang
5e0d2c01cf Fix Oracle ETL job, rewrite data sampling (#612) 2017-07-24 11:11:03 -07:00
Mars Lan
e77647db3f Update README.md 2017-07-21 17:32:18 -07:00
Mars Lan
3090d97beb Convert architecutre wiki to MD (#611) 2017-07-21 17:24:40 -07:00
Mars Lan
bf68557ab0 Convert use case docs from wiki to MD. (#610) 2017-07-21 16:21:26 -07:00
Mars Lan
98bff89ba8 Add initial road map doc. (#608) 2017-07-21 16:13:09 -07:00
hangzhang925
5a6603596e update getting-started link in README doc (#609) 2017-07-21 16:09:50 -07:00
Mars Lan
48848751ab Use go-links to track internal web pages. (#607) 2017-07-20 11:10:01 -07:00
Yi (Alan) Wang
6a8fe66ef9 Add active, deprecated flag to dataset, modify ETL to update is_active (#604) 2017-07-19 17:07:28 -07:00
Mars Lan
47393d486b Migrate contributing doc from wiki to MD. (#603) 2017-07-19 15:52:58 -07:00
Mars Lan
0d44ab6bb9 Update README.md 2017-07-19 14:06:53 -07:00
Mars Lan
51db714bb2 Delete .gitignore 2017-07-19 10:53:52 -07:00
Mars Lan
e2389a399c Update .gitignore 2017-07-19 10:53:34 -07:00
Seyi Adebajo
ee049d565b Merge pull request #600 from theseyi/dupes
fixes issue with dupes in saved compliance entities list: ensures tha…
2017-07-19 08:21:01 -07:00
Mars Lan
8ec6fce5a7 Convert & update the Getting Started Wiki to MD. (#602) 2017-07-18 17:31:05 -07:00
Seyi Adebajo
d4d1427c8a renames computed prop name. updates styles for error notification. begins steps to improve performance on compliance tab. 2017-07-18 17:09:43 -07:00
Yi (Alan) Wang
3138185068 Remove some LinkedIn specific ETL jobs (#601) 2017-07-18 16:39:45 -07:00
Mars Lan
3887c71c37 Rename readme.MD to README.md 2017-07-18 15:44:53 -07:00
Seyi Adebajo
638b45ad03 fixes issue with dupes in saved compliance entities list: ensures that the unformatted identifier fields do not contain fields already present in the previously saved or current compliance entities list 2017-07-18 15:07:22 -07:00
Mars Lan
1b23133d44 Rename Readme.md to README.md 2017-07-17 20:08:09 -07:00
Mars Lan
b442bb693b Rename readme.md to Readme.md 2017-07-17 20:07:50 -07:00
Mars Lan
951f0571bc Update readme.md 2017-07-17 20:07:38 -07:00
Mars Lan
c025ba8494 Add template job config files. (#597) 2017-07-17 17:58:17 -07:00
Seyi Adebajo
328381ae3a Merge pull request #595 from theseyi/META-425
META-425 fixes json download failure in firefox
2017-07-14 17:22:55 -07:00
Mars Lan
38a72bb005 Add Travis check for docker build & compose. (#594)
Expose LDAP-related application.conf as env vars for wherehows-frontend.
2017-07-13 14:40:34 -07:00
Seyi Adebajo
ed13a4fecf META-425 fixes json download unresponsive in firefox 2017-07-13 12:28:54 -07:00
Mars Lan
ec0b5ac309 Fix and significatly simplify the docker build process. (#593) 2017-07-13 09:39:59 -07:00
Mars Lan
30d66454a3 Clean up travis setup. (#592) 2017-07-11 13:37:43 -07:00
Mars Lan
36288820b6 Remove orphan files due to bad merge. 2017-07-10 17:16:10 -07:00
Mars Lan
0d712c07d1 Update README.md 2017-07-10 17:14:34 -07:00
Mars Lan
cd80307463 Fix broken build due to bad merge. 2017-07-10 17:05:14 -07:00
Mars Lan
70f753d895 Update README.md 2017-07-10 16:56:36 -07:00
Mars Lan
120bd7c4bc Rename wherehows-api to wherehows-frontend to be consistent with the actual artifact. (#589) 2017-07-10 13:44:36 -07:00
Mars Lan
16a95e6ed5 Clean up LI-specific constants and code. (#588) 2017-07-10 13:44:35 -07:00
Mars Lan
c7b6fd1688 Move TMS restli related code out of open source. (#587)
Add skeleton for a generalized DAO framework.
2017-07-10 13:44:35 -07:00
Mars Lan
86b815eadf Fix broken Travis build. 2017-07-10 13:44:35 -07:00
Mars Lan
bb5f483be9 Clean up comments and DDL for obsolete tables. (#586) 2017-07-10 13:44:35 -07:00
Mars Lan
a950cdbc1a Fix the bug where MySQL credential isn't properly passed to DatabaseWriter. (#585) 2017-07-10 13:44:35 -07:00
Mars Lan
8058734917 Fix the last few instances whewre username & password are specified via manual construction of url. (#584) 2017-07-10 13:44:35 -07:00
Mars Lan
deb98480a3 Completely retire wh_property table and associated codes. (#583) 2017-07-10 13:44:35 -07:00
Mars Lan
0e5e5685d7 Do not automatically kick off all jobs that yet have an entry in wh_etl_job_schedule table. (#582)
* Do not automatically kick off all jobs that yet have an entry in wh_etl_job_schedule table.
Instead simply schedule an entry and wait for its time to come.

* Make the ETL actor pool size configurable and set the default to something more conservative.
2017-07-10 13:44:35 -07:00
Mars Lan
33f49c5f55 Fix more places where connection URLs are manually constructed. (#579) 2017-07-10 13:44:35 -07:00
Mars Lan
af37b3c39f Rely on job file specifying kerberos.keytab.file using absolute path. (#578) 2017-07-10 13:44:35 -07:00
Mars Lan
932aca7f05 Call the correct method to create connection instead of buliding the connection string manually. (#577) 2017-07-10 13:44:35 -07:00
Mars Lan
770ac152e9 Refactor tree jobs to use job files. (#576) 2017-07-10 13:44:35 -07:00
Mars Lan
3f85b26d81 Drop the duplicated DB-related settings from wh_property table. (#575) 2017-07-10 13:44:35 -07:00
Mars Lan
9dca733d76 Move elastic-serach related props from wh_property table to job files. (#574)
This will break FlowTreeBuilder & DatasetTreeBuilder, both are not being used anyway.
2017-07-10 13:44:34 -07:00
Mars Lan
d2d92367f9 Also include TD table with O kind (no primary key) during ETL. (#571) 2017-07-10 13:44:34 -07:00
Mars Lan
e411aecf2b Missed another TD ut_ table filter. (#570) 2017-07-10 13:44:34 -07:00
Mars Lan
9f39f1f380 Remove the filter for TD ut_* tables as we do need the schema for them. (#569) 2017-07-10 13:44:34 -07:00
Yi (Alan) Wang
4f9f7fc513 Add a few more fields to frontend metric batch API (#567) 2017-07-10 13:44:34 -07:00