12004 Commits

Author SHA1 Message Date
Mars Lan
03ba2bc85e Move license header to wherehows-docs & update documentation (#698)
Fix license checking for Play-based projects and fix violated files
2017-08-22 21:32:53 -07:00
Yi (Alan) Wang
4b30623fa0 Convert DatasetOwner to entity and add copy constructor (#696) 2017-08-22 17:47:56 -07:00
Mars Lan
bf5448d561 Replace db.id & app.id property keys with the existing job.ref.id key (#695) 2017-08-22 17:39:10 -07:00
Shridhar Sattur
60914f6782 Converting DatasetOwner to hibernate entity (#697) 2017-08-22 16:10:20 -07:00
Shridhar Sattur
5b8e40ab84 Converting Flow model to hibernate (#685)
* Converting one of the wherehows-frontend model to hibernate

* Converting few models and UserDAO to use hibernate

* Converting Flow model to hibernate
2017-08-22 10:55:29 -07:00
Yi (Alan) Wang
68590fbcb8 Return milliseconds in Owners and Compliance API (#691) 2017-08-21 17:00:05 -07:00
wenhuaOpenx
f7ec09e19a Add etl job to extract/load druid metadata (#680)
* test

* test

* add druid etl code

* remove comments

* remove comments

* remove test doc"

* add job template for DRUID_METADATA_ETL

* add druid metadata etl configs to local_test.properties.template

* refactor logger

* remove comments

* fix typos

* add unit test for druid metadata etl job

* refactor unit test code

* import testgn package

* import new package

* reformat the druid etl code based on LinkedIn code style

* add README for druid metadata etl

* add README for druid metadata etl

* add README for druid metadata etl
2017-08-21 16:34:49 -07:00
Seyi Adebajo
fe68825391 removes s->ms conversion from timestamps in ownership and compliance features. removes mirage deploy for dev env 2017-08-21 15:22:28 -07:00
Seyi Adebajo
e6e753e569 Merge pull request #689 from theseyi/auto-suggestions
Auto suggestions
2017-08-21 10:05:45 -07:00
na zhang
f5774314b6 Merge pull request #683 from camelliazhang/master
support dataset urn search
2017-08-21 10:03:44 -07:00
Seyi Adebajo
4ca9433186 splits compliance questions into separate partials 2017-08-20 20:58:19 -07:00
Seyi Adebajo
79854ab9ae updates the edit view. adds hasRecentSuggestions flag for compliance metadata. refactors suggestions getter to include lastModified date. 2017-08-20 20:23:56 -07:00
Seyi Adebajo
9bbf77fe99 adds feature to show all potential member data fields in readonly mode, filters to contained member data fields by default. 2017-08-20 18:53:01 -07:00
Seyi Adebajo
ef1c1df63b mark all as no 2017-08-20 18:12:56 -07:00
Yi (Alan) Wang
47b1799a0c Modify compliance DAO (#688) 2017-08-20 17:32:23 -07:00
Seyi Adebajo
b5b2b2b8ba updates sytles and text for json uploader component. updates member data component styles 2017-08-20 16:46:43 -07:00
Seyi Adebajo
0ba5315a6c Merge pull request #686 from theseyi/auto-suggestions
Auto suggestions:  initial core behavior implementation
2017-08-18 15:40:56 -07:00
Jennifer Zheng
a7581d30ed Changing hive_exec dependency to :core (#687) 2017-08-18 15:25:42 -07:00
Seyi Adebajo
ef4e304862 reinstates babel polyfill inclusion for js sources. adds allowJs flag 2017-08-18 15:05:35 -07:00
Seyi Adebajo
df4112f868 adds handler implementation for suggestion action. refactoers dataset controller reference to compliance api. 2017-08-18 14:43:14 -07:00
Seyi Adebajo
6543eca32c adds compliance action buttons to affirm or discard suggestions 2017-08-18 14:43:14 -07:00
Seyi Adebajo
0d49e59392 updates Metadata Compliance dataType constants to match approved values. removes babel polyfill from build output. removes jshint pragma from envirnment js: current linter is eslint 2017-08-18 14:43:14 -07:00
Seyi Adebajo
13757cf37b partially implements auto-suggestions feature. minor refactoring. adds typdef fir mirage route handlers. deletes unused dataset-schema-table component. adds mirage route handler for compliance api suggestions. updates compliance table to show suggestions. 2017-08-18 14:43:14 -07:00
Seyi Adebajo
080e140637 Merge pull request #679 from theseyi/suggestions
adds api request for suggestions. adds types for api and suggestions.
2017-08-18 14:21:23 -07:00
Mars Lan
5120bcc686 Update coding-guidelines.md 2017-08-18 10:48:30 -07:00
Mars Lan
d57b0160ff Move coding guideline from wiki to MD
Add idea style file
2017-08-18 10:46:40 -07:00
Yi (Alan) Wang
8866ac0ff1 Modify frontend owners DAO functions (#684) 2017-08-17 22:08:06 -07:00
Na Zhang
0d481a2539 support dataset urn search 2017-08-17 14:10:29 -07:00
Yi (Alan) Wang
0bdd1d6c74 Mark transient field for hibernate to fix mapping issue (#682) 2017-08-17 09:11:46 -07:00
Yi (Alan) Wang
28b83b8e7b Add BaseJob in wherehows-common, make ETLjob extends from it (#681) 2017-08-16 21:24:38 -07:00
Shridhar Sattur
cc1699761e Converting CompanyUser model to hibernate entity (#670)
* Converting one of the wherehows-frontend model to hibernate

* Converting few models and UserDAO to use hibernate
2017-08-16 21:24:01 -07:00
na zhang
336b750d17 Merge pull request #677 from camelliazhang/master
ump metric ETL
2017-08-16 17:16:46 -07:00
Na Zhang
ca34cd920d ump metric ETL 2017-08-16 16:43:46 -07:00
Seyi Adebajo
8494e4bf2b adds api request for suggestions. adds interfaces. 2017-08-16 13:29:13 -07:00
Seyi Adebajo
47e986e237 Merge pull request #676 from theseyi/master
supports new compliance api. dependency updates. misc changes
2017-08-16 13:22:30 -07:00
Yi (Alan) Wang
93ebe430b5 Move Dataset owner DAO to wherehows-dao (#675) 2017-08-16 10:42:42 -07:00
Seyi Adebajo
4d0d746fe3 adds typescript. adds mirage. updates dependencies. begins separating api concerns from app: datasets. removes jshint.
adds mirage model+factory for compliance suggestion

updates gitignore: removes typings. adds environment.d.ts declaration file for config/environment. adds unit test for datasets-test. adds extracted datasets api file

updates destroy app test helper

updates compliance component to work with modified api from compliance api: removes isSubject, adds securityClassification

updates uploaded compliance shape validation. updates the dataset route

adds typescript files to prettier linting

updates gitignore with vscode
2017-08-16 10:04:36 -07:00
Yi (Alan) Wang
ab31c4706e Update Dataset compliance DAO (#674) 2017-08-16 08:59:22 -07:00
Yi (Alan) Wang
6c8a8ce567 Change static final naming in Dataset.java, reformat code (#672) 2017-08-15 16:59:41 -07:00
Yi (Alan) Wang
2ec25b3ef1 Add compliance/suggestions API to get auto-classification data (#671) 2017-08-15 14:29:31 -07:00
Mars Lan
ed5d662111 Remove outdated/internal ETLs (#669) 2017-08-14 16:00:45 -07:00
hzhang2
4eabd773d2 skip empty classify result DB insertion (#668) 2017-08-14 15:09:38 -07:00
Mars Lan
826cdae9d8 Fix: skip Jython execution if no script is defined for transform & load stages (#667) 2017-08-14 09:56:50 -07:00
Mars Lan
0637578aa6 Remove deprecated code (#666) 2017-08-11 16:45:50 -07:00
Mars Lan
c34193371b Put more emphasis on the ownership requirement. (#665) 2017-08-11 12:24:47 -07:00
Mars Lan
6153565968 Add missing DDLs for LDAP-related ETL. (#664) 2017-08-11 11:41:40 -07:00
Yi (Alan) Wang
3479180ca3 Fix DAO Factory config name error, refactor some code (#658) 2017-08-10 18:13:59 -07:00
Mars Lan
4b4cae2148 Add base class for all pure jython ETLs (#663) 2017-08-10 17:40:19 -07:00
hzhang2
d22b975755 fix a DB insert issue, reporting missing a column (#662) 2017-08-10 17:36:10 -07:00
Yi (Alan) Wang
3a4acd1d99 Modify Compliance entity fields (#656) 2017-08-10 10:31:19 -07:00