12076 Commits

Author SHA1 Message Date
Seyi Adebajo
fbaf681f68 fixes issue with updating classification for identifier fields with dot notation syntax in the field name 2017-07-10 13:42:59 -07:00
Seyi Adebajo
aa7d06a277 fixes issue with updating field logical type on compliance 2017-07-10 13:42:59 -07:00
Seyi Adebajo
ddc171e424 add ownership notification dot for unconfirmed number of owners 2017-07-10 13:42:58 -07:00
Seyi Adebajo
70c6968e49 adds missing x-editable dep for bower.json 2017-07-10 13:42:58 -07:00
Seyi Adebajo
fafb7d501f removes support for datasetUrn from new policy creation. changes find by username to search by full name. fixes issues with null properties on compliance policy. add styling to reduce visibility of semi-hidden select 2017-07-10 13:42:58 -07:00
Seyi Adebajo
d3a26adcd7 adds support for passing datasetUrn on new compliance policy creation. fixes ui rendering issue with notification. 2017-07-10 13:42:58 -07:00
Seyi Adebajo
0da21378fe updates dataset-compliance compliance component. adds notification component styles. fixes complianceEntities key name 2017-07-10 13:42:58 -07:00
Seyi Adebajo
c76487c167 updates pii data collection feature: single tab for compliance and confidential, renamed to compliance. moved closer to ownership tab. add notification dot for tab requiring user attention. moved action bar to fixed position at bottom of screen. removed app footer. myriad styling changes. etc 2017-07-10 13:42:58 -07:00
Seyi Adebajo
a9c622c832 adds browse feature for flows and metrics 2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
5dede95d9d Modify privacy API to access dataset_compliance table (#513) 2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
b2736e281b Create dataset_compliance table to combine compliance and security (#512) 2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
bc49f8a354 Security API classification field format change (#511) 2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
927a4ad5e2 Add frontend privacy API to combine compliance and security (#510) 2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
675dadd374 Kafka ETL to fetch queuing pipeline, also add topic blacklist (#509) 2017-07-10 13:42:57 -07:00
Yi (Alan) Wang
225d1fc6ec Modify HIVE ETL to commit often (#505) 2017-07-10 13:42:57 -07:00
Yi (Alan) Wang
35bc64f8d2 Backend scheduler add job timeout (#503) 2017-07-10 13:42:57 -07:00
Na Zhang
3dd2be0106 support refine by multiple sources using ES filter 2017-07-10 13:42:57 -07:00
Seyi Adebajo
f64e674b50 fix: identifierType has a different definition for compliance policy than for confidential spec: api borrows thme schema but this field is not needed for confidential spec 2017-07-10 13:42:57 -07:00
Seyi Adebajo
0eeee4a087 fixes superfluous classification field addition from ui 2017-07-10 13:42:57 -07:00
Seyi Adebajo
29acbcfc3f fixes issue with unrecognized field: renames dataType -> identifierType 2017-07-10 13:42:57 -07:00
Seyi Adebajo
7c814ab15d updates field format sort order for confidential spec. removes unused code from router page tracking method 2017-07-10 13:42:57 -07:00
Seyi Adebajo
d8d3d28170 moves .eslintrc to wherehows-web dir. 2017-07-10 13:42:57 -07:00
Mars Lan
d75ae54b4b Rename data-model to wherehows-data-model. (#492) 2017-07-10 13:42:57 -07:00
Seyi Adebajo
7d07ab76b3 adds question numbers for confidential tab 2017-07-10 13:42:57 -07:00
Seyi Adebajo
f5210a9953 disables save on confidential if all datasets content types don't have a boolean value 2017-07-10 13:42:57 -07:00
Mars Lan
5f5c0937d1 Rename web, backend-service (#490)
* Rename web to wherehows-api and update README.

* Rename backend-service to wherehows-backend

* Rename metadata-etl to wherehows-etl

* Rename hadoop-dataset-extractor-standalone to wherehows-hadoop
2017-07-10 13:42:56 -07:00
Seyi Adebajo
9f6f094af7 fix navigation when the browse route is not a browse.entity route 2017-07-10 13:42:56 -07:00
Seyi Adebajo
ad3b51d4fa updates afteramodel method comment 2017-07-10 13:42:56 -07:00
Seyi Adebajo
91fe71416a adds a byName key for metrics that are indexed and retrieved by the metric name 2017-07-10 13:42:56 -07:00
Seyi Adebajo
b0d8227cc3 fixes incorrect default transition to datasets entity on browse.entity route entry 2017-07-10 13:42:56 -07:00
Na Zhang
148e1d650c update Elastic Search index mapping info 2017-07-10 13:42:56 -07:00
Seyi Adebajo
af7e323d02 updates dataset tag link for gdpr section in confidential component 2017-07-10 13:42:56 -07:00
Mars Lan
b4fec37f61 Fix Kerberos authentication so that HIVE_DATASET_METADATA_ETL jobs can be run from non-grid cluster. (#482) 2017-07-10 13:42:56 -07:00
Seyi Adebajo
7db7be2c8f updates class name for dataset classification icons 2017-07-10 13:42:55 -07:00
Seyi Adebajo
5af9087835 updates text for unspecified logical types to Not Specified 2017-07-10 13:42:55 -07:00
Seyi Adebajo
e8211fe07c fixes integration issue with api: default value for datasetClassification is null 2017-07-10 13:42:55 -07:00
Seyi Adebajo
bdcda17439 updates spacing in ember-radio 2017-07-10 13:42:55 -07:00
Seyi Adebajo
d9eb5c4d11 updates security specification on datasets to obtain data for gdpr related to each dataset 2017-07-10 13:42:55 -07:00
Yi (Alan) Wang
8388d41fa1 Add dataset_classification to frontend security API (#481) 2017-07-10 13:42:55 -07:00
Seyi Adebajo
c74858b198 fixes navigating to datasets from rail: numbers were previously excluded from parsed string. DRY's urn regex 2017-07-10 13:42:55 -07:00
Seyi Adebajo
d008767304 updates the list of field data types: removes member, group, and company related fields 2017-07-10 13:42:55 -07:00
Seyi Adebajo
9188bad175 adds an infromational notification for the user if the dataset does not have a compliance policy or securty classification 2017-07-10 13:42:55 -07:00
Seyi Adebajo
1086257908 updates fallback format for dataset-author component. removes obsolete sources from build step 2017-07-10 13:42:55 -07:00
Seyi Adebajo
3bbb12a4f8 updates breadcrumbs sass component rules. creates nacho component for breadcrumbs. 2017-07-10 13:42:55 -07:00
Na Zhang
4cf65fe57c retrieve source modification time for hive and dalids 2017-07-10 13:42:55 -07:00
Seyi Adebajo
0e0f3fd69a updates informational text on ownership tab 2017-07-10 13:42:55 -07:00
Seyi Adebajo
0d16f47e32 adds @symbol for email links and styling. new tab for email links 2017-07-10 13:42:54 -07:00
Seyi Adebajo
fbacf6ea9a updates datasets security classification question 2017-07-10 13:42:54 -07:00
Seyi Adebajo
a08730b0df implements default classification for data fields. creates constants for metadata-acquisition. refactors datasets utils function to export default module. updates column ordering for security classification table. 2017-07-10 13:42:54 -07:00
Seyi Adebajo
b8532abcf6 breadcrumbs for datasets. creates util modules to building urns and validating them. known issue with last item in breadcrumbs for urns should probably not be a link 2017-07-10 13:42:54 -07:00