Yi (Alan) Wang
5808179017
Increase play http parser buffer size to 10MB ( #555 )
2017-07-10 13:44:33 -07:00
Seyi Adebajo
08e12d886f
fixes issue with file upload of compliance json on save attempt
2017-07-10 13:44:33 -07:00
Yi (Alan) Wang
98ffbfb65f
track last modified person of compliance info ( #554 )
2017-07-10 13:44:33 -07:00
Mars Lan
ea1a11d01c
Add settings dataset-level tag. ( #549 )
2017-07-10 13:44:33 -07:00
Mars Lan
90f59d23eb
Replace tooltip for ID types with link to Wiki. ( #548 )
2017-07-10 13:44:33 -07:00
Seyi Adebajo
c91ca85a90
updates the behaviour for custom identifier types to set a default classification
2017-07-10 13:44:33 -07:00
Mars Lan
53a30d5a77
Major refactoring of ETL scheduling & configuration ( #542 )
...
* Major refactoring
- Move job-spcific properties from wh_etl_job_property table to .job files
- Use the job file name instead of numeric IDs to identify ETL jobs
- Use reflection to create ETL job class at run time instead of relying hard-coded enums
- Drop ETL job-related APIs as they're no longer needed
- Drop wh_etl_job, wh_etl_job_property, wh_etl_job_execution tables
- Add wh_etl_schedule & wh_etl_history tables
2017-07-10 13:44:33 -07:00
Seyi Adebajo
9ea4545db5
updates file upload to autosave policy if checks pass
2017-07-10 13:43:00 -07:00
Seyi Adebajo
e2cf19a46a
adds support for custom id in dataset compliance. adds divider for none type in options list. adds edit mode.
2017-07-10 13:43:00 -07:00
Seyi Adebajo
c3a53b4f0b
adds support to disable options on select. removes lowercase transformation on string option values: consumer responsibility
2017-07-10 13:43:00 -07:00
Yi (Alan) Wang
50c1901890
Add dataset name convert for dalids and hive ( #538 )
...
* Add dataset name convert for dalids and hive
* Update javadoc for dataset name convert
2017-07-10 13:43:00 -07:00
Seyi Adebajo
b7895fe5bb
fixes wrong reference to new policy flag. fixes missing model name in downloaded json file.
2017-07-10 13:43:00 -07:00
Seyi Adebajo
c3de4a5ff7
adds feature to download a compliance policy as a json document. upload as json and apply to policy. performs attribute type assertions on values in uploaded policy
2017-07-10 13:43:00 -07:00
Mars Lan
30f9bf28b2
Filter out HDFS datasets with "temporary" in path name. ( #537 )
...
Treat "_" as a word boundary.
2017-07-10 13:43:00 -07:00
Mars Lan
8411e220a4
Actually write properties to dict_dataset table. ( #529 )
...
Temporariliy disable the broken updateKafkaDatasetOwner call.
Add extra blacklist pattern.
2017-07-10 13:43:00 -07:00
Yi (Alan) Wang
445a574a87
Change compliance column type to MEDIUMTEXT ( #530 )
2017-07-10 13:43:00 -07:00
Seyi Adebajo
d7a5b425ff
updates compliance wording on tooltips and updates links
2017-07-10 13:43:00 -07:00
Seyi Adebajo
287796b933
refactors nonIdFieldLogicalTypes decoupling stored representation from presentational values
2017-07-10 13:43:00 -07:00
Mars Lan
b486f7ee38
Extract and set dataset name correctly from Gobblin metadata audit event. ( #526 )
2017-07-10 13:42:59 -07:00
Seyi Adebajo
8ab2ce9252
fixes issue with tracking current user immediately after login: moves user tracking to index from application. adds session invalidation when retrieving the current user fails. slightly refactors logout
2017-07-10 13:42:59 -07:00
Seyi Adebajo
23c1ff5d78
removes obsolete confidential feature component sources
2017-07-10 13:42:59 -07:00
Mars Lan
d3a92b7d2c
Expand GobblinTrackingAuditProcessor to handle metadata audit events. ( #521 )
...
* Expand GobblinTrackingAuditProcessor to handle metadata audit events.
* Fix formating
2017-07-10 13:42:59 -07:00
Seyi Adebajo
3233fb91e4
adds default value for mixed identifier types. disabled field format select for mixed identifier types. removes geolocation from field format options. updates defaulting logic for mixed types
2017-07-10 13:42:59 -07:00
Seyi Adebajo
22625a119b
adds prettier precommit hook for app js files
2017-07-10 13:42:59 -07:00
Yi (Alan) Wang
fcbde02b37
Stop fetching EI/DEV-only Espresso DB ( #522 )
2017-07-10 13:42:59 -07:00
Seyi Adebajo
86570c7ca8
fixes debouncing issue: invalid function referencing
2017-07-10 13:42:59 -07:00
Seyi Adebajo
4a66c1313a
lines left over from last commit: adds urn as singular option for mixed type
2017-07-10 13:42:59 -07:00
Seyi Adebajo
56417b2347
adds browser confirmation dialog for unformatted non-id fields pending mocks and time. sorts options for non-id field formats. splits ge location option. restricts field format to urn for mixed identifier type.
2017-07-10 13:42:59 -07:00
Seyi Adebajo
fbaf681f68
fixes issue with updating classification for identifier fields with dot notation syntax in the field name
2017-07-10 13:42:59 -07:00
Seyi Adebajo
aa7d06a277
fixes issue with updating field logical type on compliance
2017-07-10 13:42:59 -07:00
Seyi Adebajo
ddc171e424
add ownership notification dot for unconfirmed number of owners
2017-07-10 13:42:58 -07:00
Seyi Adebajo
70c6968e49
adds missing x-editable dep for bower.json
2017-07-10 13:42:58 -07:00
Seyi Adebajo
fafb7d501f
removes support for datasetUrn from new policy creation. changes find by username to search by full name. fixes issues with null properties on compliance policy. add styling to reduce visibility of semi-hidden select
2017-07-10 13:42:58 -07:00
Seyi Adebajo
d3a26adcd7
adds support for passing datasetUrn on new compliance policy creation. fixes ui rendering issue with notification.
2017-07-10 13:42:58 -07:00
Seyi Adebajo
0da21378fe
updates dataset-compliance compliance component. adds notification component styles. fixes complianceEntities key name
2017-07-10 13:42:58 -07:00
Seyi Adebajo
c76487c167
updates pii data collection feature: single tab for compliance and confidential, renamed to compliance. moved closer to ownership tab. add notification dot for tab requiring user attention. moved action bar to fixed position at bottom of screen. removed app footer. myriad styling changes. etc
2017-07-10 13:42:58 -07:00
Seyi Adebajo
a9c622c832
adds browse feature for flows and metrics
2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
5dede95d9d
Modify privacy API to access dataset_compliance table ( #513 )
2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
b2736e281b
Create dataset_compliance table to combine compliance and security ( #512 )
2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
bc49f8a354
Security API classification field format change ( #511 )
2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
927a4ad5e2
Add frontend privacy API to combine compliance and security ( #510 )
2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
675dadd374
Kafka ETL to fetch queuing pipeline, also add topic blacklist ( #509 )
2017-07-10 13:42:57 -07:00
Yi (Alan) Wang
225d1fc6ec
Modify HIVE ETL to commit often ( #505 )
2017-07-10 13:42:57 -07:00
Yi (Alan) Wang
35bc64f8d2
Backend scheduler add job timeout ( #503 )
2017-07-10 13:42:57 -07:00
Na Zhang
3dd2be0106
support refine by multiple sources using ES filter
2017-07-10 13:42:57 -07:00
Seyi Adebajo
f64e674b50
fix: identifierType has a different definition for compliance policy than for confidential spec: api borrows thme schema but this field is not needed for confidential spec
2017-07-10 13:42:57 -07:00
Seyi Adebajo
0eeee4a087
fixes superfluous classification field addition from ui
2017-07-10 13:42:57 -07:00
Seyi Adebajo
29acbcfc3f
fixes issue with unrecognized field: renames dataType -> identifierType
2017-07-10 13:42:57 -07:00
Seyi Adebajo
7c814ab15d
updates field format sort order for confidential spec. removes unused code from router page tracking method
2017-07-10 13:42:57 -07:00
Seyi Adebajo
d8d3d28170
moves .eslintrc to wherehows-web dir.
2017-07-10 13:42:57 -07:00
