Yi (Alan) Wang
927a4ad5e2
Add frontend privacy API to combine compliance and security ( #510 )
2017-07-10 13:42:58 -07:00
Yi (Alan) Wang
675dadd374
Kafka ETL to fetch queuing pipeline, also add topic blacklist ( #509 )
2017-07-10 13:42:57 -07:00
Yi (Alan) Wang
225d1fc6ec
Modify HIVE ETL to commit often ( #505 )
2017-07-10 13:42:57 -07:00
Yi (Alan) Wang
35bc64f8d2
Backend scheduler add job timeout ( #503 )
2017-07-10 13:42:57 -07:00
Na Zhang
3dd2be0106
support refine by multiple sources using ES filter
2017-07-10 13:42:57 -07:00
Seyi Adebajo
f64e674b50
fix: identifierType has a different definition for compliance policy than for confidential spec: api borrows thme schema but this field is not needed for confidential spec
2017-07-10 13:42:57 -07:00
Seyi Adebajo
0eeee4a087
fixes superfluous classification field addition from ui
2017-07-10 13:42:57 -07:00
Seyi Adebajo
29acbcfc3f
fixes issue with unrecognized field: renames dataType -> identifierType
2017-07-10 13:42:57 -07:00
Seyi Adebajo
7c814ab15d
updates field format sort order for confidential spec. removes unused code from router page tracking method
2017-07-10 13:42:57 -07:00
Seyi Adebajo
d8d3d28170
moves .eslintrc to wherehows-web dir.
2017-07-10 13:42:57 -07:00
Mars Lan
d75ae54b4b
Rename data-model to wherehows-data-model. ( #492 )
2017-07-10 13:42:57 -07:00
Seyi Adebajo
7d07ab76b3
adds question numbers for confidential tab
2017-07-10 13:42:57 -07:00
Seyi Adebajo
f5210a9953
disables save on confidential if all datasets content types don't have a boolean value
2017-07-10 13:42:57 -07:00
Mars Lan
5f5c0937d1
Rename web, backend-service ( #490 )
...
* Rename web to wherehows-api and update README.
* Rename backend-service to wherehows-backend
* Rename metadata-etl to wherehows-etl
* Rename hadoop-dataset-extractor-standalone to wherehows-hadoop
2017-07-10 13:42:56 -07:00
Seyi Adebajo
9f6f094af7
fix navigation when the browse route is not a browse.entity route
2017-07-10 13:42:56 -07:00
Seyi Adebajo
ad3b51d4fa
updates afteramodel method comment
2017-07-10 13:42:56 -07:00
Seyi Adebajo
91fe71416a
adds a byName key for metrics that are indexed and retrieved by the metric name
2017-07-10 13:42:56 -07:00
Seyi Adebajo
b0d8227cc3
fixes incorrect default transition to datasets entity on browse.entity route entry
2017-07-10 13:42:56 -07:00
Na Zhang
148e1d650c
update Elastic Search index mapping info
2017-07-10 13:42:56 -07:00
Seyi Adebajo
af7e323d02
updates dataset tag link for gdpr section in confidential component
2017-07-10 13:42:56 -07:00
Mars Lan
b4fec37f61
Fix Kerberos authentication so that HIVE_DATASET_METADATA_ETL jobs can be run from non-grid cluster. ( #482 )
2017-07-10 13:42:56 -07:00
Seyi Adebajo
7db7be2c8f
updates class name for dataset classification icons
2017-07-10 13:42:55 -07:00
Seyi Adebajo
5af9087835
updates text for unspecified logical types to Not Specified
2017-07-10 13:42:55 -07:00
Seyi Adebajo
e8211fe07c
fixes integration issue with api: default value for datasetClassification is null
2017-07-10 13:42:55 -07:00
Seyi Adebajo
bdcda17439
updates spacing in ember-radio
2017-07-10 13:42:55 -07:00
Seyi Adebajo
d9eb5c4d11
updates security specification on datasets to obtain data for gdpr related to each dataset
2017-07-10 13:42:55 -07:00
Yi (Alan) Wang
8388d41fa1
Add dataset_classification to frontend security API ( #481 )
2017-07-10 13:42:55 -07:00
Seyi Adebajo
c74858b198
fixes navigating to datasets from rail: numbers were previously excluded from parsed string. DRY's urn regex
2017-07-10 13:42:55 -07:00
Seyi Adebajo
d008767304
updates the list of field data types: removes member, group, and company related fields
2017-07-10 13:42:55 -07:00
Seyi Adebajo
9188bad175
adds an infromational notification for the user if the dataset does not have a compliance policy or securty classification
2017-07-10 13:42:55 -07:00
Seyi Adebajo
1086257908
updates fallback format for dataset-author component. removes obsolete sources from build step
2017-07-10 13:42:55 -07:00
Seyi Adebajo
3bbb12a4f8
updates breadcrumbs sass component rules. creates nacho component for breadcrumbs.
2017-07-10 13:42:55 -07:00
Na Zhang
4cf65fe57c
retrieve source modification time for hive and dalids
2017-07-10 13:42:55 -07:00
Seyi Adebajo
0e0f3fd69a
updates informational text on ownership tab
2017-07-10 13:42:55 -07:00
Seyi Adebajo
0d16f47e32
adds @symbol for email links and styling. new tab for email links
2017-07-10 13:42:54 -07:00
Seyi Adebajo
fbacf6ea9a
updates datasets security classification question
2017-07-10 13:42:54 -07:00
Seyi Adebajo
a08730b0df
implements default classification for data fields. creates constants for metadata-acquisition. refactors datasets utils function to export default module. updates column ordering for security classification table.
2017-07-10 13:42:54 -07:00
Seyi Adebajo
b8532abcf6
breadcrumbs for datasets. creates util modules to building urns and validating them. known issue with last item in breadcrumbs for urns should probably not be a link
2017-07-10 13:42:54 -07:00
Seyi Adebajo
87048b9e23
removes moar legacy code
2017-07-10 13:42:54 -07:00
Seyi Adebajo
bfc2a26dcf
removes legacy advsearch
2017-07-10 13:42:54 -07:00
Seyi Adebajo
0673b723dc
updates feature-card to use non-fixed heights by leveraging an aspect ratio mixin
2017-07-10 13:42:54 -07:00
Seyi Adebajo
55d38d3bbf
adds styling to owner list component. small updates
2017-07-10 13:42:54 -07:00
Seyi Adebajo
5e51805584
adds nuage as restricted source in dataset-author component
2017-07-10 13:42:54 -07:00
Yi (Alan) Wang
1b813147e2
Frontend dataset and owner API to return user email ( #464 )
2017-07-10 13:42:54 -07:00
Seyi Adebajo
c9666f2f21
adds last modified column for owners in owner list table. configures moment to fall back to llll for locale strings.
2017-07-10 13:42:54 -07:00
Mars Lan
d57bce2c0b
Redirect ETL job's stderr & stdout to files to make debugging easier. ( #465 )
2017-07-10 13:42:54 -07:00
Seyi Adebajo
45a3bc91a5
updates dataset-owner-list component. adds ember-moment. updates entity list table
2017-07-10 13:42:53 -07:00
Yi (Alan) Wang
7aab1a5500
Minor refactoring on NuageLoad ( #460 )
2017-07-10 13:42:53 -07:00
Seyi Adebajo
82663b2f1c
hardcodes entities to preserve sort order
2017-07-10 13:42:53 -07:00
Seyi Adebajo
662f93343c
sorts browse nav bar alphabetically.
2017-07-10 13:42:53 -07:00
