yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-23 09:32:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
7,127 Commits 205 Branches 123 Tags
Commit Graph

7127 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Seyi Adebajo
b8532abcf6 breadcrumbs for datasets. creates util modules to building urns and validating them. known issue with last item in breadcrumbs for urns should probably not be a link 2017-07-10 13:42:54 -07:00
Seyi Adebajo
87048b9e23 removes moar legacy code 2017-07-10 13:42:54 -07:00
Seyi Adebajo
bfc2a26dcf removes legacy advsearch 2017-07-10 13:42:54 -07:00
Seyi Adebajo
0673b723dc updates feature-card to use non-fixed heights by leveraging an aspect ratio mixin 2017-07-10 13:42:54 -07:00
Seyi Adebajo
55d38d3bbf adds styling to owner list component. small updates 2017-07-10 13:42:54 -07:00
Seyi Adebajo
5e51805584 adds nuage as restricted source in dataset-author component 2017-07-10 13:42:54 -07:00
Yi (Alan) Wang
1b813147e2 Frontend dataset and owner API to return user email (#464) 2017-07-10 13:42:54 -07:00
Seyi Adebajo
c9666f2f21 adds last modified column for owners in owner list table. configures moment to fall back to llll for locale strings. 2017-07-10 13:42:54 -07:00
Mars Lan
d57bce2c0b Redirect ETL job's stderr & stdout to files to make debugging easier. (#465) 2017-07-10 13:42:54 -07:00
Seyi Adebajo
45a3bc91a5 updates dataset-owner-list component. adds ember-moment. updates entity list table 2017-07-10 13:42:53 -07:00
Yi (Alan) Wang
7aab1a5500 Minor refactoring on NuageLoad (#460) 2017-07-10 13:42:53 -07:00
Seyi Adebajo
82663b2f1c hardcodes entities to preserve sort order 2017-07-10 13:42:53 -07:00
Seyi Adebajo
662f93343c sorts browse nav bar alphabetically. 2017-07-10 13:42:53 -07:00
Seyi Adebajo
d65d0d887f quick refactor of dataset-table search filter implementation. adds todo comment: rename dataset-actions 2017-07-10 13:42:53 -07:00
Seyi Adebajo
b5c1ba0dc3 adds wip dataset-actions component. to be renamed entity-actions 2017-07-10 13:42:53 -07:00
Seyi Adebajo
bb6b3bb50a adds browse feature on home / index page. updates 'home' route to index. and aftermodel redirection in browse route. styling for featurecard 2017-07-10 13:42:53 -07:00
Seyi Adebajo
ab5e275581 adds flows.flow route and updates browser-viewport component to pass in entity id to route 2017-07-10 13:42:53 -07:00
Seyi Adebajo
ca6db59974 creates browser-viewport container and presentational components. updates layout styles. closes todo task to render entity components in browse.entity route. 2017-07-10 13:42:53 -07:00
Seyi Adebajo
0023e5c3e0 appends the initiating urn to the response for a fetched page urn datasets. updates browser-rail doc comment, adds default baseURL to previous value. refactors url mapping reducing helper function. updates styling in browser-rail component. 2017-07-10 13:42:53 -07:00
Yi (Alan) Wang
93242768ff Update runBackend to source application.env for conf values (#458) 2017-07-10 13:42:53 -07:00
Seyi Adebajo
9e4b758a70 changes text for Security Classification option in confidential tab from 'Not Confidential' to 'Limited Distribution' (#455) 2017-07-10 13:42:53 -07:00
Seyi Adebajo
b275c329fb adds container and presentation components for browser-rail component which composes filter-rail. adds styling doc. adds browse route template. todo: move to browse.entity 2017-07-10 13:42:53 -07:00
Seyi Adebajo
e08f9c7685 adds browse view left rail navigation component. adds link node-link component and styling 2017-07-10 13:42:52 -07:00
Yi (Alan) Wang
d444eb0122 Update Multiproduct and CodeSearch ETL job to purge non-exist dataset owner (#456) 2017-07-10 13:42:52 -07:00
Seyi Adebajo
f957e71966 adds styles for browse entity navigation 2017-07-10 13:42:52 -07:00
Seyi Adebajo
7ed0d0f037 updates routes in browse route. adds todo. reformats search.js 2017-07-10 13:42:52 -07:00
Seyi Adebajo
36a82cbc31 updates reducers utils with mapUrnsToIds helper 2017-07-10 13:42:52 -07:00
Seyi Adebajo
339c10542d updates datasets, flows, and metrics actions: removes select[entity] 2017-07-10 13:42:52 -07:00
Seyi Adebajo
92ca92d4e0 adds fetchNodes to entities actions index 2017-07-10 13:42:52 -07:00
Seyi Adebajo
e24a09f9c3 refactors createLazyRequest to use asyncExecutor for better abstraction 2017-07-10 13:42:52 -07:00
Seyi Adebajo
06917ea4f4 adds actions for browse.entity to request nodes and child entities in view. 2017-07-10 13:42:52 -07:00
Seyi Adebajo
756cd8f072 adds state handling for dataset urn child nodes and/or child datasets 2017-07-10 13:42:52 -07:00
Seyi Adebajo
c1c27bb6e5 adds default tests. updates local reference to nodes in reducers.entities.entities 2017-07-10 13:42:52 -07:00
Seyi Adebajo
2c85fc05ed adds utility functions for entites data request 2017-07-10 13:42:52 -07:00
Seyi Adebajo
63ce289cf8 adds validity check to browse action 2017-07-10 13:42:52 -07:00
Seyi Adebajo
90c8a04ea2 adds a nodelist action to browse.entity routes to fetch nodes for the current entity and urn 2017-07-10 13:42:51 -07:00
Seyi Adebajo
e18a947527 updates reducers for flows with entity reducers abstraction. correct typo in metrics reducer. 2017-07-10 13:42:51 -07:00
Seyi Adebajo
d77bf7bd2a utility function to map urns to ids 2017-07-10 13:42:51 -07:00
Seyi Adebajo
13e0fa72cb refactors datasets metrics and abstracted entity reducer functions by removing use of combineReducers function: improper switching between actions caused shared state bug 2017-07-10 13:42:51 -07:00
Seyi Adebajo
83a9509795 refactors metrics reducer to use combinedReducer from entities reducer and wrapping aggregate reducer. this will be factored out into single aggregate reducer for all entities. 2017-07-10 13:42:51 -07:00
Seyi Adebajo
15dd63bb79 updates the datasets root reducer to use a combinedReducer from entities containing reducers abstracted for each entitiy: metrics,flows,datasets. updates datasets.page route to use async thunk lazyRequestPagedDatasets 2017-07-10 13:42:51 -07:00
Mars Lan
35c0781f59 Use WH_APP_FOLDER property as the base directory for temp files for various ETL jobs (#451) 
* Use WH_APP_FOLDER property as the base directory for temp files in Oracle ETL, instead of the full path defined in wh_etl_job_property, which is often /var/tmp/{something}.

* Move common code to FileUtil.py and move Voldamort's temp files too.

* Move Kafaka ETL temp files.

* Move Espresso ETL temp files.

* Move Multiproduct ETL temp files.

* Move CodeSearch ETL temp files.

* Move teradata ETL temp files.
 2017-07-10 13:42:51 -07:00
Yi (Alan) Wang
27d12973e0 Update Nuage Load to purge non-exist dataset owners (#453) 2017-07-10 13:42:51 -07:00
Seyi Adebajo
3f569dc4c2 adds additional patterns request_header and mobile_header to tracking field regular expression. extracts tracking field pattern check to utils 2017-07-10 13:42:51 -07:00
Seyi Adebajo
566e9038cd adds browse ui features: entity navigation, styles. routes for browse.entity. initial tests 2017-07-10 13:42:51 -07:00
Seyi Adebajo
3a28e294bb updates datasets-list to integrate with the updated redux store keys 2017-07-10 13:42:51 -07:00
Mars Lan
f5a7e0c9ec Make sure all intermediate directories are created for ETL job property files. (#450) 2017-07-10 13:42:51 -07:00
Seyi Adebajo
b610385542 abstracts common functionality between datasets/flows/metrics into entities modules for actions and reducers. 2017-07-10 13:42:50 -07:00
Yi (Alan) Wang
dbebb9fa4b add owner_source to primary key in dataset_owner table schema (#449) 2017-07-10 13:42:50 -07:00
Seyi Adebajo
674b37aa38 adds actions for browse feature. abstracts reducers for datasets/metrics/flowsp into entities reducers. adds route for browse feature. 2017-07-10 13:42:50 -07:00