yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-31 13:27:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,652 Commits 207 Branches 123 Tags
Commit Graph

3652 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Gabe Lyons
a9069d4d94
feat(React): Powering lineage page through graphql endpoint (#2099) 2021-02-10 14:19:27 -08:00
Gabe Lyons
2e8ebcf109 feat(React): powering user page via graphql 2021-02-10 14:16:03 -08:00
Gabe Lyons
7f2ca12e36
feat(React): deprecation status in header (#2097) 2021-02-09 19:05:50 -08:00
Gabe Lyons
c2698b99f1
feat(React): Adding schema tab on dataset entity (#2096) 2021-02-09 18:14:10 -08:00
John Joyce
2645aa0b5f
feat(React): Adding Properties, Documentation tabs, user search, & supporting Dataset mutations (#2093) 
* Adding Properties, Documentation tabs, & supporting mutations

Co-authored-by: John Joyce <john@acryl.io>
 2021-02-09 14:30:23 -08:00
brendansun93
cbbe6a5c4b
fix (React): Fix broken profile link on ownership + header (#2095) 
Co-authored-by: Brendan Sun <shihaosun@geotab.com>
 2021-02-09 13:41:32 -08:00
Harshal Sheth
ad745a2a74
fix: Bump gma version (#2094) 2021-02-09 12:07:02 -08:00
John Joyce
da1258c335
feat(GraphQL Mutation): Introducing updateDataset mutation (#2091) 
* Introducing updateDataset mutation

* WritableType -> MutableType

* Add createdAt input

Co-authored-by: John Joyce <john@acryl.io>
 2021-02-09 10:08:28 -08:00
Arpan Majumder
b3dfa1e4ae
2056 | Change dataset lineage pendulum animation component (#2061) 2021-02-08 15:33:15 -08:00
Gabe Lyons
99e0a110d9
feat(React Incubation): adding lineage page with sample data (#2090) 2021-02-08 15:23:47 -08:00
mahao
6c04ba1ebc
fix(docs): update URN models and DatasetUrn links (#2087) 
Signed-off-by: mahao <allenhaozi@gmail.com>
 2021-02-07 11:33:54 -08:00
Gabe Lyons
dcefd96b4a
feat(React Incubation): User Profile (#2083) 
* feat(react incubation): user profile w/ mock data

* removing spurious build-and-test change

* fixing CI issues
 2021-02-05 14:21:04 -08:00
John Joyce
b0801de7ad
fix(GraphQL): Add schemaMetadata mapping & correctly form path string (#2084) 
* Fixing DataHub frontend Browse bug

* Add schema mapping

Co-authored-by: John Joyce <john@acryl.io>
 2021-02-05 12:56:50 -08:00
Gabe Lyons
b73723b98c
fix(react): including eslint in CI (#2086) 2021-02-05 12:56:07 -08:00
John Joyce
cb2f3a466d
fix(integ test): Bumping GMA to 0.2.40 (#2085) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-02-05 11:51:56 -08:00
Harshal Sheth
b491e4ad3c
fix(SQL ingest): Bump confluent-kafka version (#2082) 
This should help resolve #2079.
 2021-02-03 18:06:35 -08:00
John Joyce
9d38ae4dd4
refactor(React Incubation): Entity Interface & EntityRegistry (#2077) 
* React App: Entity Registry!  (#15)

Introducing the Entity Registry: an Entity-oriented Architecture

Co-authored-by: John Joyce <john@acryl.io>
 2021-02-03 11:49:51 -08:00
John Joyce
4cdef602b4
Enable mutation only in frontend (#2081) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-02-03 11:34:16 -08:00
John Joyce
1a49785add
feat(GraphQL Query): Supporting complete Dataset, CorpUser with Search & Browse in GraphQL API (#2076) 
Co-authored-by: John Joyce <johnjoyce@johns-mbp.home>
 2021-02-02 20:18:31 -08:00
Arun Vasudevan
84e952e138
feat (graphql): Datahub GMS Graphql Api Application for Querying Dataset (#2071) 2021-02-01 11:51:15 -08:00
Gabe Lyons
148c733673
refactor(React Incubation): Search routing refactor (#2075) 2021-02-01 11:50:10 -08:00
Shirshanka Das
ebfc3efe62
docs: Updating README with upcoming TownHall info (#2074) 
* docs: Updating README with upcoming townhall info

* nit: whitespace
 2021-01-29 15:01:48 -08:00
John Joyce
9e66aa0649
Fixing CorpUsers Search Bug (#2073) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-01-29 12:08:50 -08:00
Mars Lan
7a786c185b
Drop obsolete info on mysql-etl (#2072) 2021-01-29 09:03:53 -08:00
John Plaisted
d89fa4a27b
feat: update GMA to 0.2.35 (#2067) 
Required editing the search tests for the new search config tests.
 2021-01-28 15:55:51 -08:00
Gabe Lyons
e2e3aca478
fix (react): fixing browse routing (#2069) 
* fixing browse routing
* including react app in build
 2021-01-27 10:52:46 -08:00
John Joyce
bee6ba43f8
feat(React Browse): Adding Browse Logic and misc refactorings (#2060) 
Co-authored-by: John Joyce <jjoyce0510@gmail.com>
Co-authored-by: Gabe Lyons <gabe@Gabes-MacBook-Pro.local>
 2021-01-25 13:29:23 -08:00
John Joyce
50cec65f57
feat(GQL Queries): Productionalizing GraphQL Part 1: Dataset Query support + adding shared GraphQL module (#2066) 
* Productionalizing GraphQL Part 1: Dataset Query support + introducing common datahub-graphql-core module.

Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-22 15:44:00 -08:00
Nagarjuna Kanamarlapudi
f9d33f5519
(refactor): Convert dataPlatforms to GMA aspect models and associated resource to GMA resource. (#2057) 
* (refactor): Convert dataPlatforms to GMA aspect and associated resource to GMA resource.

BREAKING CHANGE: /datasets/dataPlatforms API is now changed to become GMA resource.

* Change documentation style
 2021-01-20 15:50:48 -08:00
Shirshanka Das
2d9a5b5151
Updating townhall history for Jan 15, and date for next townhall (#2063) 2021-01-19 15:16:26 -08:00
John Joyce
550cdc51ee
feat(React Incubation): React Playground Proof of Concept (#2059) 
Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-17 12:54:49 -08:00
John Joyce
3d5a6c60a1
React Incubation RFC (#2055) 
Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-14 21:31:05 -08:00
Javier Sotelo
77d86f7f79
Support optional initContainers to setup extra initialization (#2058) 
Co-authored-by: jsotelo <javier.sotelo@viasat.com>
 2021-01-13 19:59:49 -08:00
Nagarjuna Kanamarlapudi
7ea4ba561a
Update townhall schedule docs to third friday of every month (#2054) 2021-01-12 11:02:42 -08:00
Satyaprakash Bommaraju
782e29ce53
Fix for Kafka-UI Connectivity Error with Kafka-Rest Proxy (#2053) 
Fixes error when acessing http://localhost:18000 where the Kafka-UI was unable to connect to Rest Proxy
 2021-01-12 10:30:47 -08:00
Venki Balakrishnan
211fd6c311
Fix broken link in docs to the Restli resource base classes (#2050) 2021-01-10 23:45:11 -08:00
Shirshanka Das
a7e5c0d804
Townhall Agenda for Jan 15 (#2049) 2021-01-09 20:45:04 -08:00
John Joyce
abc6dcece3
feat(GraphQL support): RFC for GraphQL support in datahub-frontend (Part 1/2) - Queries (#2042) 
* GraphQL Frontend P1 RFC

* Rename README to queries

Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-08 00:28:55 -08:00
Shirshanka Das
ff65f95e4a
docs: add links to GMA repo and RFC process from relevant places (#2045) 
Updating README to describe source repositories and dev model
Updating CONTRIBUTING to guide contributors to RFC process
 2021-01-02 16:40:23 -08:00
Mars Lan
36b79a3ef3
build(docker): add script to clean up docker environment (#2013) 
Co-authored-by: Mars Lan <mars@trayminder.com>
 2020-12-17 13:52:31 -08:00
Shirshanka Das
ff7c7fc8e2
Update README.md (#2041) 
Adding links to latest DataHub blog post.
 2020-12-17 11:40:52 -08:00
Nagarjuna Kanamarlapudi
0fef73bb57
fix(search): Fix the rollback unintentional rollback(#2028) of dataset index to search by field paths. (#2040) 
Enables the auto complete of field paths on DataHub UI
 2020-12-14 17:40:24 -08:00
Ilya Ksenofontov
eedf0ac1af
fix: The field connection with type URLConnection is not Serializable. (#2034) 
An allegedly Serializable object with non-transient, non-serializable data members could cause program crashes. Method toURL() of URL class is depreceted.
 2020-12-09 10:33:31 -08:00
Nagarjuna Kanamarlapudi
3235dc2fec
Update town hall history for 12/4 and announce the next town hall date (#2032) 
* Update townhall history for 12/4 and announce the next townhall date.
 2020-12-07 15:26:34 -08:00
Nagarjuna Kanamarlapudi
f103998dcb
feat(Search): Inject restli client into index builders (#2024) 
* feat(Search): Inject restli client into index builders
Inject restli client into index builders
 2020-12-03 11:43:48 -08:00
John Plaisted
838f964114
feat: add elasticsearch sanity integration tests (#2028) 
These tests verify that, given an index settings and mappings, data can be written to the index, and read from it with a query_all query. These are very simple sanity tests.

We can, and should, write more complex tests that specific to each index in the future.
 2020-12-02 20:49:34 -08:00
John Plaisted
5f9d967451
fix: ingestion docker image (#2027) 
The environment was not set correctly, so it could not fire kafka events. It (mce-cli) always worked when running outside of docker.

I also added a dev ingestion docker image / script which may be much faster if you've already built locally.

Tested:
1. Cleaned docker volumes and started datahub. Verified it is empty.
2. Built with gradle.
3. Ran ./docker/ingestion/ingestion-dev.sh. Verified data shows in DataHub.
4. Ran step 1 again.
5. Ran ./docker/ingestion/ingestion.sh. Verified data shows in DataHub.
v0.6.1 		2020-12-02 17:40:12 -08:00
Nagarjuna Kanamarlapudi
a1e7e26e08
Fix dataset index creation issue (#2022) 2020-11-30 18:33:06 -08:00
Harsh Shah
06cca77a6b
feat(models): Add DataFlow and DataJob models (#2008) 
Add DataFlow and DataJob urn and aspect models.
The aspects include metadata associated with Data processing flow and job entities,
associated inputs and outputs of a job.
 2020-11-30 17:48:29 -08:00
John Plaisted
8ab4e930c2
Add a CODEOWNERS file. (#2021) 
After this we can enforce that reviews must be approved by people on this list.
 2020-11-30 17:02:50 -08:00