yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-08-07 08:48:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,186 Commits 220 Branches 123 Tags
Commit Graph

5186 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
John Joyce
9d38ae4dd4
refactor(React Incubation): Entity Interface & EntityRegistry (#2077) 
* React App: Entity Registry!  (#15)

Introducing the Entity Registry: an Entity-oriented Architecture

Co-authored-by: John Joyce <john@acryl.io>
 2021-02-03 11:49:51 -08:00
John Joyce
4cdef602b4
Enable mutation only in frontend (#2081) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-02-03 11:34:16 -08:00
John Joyce
1a49785add
feat(GraphQL Query): Supporting complete Dataset, CorpUser with Search & Browse in GraphQL API (#2076) 
Co-authored-by: John Joyce <johnjoyce@johns-mbp.home>
 2021-02-02 20:18:31 -08:00
Arun Vasudevan
84e952e138
feat (graphql): Datahub GMS Graphql Api Application for Querying Dataset (#2071) 2021-02-01 11:51:15 -08:00
Gabe Lyons
148c733673
refactor(React Incubation): Search routing refactor (#2075) 2021-02-01 11:50:10 -08:00
Shirshanka Das
ebfc3efe62
docs: Updating README with upcoming TownHall info (#2074) 
* docs: Updating README with upcoming townhall info

* nit: whitespace
 2021-01-29 15:01:48 -08:00
John Joyce
9e66aa0649
Fixing CorpUsers Search Bug (#2073) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-01-29 12:08:50 -08:00
Mars Lan
7a786c185b
Drop obsolete info on mysql-etl (#2072) 2021-01-29 09:03:53 -08:00
John Plaisted
d89fa4a27b
feat: update GMA to 0.2.35 (#2067) 
Required editing the search tests for the new search config tests.
 2021-01-28 15:55:51 -08:00
Gabe Lyons
e2e3aca478
fix (react): fixing browse routing (#2069) 
* fixing browse routing
* including react app in build
 2021-01-27 10:52:46 -08:00
John Joyce
bee6ba43f8
feat(React Browse): Adding Browse Logic and misc refactorings (#2060) 
Co-authored-by: John Joyce <jjoyce0510@gmail.com>
Co-authored-by: Gabe Lyons <gabe@Gabes-MacBook-Pro.local>
 2021-01-25 13:29:23 -08:00
John Joyce
50cec65f57
feat(GQL Queries): Productionalizing GraphQL Part 1: Dataset Query support + adding shared GraphQL module (#2066) 
* Productionalizing GraphQL Part 1: Dataset Query support + introducing common datahub-graphql-core module.

Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-22 15:44:00 -08:00
Nagarjuna Kanamarlapudi
f9d33f5519
(refactor): Convert dataPlatforms to GMA aspect models and associated resource to GMA resource. (#2057) 
* (refactor): Convert dataPlatforms to GMA aspect and associated resource to GMA resource.

BREAKING CHANGE: /datasets/dataPlatforms API is now changed to become GMA resource.

* Change documentation style
 2021-01-20 15:50:48 -08:00
Shirshanka Das
2d9a5b5151
Updating townhall history for Jan 15, and date for next townhall (#2063) 2021-01-19 15:16:26 -08:00
John Joyce
550cdc51ee
feat(React Incubation): React Playground Proof of Concept (#2059) 
Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-17 12:54:49 -08:00
John Joyce
3d5a6c60a1
React Incubation RFC (#2055) 
Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-14 21:31:05 -08:00
Javier Sotelo
77d86f7f79
Support optional initContainers to setup extra initialization (#2058) 
Co-authored-by: jsotelo <javier.sotelo@viasat.com>
 2021-01-13 19:59:49 -08:00
Nagarjuna Kanamarlapudi
7ea4ba561a
Update townhall schedule docs to third friday of every month (#2054) 2021-01-12 11:02:42 -08:00
Satyaprakash Bommaraju
782e29ce53
Fix for Kafka-UI Connectivity Error with Kafka-Rest Proxy (#2053) 
Fixes error when acessing http://localhost:18000 where the Kafka-UI was unable to connect to Rest Proxy
 2021-01-12 10:30:47 -08:00
Venki Balakrishnan
211fd6c311
Fix broken link in docs to the Restli resource base classes (#2050) 2021-01-10 23:45:11 -08:00
Shirshanka Das
a7e5c0d804
Townhall Agenda for Jan 15 (#2049) 2021-01-09 20:45:04 -08:00
John Joyce
abc6dcece3
feat(GraphQL support): RFC for GraphQL support in datahub-frontend (Part 1/2) - Queries (#2042) 
* GraphQL Frontend P1 RFC

* Rename README to queries

Co-authored-by: John Joyce <jjoyce0510@gmail.com>
 2021-01-08 00:28:55 -08:00
Shirshanka Das
ff65f95e4a
docs: add links to GMA repo and RFC process from relevant places (#2045) 
Updating README to describe source repositories and dev model
Updating CONTRIBUTING to guide contributors to RFC process
 2021-01-02 16:40:23 -08:00
Mars Lan
36b79a3ef3
build(docker): add script to clean up docker environment (#2013) 
Co-authored-by: Mars Lan <mars@trayminder.com>
 2020-12-17 13:52:31 -08:00
Shirshanka Das
ff7c7fc8e2
Update README.md (#2041) 
Adding links to latest DataHub blog post.
 2020-12-17 11:40:52 -08:00
Nagarjuna Kanamarlapudi
0fef73bb57
fix(search): Fix the rollback unintentional rollback(#2028) of dataset index to search by field paths. (#2040) 
Enables the auto complete of field paths on DataHub UI
 2020-12-14 17:40:24 -08:00
Ilya Ksenofontov
eedf0ac1af
fix: The field connection with type URLConnection is not Serializable. (#2034) 
An allegedly Serializable object with non-transient, non-serializable data members could cause program crashes. Method toURL() of URL class is depreceted.
 2020-12-09 10:33:31 -08:00
Nagarjuna Kanamarlapudi
3235dc2fec
Update town hall history for 12/4 and announce the next town hall date (#2032) 
* Update townhall history for 12/4 and announce the next townhall date.
 2020-12-07 15:26:34 -08:00
Nagarjuna Kanamarlapudi
f103998dcb
feat(Search): Inject restli client into index builders (#2024) 
* feat(Search): Inject restli client into index builders
Inject restli client into index builders
 2020-12-03 11:43:48 -08:00
John Plaisted
838f964114
feat: add elasticsearch sanity integration tests (#2028) 
These tests verify that, given an index settings and mappings, data can be written to the index, and read from it with a query_all query. These are very simple sanity tests.

We can, and should, write more complex tests that specific to each index in the future.
 2020-12-02 20:49:34 -08:00
John Plaisted
5f9d967451
fix: ingestion docker image (#2027) 
The environment was not set correctly, so it could not fire kafka events. It (mce-cli) always worked when running outside of docker.

I also added a dev ingestion docker image / script which may be much faster if you've already built locally.

Tested:
1. Cleaned docker volumes and started datahub. Verified it is empty.
2. Built with gradle.
3. Ran ./docker/ingestion/ingestion-dev.sh. Verified data shows in DataHub.
4. Ran step 1 again.
5. Ran ./docker/ingestion/ingestion.sh. Verified data shows in DataHub.
v0.6.1 		2020-12-02 17:40:12 -08:00
Nagarjuna Kanamarlapudi
a1e7e26e08
Fix dataset index creation issue (#2022) 2020-11-30 18:33:06 -08:00
Harsh Shah
06cca77a6b
feat(models): Add DataFlow and DataJob models (#2008) 
Add DataFlow and DataJob urn and aspect models.
The aspects include metadata associated with Data processing flow and job entities,
associated inputs and outputs of a job.
 2020-11-30 17:48:29 -08:00
John Plaisted
8ab4e930c2
Add a CODEOWNERS file. (#2021) 
After this we can enforce that reviews must be approved by people on this list.
 2020-11-30 17:02:50 -08:00
Charlie Tran
c739ab4f22
fix/docs(frontend): Syncs UI with internal frontend (#2009) 
* Init new and improved in repo documentation for open source and github
{COMMIT-SYNC:dca335ff397c3e9c1283d845cef56fdb42f7853b}

* [META-13251] Initial implementation for button to integrate with wintermute
{COMMIT-SYNC:491b2bf5bc91137a2919370e81936033be15b13a}

* Quickfix for UMP Datasets not showing the correct owner link
{COMMIT-SYNC:26eb64cca78f96ed383994b7e67dd4fc8a99d985}

* Updates history of datahub documentation
{COMMIT-SYNC:306b2c72f3a81e699c8b414a8aaf4dcbfdf1ed31}

Co-authored-by: Ignacio Bona <ibonapiedrabuena@linkedin.com>
 2020-11-26 06:56:18 -08:00
Mars Lan
1a64d6364d
docs: upload updated deck (#2016) 
* Delete Taming the Data Beast Using DataHub.pdf

* Add files via upload
 2020-11-26 04:57:58 -08:00
Mars Lan
6fdea6391d
docs: update links (#2015) 
* Update README.md

* Update links.md
 2020-11-26 04:56:11 -08:00
Mars Lan
0cee8d90c2
Update links.md 2020-11-25 19:39:12 -08:00
Mars Lan
0754e26940
Update README.md 2020-11-25 19:38:24 -08:00
Mars Lan
90b09afbc1
Add files via upload 2020-11-25 19:34:46 -08:00
Mars Lan
8fad457330
Update debugging.md 2020-11-25 16:55:32 -08:00
Mars Lan
bc26b1186d
Update links.md 2020-11-25 14:10:14 -08:00
Mars Lan
7f6720f90c
Update README.md 2020-11-25 12:08:18 -08:00
Nagarjuna Kanamarlapudi
8707bb06a8
Townhall agenda for December 4 (#2011) 
* Townhall agenda for December 4
 2020-11-25 11:48:09 -08:00
Kerem Sahin
4d8320e4a0
feat(dashboard): Dashboards backend implementation (#1884) 2020-11-23 09:25:58 -08:00
Nagarjuna Kanamarlapudi
5d083143db
feat(dataset): Enable search of datasets by field names (#2001) 
* feat(dataset): Enable search of datasets by field names
 2020-11-20 12:01:07 -08:00
John Plaisted
6f59a91865
Bump GMA to latest (#2007) 
Involves fixing some types. Bright side is that ModelValidation actually checks aspects now (it did not before because aspects are not records but unions!).
 2020-11-18 14:07:48 -08:00
cptran777
89caefe268 Init new and improved in repo documentation for open source and github 
{COMMIT-SYNC:dca335ff397c3e9c1283d845cef56fdb42f7853b}
 2020-11-17 15:44:26 -08:00
shakti-garg-saxo
808330f7f8
feat(kubernetes): Add pod-level annotations to the datahub helm charts (#2005) 
* 2003 | add pod annotations

* 2003 | update documentation and bump up chart version

Co-authored-by: shakti-garg <shakti.garg@gmail.com>
 2020-11-17 15:20:55 -08:00
Ignacio Bona
5fc77f2e61 OS build improvements (1minute) 
{COMMIT-SYNC:01040678c188091b7f5ccea77e1ec8282d4be142}
 2020-11-17 12:38:21 -08:00