5186 Commits

Author SHA1 Message Date
Ignacio Bona
96af9c7ed6 OS Fixes: Hand tailor types, merge dataset-entity, removed unused types
{COMMIT-SYNC:8532a92fef64760adebfc54fa2ad4c3acf361b41}
2020-11-17 12:38:21 -08:00
Ignacio Bona
f043d414a4 Automatic pr creation
{COMMIT-SYNC:7f757e3a514fdeff1de922112f182386bd322228}
2020-11-17 12:38:21 -08:00
shakti-garg-saxo
1351de4599
1995 | fix indentation value in helm deployment templates (#2004)
Co-authored-by: shakti-garg <shakti.garg@gmail.com>
2020-11-17 07:29:59 -08:00
Mars Lan
f5891a733a
Update links.md 2020-11-13 21:19:17 -08:00
shakti-garg-saxo
7ed6eb8845
Update doc for configuring topic names (#1999)
1. Add topic-name configuration for each component
2. How to configure them in the deployable
2020-11-13 21:08:48 -08:00
Arun Vasudevan
f738f7b7a9 Doc fix 2020-11-13 16:16:24 -08:00
Arun Vasudevan
89960a0a27 Exposing Neo4j Driver Configs 2020-11-13 16:16:24 -08:00
Ignacio Bona Piedrabuena
eb8b4a357e
Update townhall-history.md 2020-11-12 14:40:35 -08:00
Ignacio Bona Piedrabuena
5b5bfbef25
(doc) Adding DataHub UI overview presentation 2020-11-12 14:38:53 -08:00
Shirshanka Das
41e40b6994
Update townhall-history.md
Add SCSI talk link
2020-11-12 11:40:34 -08:00
Shirshanka Das
f511404cd0
Adding SCSI talk slides 2020-11-12 11:37:39 -08:00
Shirshanka Das
9e881f8ece
Update townhall-history.md
Add link to use-cases talk slides
2020-11-12 11:31:32 -08:00
Shirshanka Das
99291ec03b
Adding Metadata Use-Cases lightning talk slides 2020-11-12 11:27:53 -08:00
Kerem Sahin
733893f5f9
feat(dashboard): Dashboard models update (#1932)
* feat(dashboard): Dashboard models update

* Keep chartId/dashboardId fields in the URN definitions and add fields for chartURL/dashboardURL into info aspects

* Rebase and address some comments
2020-11-12 11:17:22 -08:00
John Plaisted
32e18a1fc7
fix: fix build definition of DatasetFieldUrn (#1991) 2020-11-11 16:54:05 -08:00
John Plaisted
60e43061d8
[Breaking] Update to GMA 0.2.0 and fix Urn definitions. (#1977)
Urn definitions needed to be updated since 0.2.0 changed the base Urn class. 

I also added some more urn coercers that were missing.
2020-11-11 16:06:29 -08:00
Jyoti Wadhwani
70ddb09d29
feat: enable SCSI for datasets (#1986)
* enable SCSI for datasets

* Update scsi-onboarding-guide.md
2020-11-11 13:04:20 -08:00
Ignacio Bona Piedrabuena
3407dab090
2020-10-10 Syncronizing datahub-web {COMMIT-SYNC:7f757e3a514fdeff1de922112f182386bd322228} (#1989) 2020-11-10 17:34:31 -08:00
Nagarjuna Kanamarlapudi
7d574d1094
feat(field-level-lineage): Add models for field level lineage (#1936)
* feat(field-level-lineage): adding models for field level lineage

adding models for field level lineage. Introduce DatasetFieldUrn as a unique identifier for dataset field
2020-11-09 14:08:48 -08:00
Ignacio Bona Piedrabuena
89c78551cc
1604086049622-ui-sync (#1981)
Co-authored-by: Ignacio Bona <ibonapiedrabuena@linkedin.com>
2020-11-09 12:17:51 -08:00
Nagarjuna Kanamarlapudi
bf361a6355
Updates to town hall history and next town hall (#1988)
* Updates to townhall history and next townhall

* Update README.md

Co-authored-by: Mars Lan <mars.th.lan@gmail.com>
2020-11-09 10:29:32 -08:00
shakti-garg-saxo
66a10a8f99
docs: update UI credential requirement for Quickstart (#1987)
* update UI credential requirement for Quickstart

* Update quickstart.md

Co-authored-by: Mars Lan <mars.th.lan@gmail.com>
2020-11-07 17:54:52 -08:00
Jyoti Wadhwani
1516a9ad78
Update README.md 2020-11-05 16:12:38 -08:00
Madhu Podila
0527e483bc
feat(business-glossary):RFC for Business Glossary (#1842)
* added intial version of Business Glossary RFC

* slight updates to Business Glossary RFC

* slight updates to Business Glossary RFC

* updated the sample business glossary table

* updated the sample business glossary content

* updated the sample business glossary content

* Update README.md

updated the attribute of Business Term

* incorporated feedback around DatasetFieldUrn and relationships

* Update README.md

updated the alternatives section

* Update README.md

incorporated the feedback provided by Nagarjuna

* Update README.md

Incorporated feedback 
a) removal of redundant uri attribute from BusinessTerm definition
b) rolled back changes to SchemaField (as per feedback) and will continue to use fieldPath is unique identified for a field in a given Dataset

* Incrporated the review comments and Discussion Feedck

* Fix teh RFC link

* Fix teh RFC link
2020-11-05 14:56:28 -08:00
Jyoti Wadhwani
9fb3ee2247
add LocalDAOStorageConfigFactory for SCSI (#1985) 2020-11-05 11:37:45 -08:00
Nagarjuna Kanamarlapudi
54fef777ac
docs: update agenda of town hall (#1982)
* update agenda of townhall

* tag presenters and add time of talks

* adjust times to accommodate Q&A
2020-11-02 17:54:23 -08:00
Jyoti Wadhwani
2f4797872d
add SCSI bootstrap script for datasets (#1978) 2020-11-02 16:56:36 -08:00
Mars Lan
0a7a9db45e
Update README.md 2020-11-02 13:08:21 -08:00
Mars Lan
ab03a4ee9e
refactor(gms): use BaseLocalDAO as the interface in factories & rest.li resources (#1979)
* refactor(gms): use BaseLocalDAO as the interface in factories & rest.li resources

Fixes #1974

* Revert yarn.lock change

Co-authored-by: Mars Lan <mars@trayminder.com>
2020-10-31 09:27:01 -07:00
Nagarjuna Kanamarlapudi
5a5c6863fa
announce release of v0.6.0 (#1976) 2020-10-29 12:07:35 -07:00
John Plaisted
b4d22fc463
refactor: use better assertj assertions. (#1975) 2020-10-29 11:46:25 -07:00
Jyoti Wadhwani
0c92a8e887
refactor search index builder to store urn parts efficiently (#1937) (#1972)
* refactor search index builder to store urn parts efficiently (#1937)

Co-authored-by: Jyoti Wadhwani <jywadhwa@linkedin.com>

* set urn for all documents

* rebase, fix merge conflicts and modify tests

Co-authored-by: Jyoti Wadhwani <jywadhwa@linkedin.com>
v0.6.0
2020-10-29 09:52:41 -07:00
Mars Lan
32133cd6f2
Update README.md 2020-10-29 05:31:16 -07:00
Jyoti Wadhwani
f455f51756
get rid of search mock utils (#1973) 2020-10-28 14:13:46 -07:00
John Plaisted
b2e73fa003
test: improve test coverage for DatasetIndexBuilder. (#1971)
The other index builders need similar improvements, but after #1937 some coverage is better than no coverage.
2020-10-28 13:32:04 -07:00
John Plaisted
5fd2110b7f
Revert "refactor search index builder to store urn parts efficiently (#1937)" (#1970)
This broke MAE processor because not all documents have urns now.

This reverts commit 5fca512a07cea75480633188e634ba07f49cdb28.
2020-10-28 11:32:18 -07:00
John Plaisted
38e928d235
Update development.md 2020-10-28 10:19:55 -07:00
Mars Lan
15c4d238f5
feat: enable default restli documentation (#1969)
Fixes https://github.com/linkedin/datahub/issues/1966
2020-10-28 08:05:00 -07:00
Claudio Benfatto
a0bb82673a
fix: add placeholder for logging call parameter (#1968)
The error was passed as a parameter for the log call but the
lack of the {} placeholder was excluding it from the resulting log line.
2020-10-28 04:55:40 -07:00
Mars Lan
609739179b
refactor: drop unused models to prevent drifts (#1964) 2020-10-27 10:02:21 -07:00
Mars Lan
1d0ceab081
Update README.md 2020-10-27 05:25:51 -07:00
Kerem Sahin
1ec9f66b66
Bump to datahub-gma 0.1.0 (#1931) 2020-10-26 16:18:21 -07:00
Pardhu Gunnam
144af165a9
Update faq.md (#1962)
Updating DataHub vs commercial solutions FAQ
2020-10-26 07:28:41 -07:00
Kerem Sahin
b989f9d16a
Upgrade neo4j to 4.0 (#1960) 2020-10-26 05:31:00 -07:00
John Plaisted
25b663cc18
refactor: move code to linkedin/datahub-gma. (#1955)
Move code to linkedin/datahub-gma.

"GMA" (Generalized Metadata Architecture) is the backend of DataHub, and has been moved to its own repository.

This deletes the code that was moved and uses jars that GMA publishes to bintray to load it.

Note that not all of GMA was moved, but most of it. We may still move more things to the other repository in the future.
2020-10-23 15:14:57 -07:00
John Plaisted
230ecce9d6
Revert "fix: validate entity type for an urn (#1958)" (#1959)
This change should've been made in datahub-gma instead.

This reverts commit 127d84e3f9bc8b0638df535a594f21d8e34a508b.
2020-10-23 14:33:11 -07:00
Jyoti Wadhwani
127d84e3f9
fix: validate entity type for an urn (#1958) 2020-10-23 12:56:29 -07:00
Mars Lan
0a232bb658
Update debugging.md 2020-10-23 06:10:49 -07:00
Jyoti Wadhwani
4bfcb4b508
add aspects to VALUE model of datasets (#1940) 2020-10-22 21:29:28 -07:00
Nagarjuna Kanamarlapudi
e936e2b856
fix(login): Fix login error when corp user editable information is not present. Fixes #1948 (#1950)
* fix(login): Fix login error when corp user editable information is not present

Check if the aspects are present before extracting the values

* More stronger checks for presence of aspects in model
2020-10-21 20:21:34 -07:00