12076 Commits

Author SHA1 Message Date
Shirshanka Das
f511404cd0
Adding SCSI talk slides 2020-11-12 11:37:39 -08:00
Shirshanka Das
9e881f8ece
Update townhall-history.md
Add link to use-cases talk slides
2020-11-12 11:31:32 -08:00
Shirshanka Das
99291ec03b
Adding Metadata Use-Cases lightning talk slides 2020-11-12 11:27:53 -08:00
Kerem Sahin
733893f5f9
feat(dashboard): Dashboard models update (#1932)
* feat(dashboard): Dashboard models update

* Keep chartId/dashboardId fields in the URN definitions and add fields for chartURL/dashboardURL into info aspects

* Rebase and address some comments
2020-11-12 11:17:22 -08:00
John Plaisted
32e18a1fc7
fix: fix build definition of DatasetFieldUrn (#1991) 2020-11-11 16:54:05 -08:00
John Plaisted
60e43061d8
[Breaking] Update to GMA 0.2.0 and fix Urn definitions. (#1977)
Urn definitions needed to be updated since 0.2.0 changed the base Urn class. 

I also added some more urn coercers that were missing.
2020-11-11 16:06:29 -08:00
Jyoti Wadhwani
70ddb09d29
feat: enable SCSI for datasets (#1986)
* enable SCSI for datasets

* Update scsi-onboarding-guide.md
2020-11-11 13:04:20 -08:00
Ignacio Bona Piedrabuena
3407dab090
2020-10-10 Syncronizing datahub-web {COMMIT-SYNC:7f757e3a514fdeff1de922112f182386bd322228} (#1989) 2020-11-10 17:34:31 -08:00
Nagarjuna Kanamarlapudi
7d574d1094
feat(field-level-lineage): Add models for field level lineage (#1936)
* feat(field-level-lineage): adding models for field level lineage

adding models for field level lineage. Introduce DatasetFieldUrn as a unique identifier for dataset field
2020-11-09 14:08:48 -08:00
Ignacio Bona Piedrabuena
89c78551cc
1604086049622-ui-sync (#1981)
Co-authored-by: Ignacio Bona <ibonapiedrabuena@linkedin.com>
2020-11-09 12:17:51 -08:00
Nagarjuna Kanamarlapudi
bf361a6355
Updates to town hall history and next town hall (#1988)
* Updates to townhall history and next townhall

* Update README.md

Co-authored-by: Mars Lan <mars.th.lan@gmail.com>
2020-11-09 10:29:32 -08:00
shakti-garg-saxo
66a10a8f99
docs: update UI credential requirement for Quickstart (#1987)
* update UI credential requirement for Quickstart

* Update quickstart.md

Co-authored-by: Mars Lan <mars.th.lan@gmail.com>
2020-11-07 17:54:52 -08:00
Jyoti Wadhwani
1516a9ad78
Update README.md 2020-11-05 16:12:38 -08:00
Madhu Podila
0527e483bc
feat(business-glossary):RFC for Business Glossary (#1842)
* added intial version of Business Glossary RFC

* slight updates to Business Glossary RFC

* slight updates to Business Glossary RFC

* updated the sample business glossary table

* updated the sample business glossary content

* updated the sample business glossary content

* Update README.md

updated the attribute of Business Term

* incorporated feedback around DatasetFieldUrn and relationships

* Update README.md

updated the alternatives section

* Update README.md

incorporated the feedback provided by Nagarjuna

* Update README.md

Incorporated feedback 
a) removal of redundant uri attribute from BusinessTerm definition
b) rolled back changes to SchemaField (as per feedback) and will continue to use fieldPath is unique identified for a field in a given Dataset

* Incrporated the review comments and Discussion Feedck

* Fix teh RFC link

* Fix teh RFC link
2020-11-05 14:56:28 -08:00
Jyoti Wadhwani
9fb3ee2247
add LocalDAOStorageConfigFactory for SCSI (#1985) 2020-11-05 11:37:45 -08:00
Nagarjuna Kanamarlapudi
54fef777ac
docs: update agenda of town hall (#1982)
* update agenda of townhall

* tag presenters and add time of talks

* adjust times to accommodate Q&A
2020-11-02 17:54:23 -08:00
Jyoti Wadhwani
2f4797872d
add SCSI bootstrap script for datasets (#1978) 2020-11-02 16:56:36 -08:00
Mars Lan
0a7a9db45e
Update README.md 2020-11-02 13:08:21 -08:00
Mars Lan
ab03a4ee9e
refactor(gms): use BaseLocalDAO as the interface in factories & rest.li resources (#1979)
* refactor(gms): use BaseLocalDAO as the interface in factories & rest.li resources

Fixes #1974

* Revert yarn.lock change

Co-authored-by: Mars Lan <mars@trayminder.com>
2020-10-31 09:27:01 -07:00
Nagarjuna Kanamarlapudi
5a5c6863fa
announce release of v0.6.0 (#1976) 2020-10-29 12:07:35 -07:00
John Plaisted
b4d22fc463
refactor: use better assertj assertions. (#1975) 2020-10-29 11:46:25 -07:00
Jyoti Wadhwani
0c92a8e887
refactor search index builder to store urn parts efficiently (#1937) (#1972)
* refactor search index builder to store urn parts efficiently (#1937)

Co-authored-by: Jyoti Wadhwani <jywadhwa@linkedin.com>

* set urn for all documents

* rebase, fix merge conflicts and modify tests

Co-authored-by: Jyoti Wadhwani <jywadhwa@linkedin.com>
v0.6.0
2020-10-29 09:52:41 -07:00
Mars Lan
32133cd6f2
Update README.md 2020-10-29 05:31:16 -07:00
Jyoti Wadhwani
f455f51756
get rid of search mock utils (#1973) 2020-10-28 14:13:46 -07:00
John Plaisted
b2e73fa003
test: improve test coverage for DatasetIndexBuilder. (#1971)
The other index builders need similar improvements, but after #1937 some coverage is better than no coverage.
2020-10-28 13:32:04 -07:00
John Plaisted
5fd2110b7f
Revert "refactor search index builder to store urn parts efficiently (#1937)" (#1970)
This broke MAE processor because not all documents have urns now.

This reverts commit 5fca512a07cea75480633188e634ba07f49cdb28.
2020-10-28 11:32:18 -07:00
John Plaisted
38e928d235
Update development.md 2020-10-28 10:19:55 -07:00
Mars Lan
15c4d238f5
feat: enable default restli documentation (#1969)
Fixes https://github.com/linkedin/datahub/issues/1966
2020-10-28 08:05:00 -07:00
Claudio Benfatto
a0bb82673a
fix: add placeholder for logging call parameter (#1968)
The error was passed as a parameter for the log call but the
lack of the {} placeholder was excluding it from the resulting log line.
2020-10-28 04:55:40 -07:00
Mars Lan
609739179b
refactor: drop unused models to prevent drifts (#1964) 2020-10-27 10:02:21 -07:00
Mars Lan
1d0ceab081
Update README.md 2020-10-27 05:25:51 -07:00
Kerem Sahin
1ec9f66b66
Bump to datahub-gma 0.1.0 (#1931) 2020-10-26 16:18:21 -07:00
Pardhu Gunnam
144af165a9
Update faq.md (#1962)
Updating DataHub vs commercial solutions FAQ
2020-10-26 07:28:41 -07:00
Kerem Sahin
b989f9d16a
Upgrade neo4j to 4.0 (#1960) 2020-10-26 05:31:00 -07:00
John Plaisted
25b663cc18
refactor: move code to linkedin/datahub-gma. (#1955)
Move code to linkedin/datahub-gma.

"GMA" (Generalized Metadata Architecture) is the backend of DataHub, and has been moved to its own repository.

This deletes the code that was moved and uses jars that GMA publishes to bintray to load it.

Note that not all of GMA was moved, but most of it. We may still move more things to the other repository in the future.
2020-10-23 15:14:57 -07:00
John Plaisted
230ecce9d6
Revert "fix: validate entity type for an urn (#1958)" (#1959)
This change should've been made in datahub-gma instead.

This reverts commit 127d84e3f9bc8b0638df535a594f21d8e34a508b.
2020-10-23 14:33:11 -07:00
Jyoti Wadhwani
127d84e3f9
fix: validate entity type for an urn (#1958) 2020-10-23 12:56:29 -07:00
Mars Lan
0a232bb658
Update debugging.md 2020-10-23 06:10:49 -07:00
Jyoti Wadhwani
4bfcb4b508
add aspects to VALUE model of datasets (#1940) 2020-10-22 21:29:28 -07:00
Nagarjuna Kanamarlapudi
e936e2b856
fix(login): Fix login error when corp user editable information is not present. Fixes #1948 (#1950)
* fix(login): Fix login error when corp user editable information is not present

Check if the aspects are present before extracting the values

* More stronger checks for presence of aspects in model
2020-10-21 20:21:34 -07:00
Charlie Tran
c29fd38c7f
Moves remaining references to non-inclusive language (#1949) 2020-10-20 13:58:09 -07:00
Charlie Tran
4a80baaeb5
Catch up fe to internal - includes module consolidations for faster build times (#1947) 2020-10-20 10:26:02 -07:00
Mars Lan
bfd012f258
docs: update links (#1944)
* Update README.md

* Update links.md
2020-10-16 05:30:28 -07:00
Mars Lan
6773e2ce6f
Update README.md 2020-10-16 05:01:48 -07:00
Mars Lan
da2eb8e6be refactor: move flow/job RFC to the correct location 2020-10-16 04:33:41 -07:00
Harsh Shah
db18d61074
feat(Azkaban entities): RFC for Azkaban Flows and Jobs (#1820)
* feat(Azkaban entities): RFC for Azkaban Flows and Jobs

* Update to pivot to data job and flow as an entity and address comments

* Update urn definitions and address comments

* address minor comments
2020-10-16 04:32:28 -07:00
Jyoti Wadhwani
39cab54b70
datasets client to extend browsable client (#1939)
Co-authored-by: Jyoti Wadhwani <jywadhwani@linkedin.com>
2020-10-15 21:14:25 -07:00
Charlie Tran
d24c396fd7
Change favicon and logo to be datahub instead of linkedin (#1938) 2020-10-15 14:14:38 -07:00
Jyoti Wadhwani
5fca512a07
refactor search index builder to store urn parts efficiently (#1937)
Co-authored-by: Jyoti Wadhwani <jywadhwa@linkedin.com>
2020-10-14 13:47:12 -07:00
andrewkantor
559a50ecab
Update tab.ts (#1913) 2020-10-13 11:45:45 -07:00