1367 Commits

Author SHA1 Message Date
Javier Sotelo
ad4c80a753
feat(kafka-config): Add ability to configure other Kafka props (#1745)
* Integarte spring-kafka & spring-boot for security props

- Upgrade spring-kafka to 2.1.14
- Use KafkaListener and KafkaTemplates to enable KafkaAutoConfiguration
- Integrates spring-boot's KafkaProperties into spring-kafka's config

* Cleanup imports

* Add DataHub kafka env vars

* Remove kafka-streams dependency

* Add KafkaProperties to gms; Add docs

* Add to Adoption

* Remove KAFKA_BOOTSTRAP_SERVER default

Co-authored-by: jsotelo <javier.sotelo@viasat.com>
Co-authored-by: Kerem Sahin <ksahin@linkedin.com>
2020-07-27 05:22:51 -07:00
Mars Lan
0a8acb8ae2
Update README.md 2020-07-26 11:26:48 -07:00
Mars Lan
fe52c8e05c
Update README.md 2020-07-26 11:08:13 -07:00
Mars Lan
aa34e1999f
Update README.md 2020-07-26 10:59:58 -07:00
Mars Lan
adf975ee18
build: build GitHub Pages from /docs directory (#1752)
- Move non-README top-level MD files to /docs
- Update all absolute links to files in /docs to relative links
- Add a placeholder front page for GitHub Pages
2020-07-26 10:41:32 -07:00
Mars Lan
3e4c110723
Revert "build: build GitHub Page from /docs directory (#1750)" (#1751)
This reverts commit b0f56de7a81b8bf921ff37cb81024692d1b9a8ce.
2020-07-26 10:24:41 -07:00
Mars Lan
b0f56de7a8
build: build GitHub Page from /docs directory (#1750)
- Move top-level MD files to /docs and symlink them back
- Update all absolute links to files in /docs to relative links
2020-07-26 10:22:35 -07:00
Mars Lan
2031c09663
Delete _config.yml 2020-07-26 08:10:37 -07:00
Mars Lan
b47277ac31 Set theme jekyll-theme-cayman 2020-07-26 08:05:20 -07:00
Mars Lan
9ecd8de99c
Update faq.md 2020-07-26 07:58:00 -07:00
Mars Lan
aefa725ada
Update roadmap.md 2020-07-26 07:27:55 -07:00
Kerem Sahin
bb9a6cec19 Doc fixes 2020-07-25 19:47:12 -07:00
Mars Lan
aa6a23c08d
Update links.md 2020-07-25 09:56:59 -07:00
Mars Lan
060b91ad3e
Update faq.md 2020-07-22 16:42:09 -07:00
Mars Lan
db0b974de4
Update features.md 2020-07-22 16:37:50 -07:00
Mars Lan
e983f3dd9d
doc: add a separate doc to keep track of the full list or links (#1744)
* Update README.md

* Create links.md

* Update README.md

* Update links.md
2020-07-22 15:16:57 -07:00
Mars Lan
1a5e56ce66
Update roadmap.md 2020-07-22 07:03:06 -07:00
John Plaisted
8686a39b38
Update the roadmap (#1740)
* Update the roadmap

- Make short term more like what we're doing this quarter
- Medium term is next quarter
- Long term is 2 or 3 quarters from now
- Visionary is even beyond that

Making this PR mostly to discuss the roadmap. I've moved a few items down to "unprioritized"; before merging this we should put these in a category. Mostly saving the state of what I've done so far.

* Update roadmap.md

Co-authored-by: Mars Lan <mars.th.lan@gmail.com>
2020-07-22 07:01:53 -07:00
Mars Lan
3cbfded0bc
Update townhalls.md 2020-06-30 15:56:52 -07:00
Jyoti Wadhwani
7655ab25eb
Update townhalls.md
Update with the latest recording
2020-06-30 15:44:56 -07:00
Kerem Sahin
9501e9bd70 docs: Graph onboarding demo 2020-06-26 01:10:44 -07:00
geosmart
3e0d658e62
fix-DatasetSearchConfig class ref (#1704) 2020-06-19 08:14:08 -07:00
Liangjun Jiang
40f08ecaf1
Implement data process graph feature (#1695)
* implement data process graph feature; update the document

* add unit test for data process graph

* removed auto generated avro files

* update image
2020-06-17 11:58:42 -07:00
Jyoti Wadhwani
7fc4d85ceb
Update townhalls.md
Update the agenda for next town hall
2020-06-15 15:55:39 -07:00
Kerem Sahin
ccd7c1f38a
Update townhalls.md 2020-06-15 15:33:14 -07:00
Jyoti Wadhwani
be75856597
Update townhalls.md
Change town hall details
2020-06-01 16:46:02 -07:00
Mars Lan
920a1774dc
docs: points to docker images hosted by linkedin org (#1683)
As we're now utilize GitHub Actions to build & publish docker images to docker hub under linkedin org
Also allow overriding image tags via DATAHUB_VERSION environment variable
2020-06-01 09:36:51 -07:00
Jyoti Wadhwani
ebe2dc274c
Update townhalls.md
Update the agenda for town hall
2020-05-28 10:23:05 -07:00
Mars Lan
1283dd3ff4
refactor(pdl): convert all pdsc to pdl (#1678)
Use the automated tool in https://linkedin.github.io/rest.li/pdl_migration
Also update all relevant docs
2020-05-21 10:49:23 -07:00
Jyoti Wadhwani
0bd99835cd
Update townhalls.md 2020-05-16 14:04:54 -07:00
Jyoti Wadhwani
fe3494c955
Update townhalls.md 2020-05-13 10:39:48 -07:00
Mars Lan
509b2e1515
refactor: use named volume instead of bind mount in quickstart (#1669)
Volume is the preferred method over bind mount (https://docs.docker.com/storage/volumes/) for persistent container data.
This also eliminates the need for the ugly chmod hack for elasticsearch and hopefully fixes https://github.com/linkedin/datahub/issues/1650
2020-05-11 09:06:38 -07:00
Liangjun Jiang
b5127a631b
Update New Entity Onboarding Doc (#1668)
* add diagram to visually understand the process to onboard a new entity

* update the diagram

Co-authored-by: Liangjun <liajiang@expediagroup.com>
2020-05-08 14:37:36 -07:00
Mars Lan
4c7f647067
Update debugging.md 2020-05-08 10:07:37 -07:00
Mars Lan
d6fcefb75b
style: add checkstyle and IDEA code style config (#1662)
Currently allow checkstyle warnings until all violations have been fixed
2020-05-07 15:59:16 -07:00
Arun Vasudevan
29964b9658
Update metadata-modelling.md (#1660) 2020-05-06 14:28:45 -07:00
Mars Lan
95f0a503e1
docs: add DI configuration for new entities
Fix https://github.com/linkedin/datahub/issues/1656
2020-05-05 07:25:34 -07:00
Mars Lan
055c5de93b
Update developers.md 2020-05-04 16:26:12 -07:00
Mars Lan
95cf7ed553
docs: add example factory classes
Fix https://github.com/linkedin/datahub/issues/1656
2020-05-04 16:19:00 -07:00
Mars Lan
e10d6bfdd5
Update debugging.md 2020-04-28 14:38:57 -07:00
Mars Lan
ea561a8957
Update debugging.md 2020-04-28 14:37:55 -07:00
Kerem Sahin
b8c4c788e1
Update architecture.md 2020-04-25 17:25:25 -07:00
Kerem Sahin
d8c98f4ca5 doc: Fix & modify architecture diagram 2020-04-25 17:23:23 -07:00
geosmart
b0081de621
docs: update metadata-modelling.md (#1638)
* Update metadata-modelling.md

Pegasus schema blog url is not working ,so use rest.li wiki instead
2020-04-18 11:19:19 -07:00
Jyoti Wadhwani
6a8b9e7a48
Update townhalls.md
Add link to recording and Q&A doc from previous meeting
2020-04-17 14:56:26 -07:00
Jyoti Wadhwani
4e7786acaf
Update townhalls.md 2020-04-14 11:44:48 -07:00
Jyoti Wadhwani
1dbe23ed80
Update townhalls.md
Add agenda for the town hall meeting
2020-04-14 11:38:21 -07:00
Kerem Sahin
b8cab17249
Fix typos in entity.md 2020-04-12 20:41:39 -07:00
Mars Lan
d93afaebfa
docs: fix slack link 2020-04-12 16:30:34 -07:00
Mars Lan
e834e7ae86
Update entity.md 2020-04-11 19:22:05 -07:00