yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-05 16:22:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
12,004 Commits 189 Branches 118 Tags
Commit Graph

1355 Commits

Author SHA1 Message Date
John Plaisted
2689d6ef91
Update townhalls.md 2020-08-19 16:09:31 -07:00
Kerem Sahin
19d6f007da
Update high-cardinality.md 2020-08-19 01:32:23 -07:00
Mars Lan
7f3a686b1a
Update relationship.md 2020-08-18 05:13:01 -07:00
Mars Lan
247858a786
Update high-cardinality.md 2020-08-17 10:21:04 -07:00
Kerem Sahin
18a3892736
Update quickstart.md 2020-08-14 01:29:50 -07:00
Mars Lan
ca33df2b02
Update townhall-history.md 2020-08-13 07:29:35 -07:00
John Plaisted
ae69e65431
Add log documentation 
we didn't end up mounting logs; docker desktop is a better experience
 2020-08-12 11:27:47 -07:00
Mars Lan
03e3d49445
feat(ingest): add example crawler for MS SQL (#1803) 
Also fix the incorrect assumption on column comments & add sample docker-compose file
 2020-08-12 08:51:39 -07:00
na zhang
a13c1e10e6
docs: how to customize the search experience (#1795) 
* add description field for dataset index mapping

* documentation on how to customize the search experience
 2020-08-10 19:22:08 -07:00
Mars Lan
b8f1be31bd
Update search-onboarding.md 2020-08-09 13:17:52 -07:00
Jyoti Wadhwani
58d1d7b415
docs: create search-over-new-field.md (#1790) 
Add a doc on searching over a new field
 2020-08-09 12:06:24 -07:00
John Plaisted
b8e18b0b5d
refactor(docker): make docker files easier to use during development. (#1777) 
* Make docker files easier to use during development.

During development it quite nice to have docker work with locally built code. This allows you to launch all services very quickly, with your changes, and optionally with debugging support.

Changes made to docker files:
- Removed all redundant docker-compose files. We now have 1 giant file, and smaller files to use as overrides.
- Remove redundant README files that provided little information.
- Rename docker/<dir> to match the service name in the docker-compose file for clarity.
- Move environment variables to .env files. We only provide dev / the default environment for quickstart.
- Add debug options to docker files using multistage build to build minimal images with the idea that built files will be mounted instead.
- Add a docker/dev.sh script + compose file to easily use the dev override images (separate tag; images never published; uses debug docker files; mounts binaries to image).
- Added docs/docker documentation for this.
 2020-08-06 16:38:53 -07:00
John Plaisted
43dfce8b2f
Update rfc.md 2020-08-06 09:58:04 -07:00
Mars Lan
abd63fb029
Update townhall-history.md 2020-08-06 06:30:02 -07:00
Mars Lan
6275a3cbe8
Update townhall-history.md 2020-08-06 06:29:31 -07:00
Mars Lan
8e32f41828
Update aspect.md 2020-08-06 05:12:30 -07:00
Mars Lan
687dc3ae9a
Update aspect-versioning.md 2020-08-06 05:10:51 -07:00
Mars Lan
009eff0aef
docs: more placeholders for advance topics (#1781) 
* Create aspect-versioning.md

* Create derived-aspects.md

* Create backfilling.md
 2020-08-05 20:09:51 -07:00
Mars Lan
401b21a871
docs: add placeholders for advanced topics (#1780) 
* Create high-cardinality.md

* Create pdl-best-practices

* Create partial-update.md

* Rename pdl-best-practices to pdl-best-practices.md

* Create entity-hierarchy.md
 2020-08-05 19:25:55 -07:00
John Plaisted
776b0c1a07
Update townhalls.md 2020-08-03 12:29:07 -07:00
John Plaisted
e6c78400de
Update for August invite; link to history 2020-08-03 10:49:25 -07:00
John Plaisted
80112ad196
Add a separate page for previous townhalls 2020-08-03 10:41:46 -07:00
Mars Lan
6044a86f76
Update developers.md 2020-08-01 16:17:43 -07:00
Mars Lan
91668fc566
Update developers.md 2020-08-01 15:17:21 -07:00
Mars Lan
4b6b1dd192
Update metadata-ingestion.md 2020-08-01 07:52:29 -07:00
Mars Lan
0a886b6ef2
Update slack.md 2020-08-01 05:08:46 -07:00
Mars Lan
8c77457182
Update slack.md 2020-08-01 05:06:30 -07:00
Mars Lan
35e9c24521
docs: move quickstart guide to a separate file under docs (#1765) 
docs: move quickstart guide to a separate doc under docs directory
 2020-07-31 18:48:18 -07:00
Jyoti Wadhwani
a1d33f2e71
Update townhalls.md 2020-07-31 15:18:05 -07:00
John Plaisted
217044efc8
Update townhalls.md 2020-07-31 15:09:44 -07:00
John Plaisted
5ea160b655
Update townhalls.md 2020-07-31 08:36:08 -07:00
Mars Lan
1424b1723d
Update faq.md 2020-07-31 06:33:02 -07:00
Mars Lan
4060960a15
Update entity.md 2020-07-31 05:46:12 -07:00
shakti-garg-saxo
b80c14d543
Update kafka-config.md (#1763) 
Fix name of spring-kafka property to pass SASL_JAAS config
 2020-07-31 04:10:21 -07:00
Liangjun Jiang
dfb74c6285
docs: add a sequence diagram and a description (#1757) 
* add a sequence diagram and a description

* update descrpition based on feedback

* Update README.md

* Update README.md

Co-authored-by: Mars Lan <mars.th.lan@gmail.com>
 2020-07-30 13:02:54 -07:00
John Plaisted
c5738d6403
Add documentation around the DataHub RFC process. (#1754) 
Other repos have similar RFC processes (though they seem to have a separate repo for their RFC docs).

This provides a more structured way for contributors to make siginficant design contributions.

https://github.com/linkedin/datahub/issues/1692
 2020-07-28 16:43:40 -07:00
Jyoti Wadhwani
8eca685be3
Update townhalls.md 2020-07-27 10:33:24 -07:00
Jyoti Wadhwani
778756b642
Agenda for next town hall 2020-07-27 10:28:33 -07:00
Javier Sotelo
ad4c80a753
feat(kafka-config): Add ability to configure other Kafka props (#1745) 
* Integarte spring-kafka & spring-boot for security props

- Upgrade spring-kafka to 2.1.14
- Use KafkaListener and KafkaTemplates to enable KafkaAutoConfiguration
- Integrates spring-boot's KafkaProperties into spring-kafka's config

* Cleanup imports

* Add DataHub kafka env vars

* Remove kafka-streams dependency

* Add KafkaProperties to gms; Add docs

* Add to Adoption

* Remove KAFKA_BOOTSTRAP_SERVER default

Co-authored-by: jsotelo <javier.sotelo@viasat.com>
Co-authored-by: Kerem Sahin <ksahin@linkedin.com>
 2020-07-27 05:22:51 -07:00
Mars Lan
0a8acb8ae2
Update README.md 2020-07-26 11:26:48 -07:00
Mars Lan
fe52c8e05c
Update README.md 2020-07-26 11:08:13 -07:00
Mars Lan
aa34e1999f
Update README.md 2020-07-26 10:59:58 -07:00
Mars Lan
adf975ee18
build: build GitHub Pages from /docs directory (#1752) 
- Move non-README top-level MD files to /docs
- Update all absolute links to files in /docs to relative links
- Add a placeholder front page for GitHub Pages
 2020-07-26 10:41:32 -07:00
Mars Lan
3e4c110723
Revert "build: build GitHub Page from /docs directory (#1750)" (#1751) 
This reverts commit b0f56de7a81b8bf921ff37cb81024692d1b9a8ce.
 2020-07-26 10:24:41 -07:00
Mars Lan
b0f56de7a8
build: build GitHub Page from /docs directory (#1750) 
- Move top-level MD files to /docs and symlink them back
- Update all absolute links to files in /docs to relative links
 2020-07-26 10:22:35 -07:00
Mars Lan
2031c09663
Delete _config.yml 2020-07-26 08:10:37 -07:00
Mars Lan
b47277ac31 Set theme jekyll-theme-cayman 2020-07-26 08:05:20 -07:00
Mars Lan
9ecd8de99c
Update faq.md 2020-07-26 07:58:00 -07:00
Mars Lan
aefa725ada
Update roadmap.md 2020-07-26 07:27:55 -07:00
Kerem Sahin
bb9a6cec19 Doc fixes 2020-07-25 19:47:12 -07:00