12004 Commits

Author SHA1 Message Date
Mars Lan
1efe249e3b
refactor: remove unused internal models (#1789) 2020-08-08 13:46:24 -07:00
Mars Lan
6d62713c6b
refactor: remove unused model (#1788) 2020-08-08 05:14:36 -07:00
Mars Lan
aa0a62e991
Update README.md 2020-08-08 04:58:55 -07:00
John Plaisted
5d394c6062
build: fix docker actions. (#1787)
* bug: Fix docker actions.

We renamed directories in docker/ which broke the actions.

Also try to refactor the action files a little so that we can run (but not publish) these images on pull requests that change the docker/ dir as an extra check. Note this only seems to be supported by the dockerhub plugin; the github plugin doesn't support this (so that will be an issue when we move to it only).

* Drop extra pipes
2020-08-07 19:15:09 -07:00
John Plaisted
b8e18b0b5d
refactor(docker): make docker files easier to use during development. (#1777)
* Make docker files easier to use during development.

During development it quite nice to have docker work with locally built code. This allows you to launch all services very quickly, with your changes, and optionally with debugging support.

Changes made to docker files:
- Removed all redundant docker-compose files. We now have 1 giant file, and smaller files to use as overrides.
- Remove redundant README files that provided little information.
- Rename docker/<dir> to match the service name in the docker-compose file for clarity.
- Move environment variables to .env files. We only provide dev / the default environment for quickstart.
- Add debug options to docker files using multistage build to build minimal images with the idea that built files will be mounted instead.
- Add a docker/dev.sh script + compose file to easily use the dev override images (separate tag; images never published; uses debug docker files; mounts binaries to image).
- Added docs/docker documentation for this.
2020-08-06 16:38:53 -07:00
John Plaisted
43dfce8b2f
Update rfc.md 2020-08-06 09:58:04 -07:00
Mars Lan
abd63fb029
Update townhall-history.md 2020-08-06 06:30:02 -07:00
Mars Lan
6275a3cbe8
Update townhall-history.md 2020-08-06 06:29:31 -07:00
Mars Lan
440ac687fe
Update README.md 2020-08-06 06:20:58 -07:00
Mars Lan
8e32f41828
Update aspect.md 2020-08-06 05:12:30 -07:00
Mars Lan
687dc3ae9a
Update aspect-versioning.md 2020-08-06 05:10:51 -07:00
Mars Lan
16bdf64852
Update README.md 2020-08-05 21:13:34 -07:00
Mars Lan
009eff0aef
docs: more placeholders for advance topics (#1781)
* Create aspect-versioning.md

* Create derived-aspects.md

* Create backfilling.md
2020-08-05 20:09:51 -07:00
Mars Lan
401b21a871
docs: add placeholders for advanced topics (#1780)
* Create high-cardinality.md

* Create pdl-best-practices

* Create partial-update.md

* Rename pdl-best-practices to pdl-best-practices.md

* Create entity-hierarchy.md
2020-08-05 19:25:55 -07:00
Kerem Sahin
528ee961f6
Fix README.md 2020-08-03 17:41:21 -07:00
Mars Lan
d67f85ae70
Update README.md 2020-08-03 15:37:24 -07:00
Mars Lan
03f1d78ef8
build(docker): build & publish GitHub Package (#1771)
* build(docker): build & publish docker images to GitHub Packages

Will kepp publishing to Docker Hub meanwhile until all Dockerfiles have been updated to point to GitHub.
Fixes https://github.com/linkedin/datahub/issues/1548

* Rebase & fix dockerfile locations
2020-08-03 13:08:05 -07:00
John Plaisted
776b0c1a07
Update townhalls.md 2020-08-03 12:29:07 -07:00
John Plaisted
e0a6e0feef
Update README.md 2020-08-03 12:28:44 -07:00
John Plaisted
4f344c8877
update townhall date 2020-08-03 12:05:11 -07:00
John Plaisted
a60d650787
build: remove travis (we're using GitHub actions). (#1770)
Remove travis (we're using GitHub actions).

Also ignore markdown in our current workflows.

Also update the README.md badge.
2020-08-03 12:00:28 -07:00
Mars Lan
d5ff7a52fd
Update README.md 2020-08-03 11:03:21 -07:00
John Plaisted
e6c78400de
Update for August invite; link to history 2020-08-03 10:49:25 -07:00
John Plaisted
80112ad196
Add a separate page for previous townhalls 2020-08-03 10:41:46 -07:00
Mars Lan
9bcb38bf9e
Update README.md 2020-08-03 05:20:20 -07:00
Mars Lan
352eb3fff0
fix(models): remove unused model (#1748)
* fix(models): remove unused model

Fixes https://github.com/linkedin/datahub/issues/1719

* Drop DeploymentInfo from Dataset's value model & rebuild snapshot
2020-08-02 14:06:20 -07:00
Mars Lan
9b06eda7d4
Update README.md 2020-08-01 19:11:46 -07:00
Mars Lan
6044a86f76
Update developers.md 2020-08-01 16:17:43 -07:00
Mars Lan
91668fc566
Update developers.md 2020-08-01 15:17:21 -07:00
John Plaisted
c56936b9ff
Add workflow to check build and tests on PRs + releases. (#1769)
PRs are setup to skip docs.

Also, only run docker actions on linkedin/datahub (i.e. disable on forks; makes forks nicer since you don't have failing actions).
2020-08-01 14:54:32 -07:00
Mars Lan
4b6b1dd192
Update metadata-ingestion.md 2020-08-01 07:52:29 -07:00
Mars Lan
0a886b6ef2
Update slack.md 2020-08-01 05:08:46 -07:00
Mars Lan
6d22a1c0ac
Update README.md 2020-08-01 05:07:33 -07:00
Mars Lan
8c77457182
Update slack.md 2020-08-01 05:06:30 -07:00
Mars Lan
35e9c24521
docs: move quickstart guide to a separate file under docs (#1765)
docs: move quickstart guide to a separate doc under docs directory
2020-07-31 18:48:18 -07:00
Jyoti Wadhwani
a1d33f2e71
Update townhalls.md 2020-07-31 15:18:05 -07:00
John Plaisted
217044efc8
Update townhalls.md 2020-07-31 15:09:44 -07:00
Chris Lee
381c3e7fcd
Update README.md 2020-07-31 12:29:39 -07:00
John Plaisted
5ea160b655
Update townhalls.md 2020-07-31 08:36:08 -07:00
Mars Lan
1424b1723d
Update faq.md 2020-07-31 06:33:02 -07:00
Mars Lan
80e01625de
Update README.md 2020-07-31 06:31:44 -07:00
Mars Lan
4060960a15
Update entity.md 2020-07-31 05:46:12 -07:00
shakti-garg-saxo
b80c14d543
Update kafka-config.md (#1763)
Fix name of spring-kafka property to pass SASL_JAAS config
2020-07-31 04:10:21 -07:00
shakti-garg-saxo
54523e164e
Fix reflinks in PR template (#1764) 2020-07-31 04:09:37 -07:00
Mars Lan
1be0916fa2
Update README.md 2020-07-30 16:13:22 -07:00
Liangjun Jiang
dfb74c6285
docs: add a sequence diagram and a description (#1757)
* add a sequence diagram and a description

* update descrpition based on feedback

* Update README.md

* Update README.md

Co-authored-by: Mars Lan <mars.th.lan@gmail.com>
v0.4.2
2020-07-30 13:02:54 -07:00
Chris Lee
4143fb901e
<refactor>[ingestions]: align the default kafka topics with PR #1756 (#1758) 2020-07-29 20:26:01 -07:00
Jyoti Wadhwani
779eaeed70
metadata-models 72.0.8 -> 80.0.0 (#1756) 2020-07-29 11:42:35 -07:00
John Plaisted
c5738d6403
Add documentation around the DataHub RFC process. (#1754)
Other repos have similar RFC processes (though they seem to have a separate repo for their RFC docs).

This provides a more structured way for contributors to make siginficant design contributions.

https://github.com/linkedin/datahub/issues/1692
2020-07-28 16:43:40 -07:00
Mars Lan
80f7770788
Update README.md 2020-07-28 08:32:13 -07:00