12076 Commits

Author SHA1 Message Date
Mars Lan
f87459e0a7
Update README.md 2020-08-19 17:55:05 -07:00
Mars Lan
3950b26f96
fix: drop the commits badge as it's flakey 2020-08-19 16:52:34 -07:00
Mars Lan
2260469a71
Update townhalls.md 2020-08-19 16:38:18 -07:00
John Plaisted
2689d6ef91
Update townhalls.md 2020-08-19 16:09:31 -07:00
John Plaisted
d9b86d1f05
Update metadata-models to head! (#1811)
metadata-models 80.0.0 -> 90.0.13:

   90.0.13: Roll forward: Fix the open source build by avoiding URN method that isn't part of the open source URN.
    90.0.2: Refactor listUrnsFromIndex method
    90.0.0: Start distinguishing between [] aspects vs null aspects input param
    89.0.4: Fix the open source build by avoiding URN method that isn't part of the open source URN.
    89.0.2: fix some test case name
    89.0.0: META-12686: Made the MXE_v5 topics become strictly ACL'ed to avoid the wildcard write ACL as "MetadataXEvent.+"
    88.0.6: change DAO to take Storage Config as input
    88.0.3: Add a comment on lack of avro generation for MXEv5 + add MXEv5 to the pegasus validation task.
   87.0.15: META-12651: Integrate the metadata-models-ext with metadata-models
   87.0.13: add StorageConfig to Local DAO
    87.0.3: Treat empty aspect vs optional aspect same until all clients are migrated
    87.0.2: Treat empty aspect vs optional aspect differently
    87.0.1: META-12533: Skip processing unregistered aspect specific MAE.
    83.0.6: action method to return list of urns from strong consistent index
    83.0.4: Change input param type for batch backfill
    83.0.3: Implement batch backfill
    83.0.1: Implement support for OR filter in browse query
   82.0.10: Throw UnsupportedOperationException for unsupported condition types in search filter
    82.0.6: Implement local secondary backfilling index as part of backfill method
    82.0.5: [strongly consistent index] implement getUrns method
    82.0.4: Add indexing urn fields to the local secondary index
    82.0.0: Render Delta fiels in the MCE_v5.
    81.0.1: Add pegasus to avro conversion for FMCE
    80.0.4: add get all support for BaseSingleAspectEntitySimpleKeyResource
    80.0.2: Add a BaseSearchWriterDAO with an ESBulkWriterDAO implementation.
    80.0.1: META-12254: Produce aspect specific MAE with always emit option
    80.0.0: Convert getNodesInTraversedPath to getSubgraph to return complete view of the subgraph (nodes+edges)
2020-08-19 16:06:29 -07:00
Kerem Sahin
19d6f007da
Update high-cardinality.md 2020-08-19 01:32:23 -07:00
Mars Lan
7f3a686b1a
Update relationship.md 2020-08-18 05:13:01 -07:00
Mars Lan
8dcbb73273
Update README.md 2020-08-17 11:37:40 -07:00
Mars Lan
247858a786
Update high-cardinality.md 2020-08-17 10:21:04 -07:00
Mars Lan
b32839fc73
Update README.md 2020-08-16 10:36:37 -07:00
Mars Lan
c1bd1e0fa3
Update README.md 2020-08-16 10:33:13 -07:00
Chris Lee
c77860e4f5 Revert "Update README.md"
This reverts commit 74a0d7b262a2ac22de9bc52974b721d580914ff0.
2020-08-14 14:59:41 -07:00
Chris Lee
74a0d7b262
Update README.md 2020-08-14 14:36:49 -07:00
Mars Lan
872ca3598a
fix(search): clear description from dataset index when it's cleared (#1808)
Fixes https://github.com/linkedin/datahub/issues/1798
2020-08-14 07:09:27 -07:00
Kerem Sahin
18a3892736
Update quickstart.md 2020-08-14 01:29:50 -07:00
Mars Lan
ca33df2b02
Update townhall-history.md 2020-08-13 07:29:35 -07:00
John Plaisted
ae69e65431
Add log documentation
we didn't end up mounting logs; docker desktop is a better experience
2020-08-12 11:27:47 -07:00
Mars Lan
03e3d49445
feat(ingest): add example crawler for MS SQL (#1803)
Also fix the incorrect assumption on column comments & add sample docker-compose file
2020-08-12 08:51:39 -07:00
na zhang
a13c1e10e6
docs: how to customize the search experience (#1795)
* add description field for dataset index mapping

* documentation on how to customize the search experience
2020-08-10 19:22:08 -07:00
na zhang
97424509d1
add description field for dataset index mapping (#1791) 2020-08-09 17:35:17 -07:00
Mars Lan
b8f1be31bd
Update search-onboarding.md 2020-08-09 13:17:52 -07:00
Jyoti Wadhwani
58d1d7b415
docs: create search-over-new-field.md (#1790)
Add a doc on searching over a new field
2020-08-09 12:06:24 -07:00
Mars Lan
1efe249e3b
refactor: remove unused internal models (#1789) 2020-08-08 13:46:24 -07:00
Mars Lan
6d62713c6b
refactor: remove unused model (#1788) 2020-08-08 05:14:36 -07:00
Mars Lan
aa0a62e991
Update README.md 2020-08-08 04:58:55 -07:00
John Plaisted
5d394c6062
build: fix docker actions. (#1787)
* bug: Fix docker actions.

We renamed directories in docker/ which broke the actions.

Also try to refactor the action files a little so that we can run (but not publish) these images on pull requests that change the docker/ dir as an extra check. Note this only seems to be supported by the dockerhub plugin; the github plugin doesn't support this (so that will be an issue when we move to it only).

* Drop extra pipes
2020-08-07 19:15:09 -07:00
John Plaisted
b8e18b0b5d
refactor(docker): make docker files easier to use during development. (#1777)
* Make docker files easier to use during development.

During development it quite nice to have docker work with locally built code. This allows you to launch all services very quickly, with your changes, and optionally with debugging support.

Changes made to docker files:
- Removed all redundant docker-compose files. We now have 1 giant file, and smaller files to use as overrides.
- Remove redundant README files that provided little information.
- Rename docker/<dir> to match the service name in the docker-compose file for clarity.
- Move environment variables to .env files. We only provide dev / the default environment for quickstart.
- Add debug options to docker files using multistage build to build minimal images with the idea that built files will be mounted instead.
- Add a docker/dev.sh script + compose file to easily use the dev override images (separate tag; images never published; uses debug docker files; mounts binaries to image).
- Added docs/docker documentation for this.
2020-08-06 16:38:53 -07:00
John Plaisted
43dfce8b2f
Update rfc.md 2020-08-06 09:58:04 -07:00
Mars Lan
abd63fb029
Update townhall-history.md 2020-08-06 06:30:02 -07:00
Mars Lan
6275a3cbe8
Update townhall-history.md 2020-08-06 06:29:31 -07:00
Mars Lan
440ac687fe
Update README.md 2020-08-06 06:20:58 -07:00
Mars Lan
8e32f41828
Update aspect.md 2020-08-06 05:12:30 -07:00
Mars Lan
687dc3ae9a
Update aspect-versioning.md 2020-08-06 05:10:51 -07:00
Mars Lan
16bdf64852
Update README.md 2020-08-05 21:13:34 -07:00
Mars Lan
009eff0aef
docs: more placeholders for advance topics (#1781)
* Create aspect-versioning.md

* Create derived-aspects.md

* Create backfilling.md
2020-08-05 20:09:51 -07:00
Mars Lan
401b21a871
docs: add placeholders for advanced topics (#1780)
* Create high-cardinality.md

* Create pdl-best-practices

* Create partial-update.md

* Rename pdl-best-practices to pdl-best-practices.md

* Create entity-hierarchy.md
2020-08-05 19:25:55 -07:00
Kerem Sahin
528ee961f6
Fix README.md 2020-08-03 17:41:21 -07:00
Mars Lan
d67f85ae70
Update README.md 2020-08-03 15:37:24 -07:00
Mars Lan
03f1d78ef8
build(docker): build & publish GitHub Package (#1771)
* build(docker): build & publish docker images to GitHub Packages

Will kepp publishing to Docker Hub meanwhile until all Dockerfiles have been updated to point to GitHub.
Fixes https://github.com/linkedin/datahub/issues/1548

* Rebase & fix dockerfile locations
2020-08-03 13:08:05 -07:00
John Plaisted
776b0c1a07
Update townhalls.md 2020-08-03 12:29:07 -07:00
John Plaisted
e0a6e0feef
Update README.md 2020-08-03 12:28:44 -07:00
John Plaisted
4f344c8877
update townhall date 2020-08-03 12:05:11 -07:00
John Plaisted
a60d650787
build: remove travis (we're using GitHub actions). (#1770)
Remove travis (we're using GitHub actions).

Also ignore markdown in our current workflows.

Also update the README.md badge.
2020-08-03 12:00:28 -07:00
Mars Lan
d5ff7a52fd
Update README.md 2020-08-03 11:03:21 -07:00
John Plaisted
e6c78400de
Update for August invite; link to history 2020-08-03 10:49:25 -07:00
John Plaisted
80112ad196
Add a separate page for previous townhalls 2020-08-03 10:41:46 -07:00
Mars Lan
9bcb38bf9e
Update README.md 2020-08-03 05:20:20 -07:00
Mars Lan
352eb3fff0
fix(models): remove unused model (#1748)
* fix(models): remove unused model

Fixes https://github.com/linkedin/datahub/issues/1719

* Drop DeploymentInfo from Dataset's value model & rebuild snapshot
2020-08-02 14:06:20 -07:00
Mars Lan
9b06eda7d4
Update README.md 2020-08-01 19:11:46 -07:00
Mars Lan
6044a86f76
Update developers.md 2020-08-01 16:17:43 -07:00