david-leifker
aef49b8fb2
feat(entity-client): enable client side cache for entity-client and usage-client ( #8877 )
2023-09-21 22:00:14 -05:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x ( #8852 )
2023-09-21 13:01:55 -05:00
Hyejin Yoon
31abf383d1
ci: add markdown-link-check ( #8771 )
2023-09-14 11:34:21 +09:00
ethan-cartwright
785ab7718d
fix(siblingsHook): check number of dbtUpstreams instead of all upStreams ( #8817 )
...
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
2023-09-13 08:45:58 +01:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates ( #8456 )
2023-09-02 19:25:44 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update ( #8745 )
2023-09-01 19:36:01 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images ( #8515 )
2023-08-17 10:40:17 +05:30
Indy Prentice
27392f9f81
refactor(search): Support searching multiple entities in search() as in scroll() ( #8461 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-24 15:39:44 -03:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module ( #8306 )
2023-07-20 06:39:14 +05:30
david-leifker
3dba524b1c
fix(test): consolidate mae-consumer test entity registry ( #8309 )
2023-06-27 13:28:34 +05:30
RyanHolstien
6ce0a248fd
feat(ui): create fast path for immediate processing of ui sourced changes ( #8200 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-15 16:47:13 +05:30
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default ( #8053 )
2023-05-23 11:38:58 -05:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg ( #7999 )
2023-05-17 10:32:23 -05:00
Harshal Sheth
e70d0b3859
fix(ingest/dbt): fix dbt subtypes for sources ( #8048 )
2023-05-16 11:11:26 -07:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry ( #7930 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
david-leifker
87aa792f22
fix(consumer): fix datahub usage event topic consumer ( #7866 )
2023-05-01 09:28:11 -05:00
david-leifker
2ffa39f009
Logging and test models fixes ( #7884 )
2023-04-21 15:45:20 -05:00
RyanHolstien
cbf0809c4c
chore(snakeyaml): upgrade to snakeyaml 2 ( #7786 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-04-13 12:01:51 -05:00
david-leifker
82e55636a7
feat(search): allow longer customProperties ( #7804 )
2023-04-12 16:59:11 -05:00
RyanHolstien
8ffb6a3585
feat(config): allow hooks to be enabled/disabled ( #7761 )
2023-04-07 11:10:05 -05:00
david-leifker
1b15dd484f
lint(test): remove unused imports, other test fixes ( #7659 )
2023-03-21 16:53:04 -05:00
RyanHolstien
8963e53bbd
fix(revert): remove unnecessary class check ( #7658 )
2023-03-21 12:53:39 -05:00
Shirshanka Das
fc9ad49821
fix(platform): Ensure time based lineage handles noop changes ( #7657 )
...
Co-authored-by: aditya-radhakrishnan <aditya@acryl.io>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2023-03-21 10:43:56 -05:00
Bowen Hu
a84ec0ccf8
feat(metadata-io): add support in Neo4jGraphService for lineage time filter ( #7375 )
2023-03-16 15:54:49 -07:00
david-leifker
72198f98c0
feat(search): searchAcrossEntities/Lineage improvements ( #7550 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-12 18:18:51 -07:00
John Joyce
d54e3b81cf
fix(lineage): Fixing Timeline Lineage Filters ( #7435 )
2023-02-27 16:00:57 -08:00
Pedro Silva
4f8a5c3800
feat(timeBasedLineage): add feature flag for always producing MCL ( #7407 )
2023-02-22 15:52:51 +00:00
david-leifker
751289c9e3
fix(gradle): fix gradle command referenced in docs ( #7318 )
2023-02-16 18:27:53 -06:00
david-leifker
267472ccbb
gradle(development): add additional commands for development ( #7321 )
2023-02-16 10:41:42 -06:00
david-leifker
b4b3a39829
fix(system-update): fixes system-update with more than 1 partition ( #7302 )
2023-02-09 18:54:20 -06:00
Aseem Bansal
0f8f186bd0
chore(logs): clean logs scanning location ( #7261 )
2023-02-07 16:41:39 +05:30
Aditya Radhakrishnan
c13e7e09f8
feat(lineage): add time filtering for lineage edges ( #7159 )
2023-02-02 15:30:49 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
RyanHolstien
af3fa6f22d
fix(diffMode): prevent misconfiguration of diff mode ( #7127 )
2023-01-24 15:15:41 -08:00
Aseem Bansal
192aac4271
chore: misc fixes ( #6966 )
2023-01-09 14:12:36 +05:30
david-leifker
122c024bab
refactor(gradle): move the local docker registry to common location ( #6881 )
2022-12-29 15:08:36 +05:30
david-leifker
b5275acab8
test(mce-consumer): mockbeans ( #6878 )
2022-12-28 16:18:10 -06:00
david-leifker
cb6314c51d
fix(elasticsearch): fixes out of order runId writes ( #6845 )
...
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-27 17:50:11 -06:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Chris Collins
f559dcc282
feat(lineage) Adds ability to edit lineage manually from the UI ( #6816 )
2022-12-20 10:54:08 -05:00
david-leifker
be9348b518
fix(build): rename conflicting module auth-api ( #6728 )
...
* fix(build): rename conflicting module `auth-api`
2022-12-09 18:06:51 -06:00
Chris Collins
b6887d23bb
feat(graph) Add createdOn, createdActor, updatedOn, updatedActor to graph edges ( #6615 )
2022-12-05 16:56:28 -05:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible ( #6616 )
2022-12-04 19:57:47 -08:00
Maciej Bryński
10deee7333
docs(): remove Kafka Streams from documentation ( #6596 )
2022-12-01 15:24:25 -08:00
John Joyce
7136dd5ae6
feat(platform): Support @Searchable + @Relationship Annotations for Timeseries Aspects ( #6455 )
2022-11-28 18:17:40 -08:00
Peter Szalai
dc739878a8
fix(loggin): print logging timestamp in ISO8601 format instead of just time ( #6474 )
2022-11-17 12:33:56 +01:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests ( #6269 )
2022-11-15 18:03:11 -08:00
Chris Collins
1d944beb0a
feat(lineage) Implement CLL impact analysis for inputFields ( #6426 )
2022-11-15 16:45:19 -05:00
Aditya Radhakrishnan
873b100a47
refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators ( #6320 )
...
* refactor(change-events): refactor AspectDiffers to EntityChangeEventGenerators
* feat(change-event): add change events for AssertionRunEvent
* feat(change-event): add change events for DataProcessInstanceRunEvent
2022-11-01 09:53:43 -07:00
Chris Collins
cd1331fffe
feat(lineage) Add column-level impact analysis feature ( #6272 )
2022-10-26 16:43:39 -04:00
