Chakru
a8c5202993
telemetry: add support for unified mixpanel + kafka tracking in GMS ( #13795 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2025-06-23 17:01:38 +05:30
david-leifker
1194f910bd
bump(): upgrade Kafka 7.9.1 ( #13667 )
2025-05-30 21:51:36 -05:00
Chakru
90ad3935a7
fix(build): use sync instead of copy so excess files are deleted ( #12925 )
2025-03-20 19:19:00 -07:00
Chakru
7c1ed744f4
fix(build): build improvements to help with incremental builds ( #12823 )
2025-03-10 22:43:31 +05:30
david-leifker
412600a163
feat(telemetry): cross-component async write tracing ( #12405 )
2025-01-29 11:30:44 -06:00
Chakru
638a0e370e
build(metadata-events): fix shell interpreter mismatch in build script ( #12066 )
2024-12-10 10:31:35 +05:30
Chakru
85b42e3ea5
build(coverage): enable code coverage for java and python ( #11992 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-12-02 19:27:43 -06:00
david-leifker
ede9520b87
feat(schemaField): populate schemaFields with side effects ( #10928 )
2024-09-04 15:36:12 -05:00
david-leifker
f36a597b17
fix(spring): refactor spring configuration ( #10290 )
2024-04-16 13:50:41 -05:00
david-leifker
ed10a8d8cc
feat(search): search access controls ( #9892 )
...
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
david-leifker
63322225d9
misc: datahub-upgrade improvements, aspect key & default aspects fixes ( #9796 )
2024-02-07 14:41:49 -06:00
david-leifker
264278861b
feat(build): support jdk8 spark lineage ( #9697 )
2024-01-23 17:49:23 -06:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint ( #9373 )
2023-12-06 11:02:42 +05:30
david-leifker
f70d8a45b5
chore(security): version adjustments for security vulns ( #9243 )
2023-11-14 19:00:22 -06:00
Harshal Sheth
906a5b91a8
chore(ingest): cleanup various methods ( #9221 )
2023-11-13 21:51:11 -05:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 ( #9031 )
2023-10-18 13:45:46 -05:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x ( #8852 )
2023-09-21 13:01:55 -05:00
Aseem Bansal
3193421976
fix(build): clean task cleanup generated src ( #8844 )
2023-09-15 17:58:30 +05:30
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update ( #8745 )
2023-09-01 19:36:01 +05:30
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity ( #8045 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-26 17:54:09 +01:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg ( #7999 )
2023-05-17 10:32:23 -05:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
Aditya Radhakrishnan
f0f0355a83
feat(onboarding): adds framework and some steps for onboarding steps UI ( #6462 )
...
* feat(onboarding): adds models and API for onboarding steps feature
* feat(onboarding): adds backend for onboarding steps feature
* feat(onboarding): adds framework and some steps for onboarding steps UI
2022-12-07 16:21:55 -08:00
david-leifker
4ca3327d89
fix(security): update ranger commons & dependencies for security vulns ( #6577 )
...
* fix(security): update ranger commons & dependencies for security vulns
2022-11-30 17:05:01 -06:00
Harshal Sheth
9be00e9ba1
build: use acryl's gradle-avro-plugin ( #6390 )
2022-11-09 11:39:05 +01:00
Aditya Radhakrishnan
a58502c5dc
feat(telemetry): add telemetry events to the settings page ( #6198 )
2022-10-13 11:41:47 -07:00
Chris Collins
1f1398605c
feat(lineage) Add Column-Level to Lineage Visualization ( #6138 )
2022-10-06 19:41:18 -04:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint ( #6097 )
...
* feat(ingest): add async option to ingest proposal endpoint
* small tweak to validate before write to K, also keep existing path for timeseries aspects
* avoid double convert
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Gabe Lyons
c41f92c8d0
feat(model): Add optional message field to auditstamp ( #5611 )
...
* adding messge to audit stamp
* Update AuditStamp.pdl
* Update AuditStamp.pdl
2022-08-11 13:48:49 -07:00
RyanHolstien
50f9d3d02e
chore(deps): move from velocity 1.7 to 2.3 ( #4837 )
2022-05-05 14:52:16 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
stephenp-gr
a2d096eb93
ci: update rename-namespace.sh to work on non-bash shells ( #4153 )
2022-02-21 07:48:14 -08:00
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries ( #3835 )
2022-01-05 17:32:31 -08:00
xiphl
8cd1e91072
Upgrade to 3rd Apache patch for log4j ( #3772 )
2021-12-20 06:55:22 -08:00
John Joyce
5b5135be0b
fix(vuln): log4j vulnerability - bumping to 2.16.0 ( #3755 )
2021-12-15 11:07:45 -08:00
Fredrik Sannholm
d651040c85
Fix vulnderability ( #3716 )
2021-12-10 10:07:55 -08:00
Dexter Lee
8757543be8
refactor: remove unused PDL files ( #3659 )
2021-12-02 20:22:19 -08:00
John Joyce
f3fc0970f3
refactor(build): Remove unnecessary ext modules. ( #3074 )
2021-08-10 22:48:06 -07:00
John Joyce
352a0abf8d
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect ( #2983 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest ( #2960 )
2021-07-29 20:04:40 -07:00
Dexter Lee
3caa09d21a
fix(docker): Fix dependency vulnerability ( #2763 )
2021-06-24 23:00:55 -07:00
John Joyce
29832e5385
feat(Product Analytics): Introducing In-App Analytics Beta ( #2499 )
...
Co-authored-by: Harshal Sheth <harshal@acryl.io>
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-05-11 15:41:42 -07:00
John Plaisted
25b663cc18
refactor: move code to linkedin/datahub-gma. ( #1955 )
...
Move code to linkedin/datahub-gma.
"GMA" (Generalized Metadata Architecture) is the backend of DataHub, and has been moved to its own repository.
This deletes the code that was moved and uses jars that GMA publishes to bintray to load it.
Note that not all of GMA was moved, but most of it. We may still move more things to the other repository in the future.
2020-10-23 15:14:57 -07:00
John Plaisted
542ae67cb1
Add support for customizing topic names via a convention.
...
Requested by a few people in OS. See https://github.com/linkedin/datahub/issues/1840 .
Companies need full customization over the topic name. This new class should be easily customizable by using a spring factory.
TODO to finish the implmentation for v5. For right now v5 is LI only and unfinished. Getting this in for v4 so it is useful to other companies now.
TODO AFTER OPEN SOURCE PUSH - make configurable via spring
TODO AFTER SUBMIT - see where else we can use this (jobs, where else?)
2020-09-24 16:02:12 -07:00
John Plaisted
6ece2d6469
Start adding java ETL examples, starting with kafka etl. ( #1805 )
...
Start adding java ETL examples, starting with kafka etl.
We've had a few requests to start providing Java examples rather than Python due to type safety.
I've also started to add these to metadata-ingestion-examples to make it clearer these are *examples*. They can be used directly or as a basis for other things.
As we port to Java we'll move examples to contrib.
2020-09-11 13:04:21 -07:00
Jyoti Wadhwani
779eaeed70
metadata-models 72.0.8 -> 80.0.0 ( #1756 )
2020-07-29 11:42:35 -07:00
Jyoti Wadhwani
ad6f1653e1
metadata-models 62.0.3 -> 72.0.8 ( #1693 )
2020-06-11 10:21:51 -07:00
Jyoti Wadhwani
5fb3c97315
metadata-models 54.0.1 -> 58.0.1 ( #1610 )
...
Changes include:
Remove all keys that can be moved back to respective GMS
Add support for <, <=, >, >= conditions for the filter API
Update Conditions model for <, <=, >, >= conditions
MP_VERSION=metadata-models:58.0.1
MP_VERSION=wherehows-samza:1.0.56
2020-03-26 21:53:29 -07:00
Mars Lan
38fc7249d2
Revert "metadata-models 54.0.1 -> 58.0.1:"
...
This reverts commit bab5daa56d77f067de949f6f0eb5bc7c537641f7.
2020-03-25 21:43:28 -07:00
