Tamas Nemeth
a1291faad9
feat(actions): Moving datahub-actions into oss datahub ( #13120 )
2025-04-16 12:23:29 +02:00
Chakru
5b1e194a3c
build: use docker bake to build all images in a single step ( #13191 )
2025-04-15 09:48:11 +05:30
david-leifker
b9e5d213b2
feat(openapi): platform events endpoint ( #13179 )
2025-04-11 08:55:03 -05:00
david-leifker
f527c5ed55
feat(iceberg-rest): implement iceberg REST catalog api ( #12500 )
...
Co-authored-by: ksrinath <ksrinath@users.noreply.github.com>
Co-authored-by: Chakravarthy Racharla <chakru.racharla@acryl.io>
2025-01-30 15:38:15 +05:30
Harshal Sheth
b252f782c5
feat(build): use remote gradle cache ( #12344 )
2025-01-14 17:04:49 -08:00
Aseem Bansal
58b6a5bee5
dev: add pre-commit hooks installed by default ( #12293 )
2025-01-08 21:57:55 +05:30
Harshal Sheth
08605a95a7
feat(python): split out temp wheel builds ( #12157 )
2024-12-19 08:02:37 -08:00
Shirshanka Das
f9cc67dd31
feat(schematron): add java capabilities for schema translation ( #11963 )
2024-11-26 16:03:22 -06:00
dushayntAW
6204cba2bb
fix(ingestion/prefect-plugin): Prefect plugin ( #10643 )
...
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-08-29 15:40:10 +02:00
Mayuri Nehate
9568a4254d
feat: separate great-expectations action package ( #11096 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-21 12:13:36 -04:00
Tamas Nemeth
f4fb89e799
feat(ingest/spark): Promote beta plugin ( #10881 )
...
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
david-leifker
6ed21bd1bc
feat(plugins): spring custom plugins ( #10389 )
...
Co-authored-by: Kevin Chun <kevinchun@netflix.com>
Co-authored-by: Kevin Chun <kevin1chun@gmail.com>
2024-05-09 14:56:03 -05:00
Tamas Nemeth
7e5610f358
feat(ingest/dagster): Dagster source ( #10071 )
...
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
2024-03-25 13:28:35 +01:00
david-leifker
f9e64d03cc
feat(auth): view authorization ( #10066 )
2024-03-23 06:15:36 -05:00
RyanHolstien
d55210663f
feeat(openapi): add batch endpoint to v2 using requestbody ( #10100 )
2024-03-21 15:15:29 -05:00
Tamas Nemeth
6eb5f80a9a
Openlineage endpoint and Spark Lineage Beta Plugin ( #9870 )
...
Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-03-01 09:31:21 -06:00
david-leifker
ed10a8d8cc
feat(search): search access controls ( #9892 )
...
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
RyanHolstien
131c8f878c
feat(kafka): add health indicator for kafka ( #9662 )
2024-01-19 13:44:48 -06:00
david-leifker
c2bc41d15e
fix(health): fix health check url authentication ( #9117 )
2023-11-03 12:29:31 -05:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 ( #9031 )
2023-10-18 13:45:46 -05:00
david-leifker
56c00f5586
feat(openapi): entity endpoints & analytics raw ( #8537 )
2023-09-07 17:09:52 -05:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates ( #8456 )
2023-09-02 19:25:44 -05:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module ( #8306 )
2023-07-20 06:39:14 +05:30
RyanHolstien
10e5ecf6d2
fix(async): submit additional default aspects only when not in async mode ( #8320 )
2023-06-30 15:56:12 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry ( #7930 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
Indy Prentice
3bd637843f
feat(elasticsearch): Add servlet which provides an endpoint for a healthcheck on the ES cl… ( #7799 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-04-20 11:12:00 -05:00
RyanHolstien
0d5873db2a
feat(patch): patch support for flow info and job info and refactor patchbuilders for java sdk ( #7495 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: David Leifker <david.leifker@acryl.io>
2023-04-13 15:46:35 -05:00
david-leifker
0a9dc73402
build(docker): metadata-ingestion images build and add slim version ( #7412 )
2023-03-20 18:06:35 -05:00
david-leifker
571970cf62
Dockerize updates ( #7387 )
2023-02-22 15:43:11 +05:30
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) ( #6744 )
...
* fix(security): commons-text in frontend
* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint
* testing docker build
* Add retry configuration options for entity client
* Kafka debugging
* fix(kafka-setup): parallelize topic creation
* Adjust docker build
* Docker build updates
* WIP
* fix(lint): metadata-ingestion lint
* fix(gradle-docker): fix docker frontend dep
* fix(elastic): fix race condition between gms and mae for index creation
* Revert "fix(elastic): fix race condition between gms and mae for index creation"
This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.
* fix(test): fix datahub frontend test for clean/test cycle
* fix(test): datahub-frontend missing assets in test
* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer
* gitingore update
* fix(docker): remove platform on docker base image, set by buildx
* refactor(kafka-producer): update kafka producer tracking/logging
* updates per PR feedback
* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
david-leifker
be9348b518
fix(build): rename conflicting module auth-api ( #6728 )
...
* fix(build): rename conflicting module `auth-api`
2022-12-09 18:06:51 -06:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework ( #6634 )
2022-12-06 10:22:41 -08:00
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms ( #4999 )
2022-08-01 09:47:08 -07:00
Shirshanka Das
238fca5191
chore: remove unnecessary modules from codebase ( #5420 )
2022-07-17 22:02:45 -07:00
Navin Sharma
ee7c5f75a2
Add Changes to support smoke test on Datahub deployed on kubernetes Cluster ( #5334 )
...
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2022-07-14 22:04:06 +05:30
Tamas Nemeth
c131e13582
feat(airflow): Airflow lineage ingestion plugin ( #4833 )
...
feat(airflow): Airflow lineage ingestion plugin (#4833 )
2022-05-25 09:12:11 +02:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
leifker
bb8f45bd20
feat(ingestion): add java protobuf schema ingestion ( #4178 )
...
Co-authored-by: leifker <david.leifker@landsend.com>
2022-03-11 10:13:00 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity ( #4252 )
2022-02-24 19:40:55 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) ( #3975 )
2022-01-27 10:33:12 -08:00
Swaroop Jagadish
3e234a992c
feat(java-emitter): improvements to builder API-s, moving spark-lineage under metadata-integration/java ( #3819 )
2022-01-04 01:41:09 -08:00
MugdhaHardikar-GSLab
c65609a84a
feat(datahub-client): add Java REST emitter ( #3781 )
2022-01-02 22:48:38 +05:30
MugdhaHardikar-GSLab
5b68a4dff9
feat(spark-lineage): add ability to push data lineage from spark to d… ( #3664 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-12-13 12:00:51 -08:00
Shirshanka Das
842c05980b
feat(metadata-service): support for custom model extensions without forks ( #3630 )
2021-11-28 21:06:27 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! ( #3598 )
2021-11-22 16:33:14 -08:00
Arun Vasudevan
fde42e01e2
Remove GMS GraphQL Service ( #3605 )
2021-11-22 15:53:20 -08:00
John Joyce
a92ab66a3a
refactor(nocode): Final part of No-Code cleanup ( #3477 )
2021-10-31 22:06:36 -07:00
John Joyce
2c5edd88ab
feat(graphql): migrating GraphQL API to metadata-service (nee GMS) ( #3131 )
2021-08-20 10:58:07 -07:00
John Joyce
f3fc0970f3
refactor(build): Remove unnecessary ext modules. ( #3074 )
2021-08-10 22:48:06 -07:00
John Joyce
383bde18f5
chore(frontend): Remove unused files 1/4 ( #3014 )
2021-08-09 09:48:05 -07:00
