45 Commits

Author SHA1 Message Date
Esteban Gutierrez
8a17ba14d6
fix(): Fixes multiple minor security vulnerabilities (#13222)
bug(snappy): Make sure right snappy version is installed
fix(docker): update Dockerize to version v0.9.3
fix(gms): fixes dgraph4j netty deps
fix(docker): remove SGID on /home/datahub and /home/datahub-integration
fix(datahub-actions): bump setuptools and wheel version
fix(docker): update c-ares version
fix(docker): datahub-actions addendum
2025-04-21 16:39:26 -05:00
david-leifker
2add837621
fix(): handle null systemmetadata corner cases (#13086) 2025-04-10 17:44:58 -05:00
Chakru
cf40116680
CI speedup (#13057) 2025-04-07 10:13:07 +05:30
Chakru
40106be208
build: optimizations for incremental builds and faster CI (#13033)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-02 11:51:10 +05:30
david-leifker
210e2c1fa2
chore(alpine): bump alpine images 3.21 (#12302) 2025-01-09 14:32:18 -06:00
david-leifker
327c6f911a
chore(bump): bump alpine and dockerize (#12184) 2024-12-20 15:59:07 -06:00
Aseem Bansal
082ef5b351
build: fix docker warnings (#11163) 2024-08-14 14:23:11 +05:30
david-leifker
033114d522
chore(alpine): update alpine base image (#10754) 2024-06-20 11:12:36 -05:00
david-leifker
bcb40d3d71
chore(security): updates for security vulnerabilities (#10740) 2024-06-18 11:28:39 -05:00
Davi Arnaut
2df0d1aa70
fix(mysql-setup): specify charset and collation when creating table (#9817) 2024-02-12 14:22:20 -08:00
noggi
3e79a1325c
Pin alpine base image version to 3.18 (#9421) 2023-12-08 15:37:12 -06:00
Hendrik Richert
966cb175f7
feat(dev): Make repositories configurable for enterprise developers (#9230)
Co-authored-by: Hendrik Richert <hendrik.richert@swisscom.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-11-28 14:52:11 -06:00
david-leifker
ff90fb633d
fix(datahub-ingestion): prevent transitive deps, bump addtional pyspa… (#9233) 2023-11-13 16:26:53 -06:00
Davi Arnaut
ddb4e1b5ff
fix(mysql-setup): quote database name (#9169) 2023-11-03 10:26:11 -07:00
RyanHolstien
6f466b0e50
chore(docker): update base images to alpine 3.18 (#8967) 2023-10-17 15:40:38 -05:00
Aseem Bansal
6ecdeda5ff
fix(setup): drop older table if exists (#8979) 2023-10-10 16:28:40 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
david-leifker
82272aed03
chore(deprecate): remove legacy sql table (#8253) 2023-06-23 12:41:10 +05:30
Kevin Meyer
34f8f17a55
fix(PFP-260): Upgrading sqlite to fix SQLITE-449762 (#8032) 2023-05-12 13:03:43 -04:00
Andrew Zures
39ddab8d46
fix(deploy): add missing plugin files for mysql-client library in mysql-setup (#7909) 2023-04-28 14:33:33 -05:00
david-leifker
571970cf62
Dockerize updates (#7387) 2023-02-22 15:43:11 +05:30
david-leifker
267472ccbb
gradle(development): add additional commands for development (#7321) 2023-02-16 10:41:42 -06:00
david-leifker
4b7f3b2ea7
fix(docker): fix ability to use non-default reg (#7250) 2023-02-06 15:19:11 +05:30
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
tony csoka
1149cea1c8
fix(docker): support non amd64 dockerize in setup containers (#7091)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-01-23 10:25:33 +00:00
david-leifker
ecc01b9a46
refactor(restli-mce-consumer) (#6744)
* fix(security): commons-text in frontend

* refactor(restli): set threads based on cpu cores
feat(mce-consumers): hit local restli endpoint

* testing docker build

* Add retry configuration options for entity client

* Kafka debugging

* fix(kafka-setup): parallelize topic creation

* Adjust docker build

* Docker build updates

* WIP

* fix(lint): metadata-ingestion lint

* fix(gradle-docker): fix docker frontend dep

* fix(elastic): fix race condition between gms and mae for index creation

* Revert "fix(elastic): fix race condition between gms and mae for index creation"

This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3.

* fix(test): fix datahub frontend test for clean/test cycle

* fix(test): datahub-frontend missing assets in test

* fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer

* gitingore update

* fix(docker): remove platform on docker base image, set by buildx

* refactor(kafka-producer): update kafka producer tracking/logging

* updates per PR feedback

* Add documentation around mce standalone consumer
Kafka consumer concurrency to follow thread count for restli & sql connection pool

Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 16:09:08 +00:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. (#6612)
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
Pedro Silva
4f7b5ac5e6
feat(sql): Add SQL index on createdon field (#6522) 2022-12-02 09:13:47 +00:00
Harshal Sheth
762bcbb168
chore(docker): make curl/wget commands quiet in docker (#5819) 2022-09-04 22:39:08 -07:00
Shirshanka Das
941770f3bc
feat(cli): quickstart - experimental support for backup restore (#5418) 2022-07-24 23:52:25 -07:00
Dexter Lee
d31c00939c
fix(docker): Fix mysql setup bug (#5071) 2022-06-02 10:01:36 +02:00
Mert Tunç
ff04919042
fix(mysql-setup-job): add mysql default port override support (#5036) 2022-06-01 11:46:53 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
John Joyce
664bbd3ec6
fix(mysql-setup): update default mysql collation to utf8mb4_bin (#3459) 2021-10-26 11:23:11 -07:00
John Joyce
33f4d2ede0
fix(upgrade): Improving NoCodeUpgrade logic to account for Bootstrap logic (#3301) 2021-09-28 16:30:49 -07:00
Swaroop Jagadish
d1b57927a9
fix(frontend): replacing broken link for default avatar (#3156) 2021-08-24 21:40:39 -07:00
Dexter Lee
01bc0e8e4c
fix(mysql-setup): Change default charset to utf8mb4 (#3088) 2021-08-12 16:52:00 -07:00
Dexter Lee
65d6c474f6
fix(docker): upgrade base image version (#3072) 2021-08-10 22:22:36 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960) 2021-07-29 20:04:40 -07:00
John Joyce
2a7082b9fc
fix(datahub-upgrade): add support for postgres migration (#2740) 2021-06-23 13:49:49 -07:00
John Joyce
7591c8994a
feat(datahub cli): DataHub CLI Quickstart (#2689) 2021-06-14 17:15:24 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling (#2629)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
Dexter Lee
f018dd6f3e
fix: Fix env variable setup for kafka, mysql-setup docker containers (#2402) 2021-04-14 19:07:50 -07:00
Dexter Lee
7c54004b93
feat(mysql-setup): Add the ability to specify database name for mysql-setup (#2385) 2021-04-13 08:03:50 -07:00
Dexter Lee
d158da7820
feat(docker): Add dockerfile for initializing an existing mysql server (#2298) 2021-03-27 20:26:00 -07:00