yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-08-16 21:27:03 +00:00
Code Issues Packages Projects Releases Wiki Activity

chore(ci): avoid dep on confluent-kafka 2.8.1 (#12753)

Browse Source
This commit is contained in:
Harshal Sheth 2025-02-28 10:14:07 -08:00 committed by GitHub
parent fc26c1cfb5
commit 61d4992cc9
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
metadata-ingestion/setup.py
View File

@ -77,7 +77,10 @@ kafka_common = {
# now provide prebuilt wheels for most platforms, including M1 Macs and # now provide prebuilt wheels for most platforms, including M1 Macs and
# Linux aarch64 (e.g. Docker's linux/arm64). Installing confluent_kafka # Linux aarch64 (e.g. Docker's linux/arm64). Installing confluent_kafka
# from source remains a pain. # from source remains a pain.
"confluent_kafka[schemaregistry,avro]>=1.9.0", # With the release of 2.8.1, confluent-kafka only released a source distribution,
# and no prebuilt wheels.
# See https://github.com/confluentinc/confluent-kafka-python/issues/1927
"confluent_kafka[schemaregistry,avro]>=1.9.0, != 2.8.1",
# We currently require both Avro libraries. The codegen uses avro-python3 (above) # We currently require both Avro libraries. The codegen uses avro-python3 (above)
# schema parsers at runtime for generating and reading JSON into Python objects. # schema parsers at runtime for generating and reading JSON into Python objects.
# At the same time, we use Kafka's AvroSerializer, which internally relies on # At the same time, we use Kafka's AvroSerializer, which internally relies on