Claudio Benfatto aeefde4fa1

feat(ingestion): Kafka stateful ingestion (#4028) ...

* test: test stateful ingestion for kafka

test: some more advancement

test: some improvements

refactoring

* refactor: remove some linter modifications

* tests: add unit tests for kafka state

* refactor: minor changes

* tests: improve test coverage

* fix: fix naming

* style: fix format with black

* fix: fix broken test

* revert: revert smoke tests to master

* feat: add reporting to kafka source

* tests: add smoke tests for kafka reporting

* revert: revert changes to the smoke tests

* test: add kafka integration test for stateful ingestion

* docs: update documentation on kafka source

* fix: return empty string when no platform instance

* revert: remove unwanted file

* fix: solve problem with platform instance

* chore: use console sink instead of file

* fix: disable complexity check for _extract_record

* fix: remove if condition in get_platform_instance_id

* chore: remove unneeded integration test

* test: test platform instance in kafka source unit tests

2022-02-15 07:18:36 -08:00

..

broker.env

…

create_key_value_topic.py

fix(ingest): fixing support for kafka key schemas when only key schemas are present (#3379)

2021-10-12 18:50:39 -07:00

docker-compose.yml

fix(ingest): fixing support for kafka key schemas when only key schemas are present (#3379)

2021-10-12 18:50:39 -07:00

kafka_mces_golden.json

Data domain containers ingestion (#4051)

2022-02-07 09:51:49 -08:00

kafka_to_file.yml

Data domain containers ingestion (#4051)

2022-02-07 09:51:49 -08:00

key_schema.avsc

…

schema-registry.env

…

send_records.sh

fix(ingest): fixing support for kafka key schemas when only key schemas are present (#3379)

2021-10-12 18:50:39 -07:00

test_kafka_state.py

feat(ingestion): Kafka stateful ingestion (#4028)

2022-02-15 07:18:36 -08:00

test_kafka.py

refactor(test): replace CliRunner with run_datahub_cmd method (#3746)

2021-12-16 20:07:38 -08:00

value_schema.avsc

…

zookeeper.env

…