10 Commits

Author SHA1 Message Date
Ravindra Lanka
84005d3848
feat(ingest): kafka - add support for non-default schema registry subject name strategies (#4215) 2022-02-22 16:05:46 -08:00
Claudio Benfatto
aeefde4fa1
feat(ingestion): Kafka stateful ingestion (#4028)
* test: test stateful ingestion for kafka

test: some more advancement

test: some improvements

refactoring

* refactor: remove some linter modifications

* tests: add unit tests for kafka state

* refactor: minor changes

* tests: improve test coverage

* fix: fix naming

* style: fix format with black

* fix: fix broken test

* revert: revert smoke tests to master

* feat: add reporting to kafka source

* tests: add smoke tests for kafka reporting

* revert: revert changes to the smoke tests

* test: add kafka integration test for stateful ingestion

* docs: update documentation on kafka source

* fix: return empty string when no platform instance

* revert: remove unwanted file

* fix: solve problem with platform instance

* chore: use console sink instead of file

* fix: disable complexity check for _extract_record

* fix: remove if condition in get_platform_instance_id

* chore: remove unneeded integration test

* test: test platform instance in kafka source unit tests
2022-02-15 07:18:36 -08:00
Aseem Bansal
dbcfe9e50e
docs(kafka): add example for using domains, change for clarity (#4100) 2022-02-09 08:56:27 -08:00
Tamas Nemeth
63bc830cfe
Data domain containers ingestion (#4051) 2022-02-07 09:51:49 -08:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources (#3996) 2022-01-27 15:31:25 -08:00
Aseem Bansal
7498f4bf54
doc(kafka): add permissions required for confluent cloud (#3850) 2022-01-12 14:50:58 -08:00
Aseem Bansal
895af09af2
docs(kafka): add example for ingestion from confluent cloud (#3789) 2021-12-28 07:17:03 -08:00
Seref Acet
fe531b9537
docs: Fix topic_pattern typo in kafka ingestion docs (#3317) 2021-10-03 17:52:25 -07:00
Kevin Hu
5891482114
fix(ingest): apply case insensitive regex matching by default (#3067) 2021-08-10 10:35:57 -07:00
Kevin Hu
32b8fc6108
feat(docs): refactor source and sink ingestion docs (#3031) 2021-08-08 13:40:51 -07:00