datahub/metadata-ingestion/tests/integration/kafka/kafka_to_file.yml

run_id: kafka-test

source:
  type: kafka
  config:
    ingest_schemas_as_entities: true
    connection:
      bootstrap: "localhost:29092"
      schema_registry_url: "http://localhost:28081"
    domain:
      "urn:li:domain:sales":
        allow:
          - "key_value_topic"
sink:
  type: file
  config:
    filename: "./kafka_mces.json"
feat: Adding support for nested schemas in ingestion and visualization (#3079) 2021-08-11 15:47:18 -07:00			`run_id: kafka-test`

			`source:`
			`type: kafka`
			`config:`
feat(ingest/kafka): Flag for optional schemas ingestion (#12077) 2024-12-11 17:02:31 +01:00			`ingest_schemas_as_entities: true`
feat: Adding support for nested schemas in ingestion and visualization (#3079) 2021-08-11 15:47:18 -07:00			`connection:`
chore(ingest): change kafka connect mapped ports (#7728) 2023-04-04 18:38:30 +05:30			`bootstrap: "localhost:29092"`
			`schema_registry_url: "http://localhost:28081"`
Data domain containers ingestion (#4051) 2022-02-07 18:51:49 +01:00			`domain:`
feat(ingest): improve domain ingestion usability (#5366) 2022-07-11 09:37:38 -07:00			`"urn:li:domain:sales":`
Data domain containers ingestion (#4051) 2022-02-07 18:51:49 +01:00			`allow:`
			`- "key_value_topic"`
feat: Adding support for nested schemas in ingestion and visualization (#3079) 2021-08-11 15:47:18 -07:00			`sink:`
			`type: file`
			`config:`
			`filename: "./kafka_mces.json"`