diff options
| author | lifengchao <[email protected]> | 2024-02-22 14:34:40 +0800 |
|---|---|---|
| committer | lifengchao <[email protected]> | 2024-02-22 14:34:40 +0800 |
| commit | bfb76be76da30fcd7ec189c671cdb26a15713863 (patch) | |
| tree | 82259a6dd0c84cace2bda63a5a6daa55bc86201e /docs/connector | |
| parent | 45d68199735d0c0d3ac460c1f594c22fbced5250 (diff) | |
[feature][connector-kafka] kafka sink增加log.failures.only配置控制log发送失败是否抛出异常
Diffstat (limited to 'docs/connector')
| -rw-r--r-- | docs/connector/formats/json.md | 2 | ||||
| -rw-r--r-- | docs/connector/formats/protobuf.md | 2 | ||||
| -rw-r--r-- | docs/connector/sink/kafka.md | 15 |
3 files changed, 10 insertions, 9 deletions
diff --git a/docs/connector/formats/json.md b/docs/connector/formats/json.md index 8be2959..073c888 100644 --- a/docs/connector/formats/json.md +++ b/docs/connector/formats/json.md @@ -12,7 +12,7 @@ Event serialization and deserialization format. | Name | Type | Required | Default | Description | |---------------------------|----------|----------|---------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | format | String | Yes | - | Specify what format to use, here should be 'json'. | -| json.ignore.parse.errors | Boolean | No | true | Skip fields and rows with parse errors instead of failing. Fields are set to null in case of errors. | +| json.ignore.parse.errors | Boolean | No | false | Skip fields and rows with parse errors instead of failing. Fields are set to null in case of errors. | # How to use ## Inline uses example diff --git a/docs/connector/formats/protobuf.md b/docs/connector/formats/protobuf.md index 2efbeff..9d685be 100644 --- a/docs/connector/formats/protobuf.md +++ b/docs/connector/formats/protobuf.md @@ -15,7 +15,7 @@ It is very popular in Streaming Data Pipeline. Now support protobuf format in so | format | String | Yes | - | Specify what format to use, here should be 'protobuf'. | | protobuf.descriptor.file.path | String | Yes | - | The descriptor file path. | | protobuf.message.name | String | Yes | - | The protobuf messageName to look for in descriptor file. | -| protobuf.ignore.parse.errors | Boolean | No | true | Protobuf ignore parse errors, otherwise will throw exception. | +| protobuf.ignore.parse.errors | Boolean | No | false | Protobuf ignore parse errors, otherwise will throw exception. | | protobuf.emit.default.values | Boolean | No | false | If true, default values will be emitted for missing fields. It is not recommended, because it will cause performance degradation. About basic data type, it is suggested to use `optional` instead of `required`. | ## Data Type Mapping diff --git a/docs/connector/sink/kafka.md b/docs/connector/sink/kafka.md index 04dae2f..56331bc 100644 --- a/docs/connector/sink/kafka.md +++ b/docs/connector/sink/kafka.md @@ -11,13 +11,14 @@ In order to use the Kafka connector, the following dependencies are required. Th Kafka sink custom properties. if properties belongs to Kafka Producer Config, you can use `kafka.` prefix to set. -| Name | Type | Required | Default | Description | -|-------------------------|--------|----------|---------|---------------------------------------------------------------------------------------------------------------------------------------------------------------| -| topic | String | Yes | - | Topic name is required. It used to write data to kafka. | -| kafka.bootstrap.servers | String | Yes | - | A list of host/port pairs to use for establishing the initial connection to the Kafka cluster. This list should be in the form `host1:port1,host2:port2,...`. | -| format | String | No | json | Data format. The default value is `json`. The Optional values are `json`, `protobuf`. | -| [format].config | | No | - | Data format properties. Please refer to [Format Options](../formats) for details. | -| kafka.config | | No | - | Kafka producer properties. Please refer to [Kafka Producer Config](https://kafka.apache.org/documentation/#producerconfigs) for details. | +| Name | Type | Required | Default | Description | +|-------------------------|---------|----------|---------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| +| topic | String | Yes | - | Topic name is required. It used to write data to kafka. | +| kafka.bootstrap.servers | String | Yes | - | A list of host/port pairs to use for establishing the initial connection to the Kafka cluster. This list should be in the form `host1:port1,host2:port2,...`. | +| log.failures.only | Boolean | No | true | Whether the producer should fail on errors, or only log them; If this is set to true, then exceptions will be only logged, if set to false, exceptions will be eventually thrown. | +| format | String | No | json | Data format. The default value is `json`. The Optional values are `json`, `protobuf`. | +| [format].config | | No | - | Data format properties. Please refer to [Format Options](../formats) for details. | +| kafka.config | | No | - | Kafka producer properties. Please refer to [Kafka Producer Config](https://kafka.apache.org/documentation/#producerconfigs) for details. | ## Example This example read data of inline test source and write to kafka topic `SESSION-RECORD-TEST`. |