chenjl/canal
1
0
Fork 0
mirror of https://github.com/alibaba/canal.git synced 2026-11-04 00:30:15 +08:00
Code Issues Packages Projects Releases Wiki Activity

Updated Canal Kafka RocketMQ QuickStart (markdown)

rewerma
2019-01-21 10:12:50 +08:00
parent 9c3aaab6e4
commit 242c93b765
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
Canal-Kafka-RocketMQ-QuickStart.md

@@ -88,6 +88,8 @@ canal.mq.canalGetTimeout = 100
canal.mq.flatMessage = true
canal.mq.compressionType = none
canal.mq.acks = all
# kafka消息投递是否使用事务
canal.mq.transaction = false
```
## mq相关参数说明
@@ -98,12 +100,13 @@ canal.mq.acks = all
| canal.mq.retries | 发送失败重试次数 | 0 |
| canal.mq.batchSize | kafka为`ProducerConfig.BATCH_SIZE_CONFIG` <br> rocketMQ无意义 | 16384 |
| canal.mq.maxRequestSize | kafka为`ProducerConfig.MAX_REQUEST_SIZE_CONFIG` <br> rocketMQ无意义 | 1048576 |
| canal.mq.lingerMs | kafka为`ProducerConfig.LINGER_MS_CONFIG` <br> rocketMQ无意义 | 1 |
| canal.mq.lingerMs | kafka为`ProducerConfig.LINGER_MS_CONFIG` , 如果是flatMessage格式建议将该值调大, 如: 200<br> rocketMQ无意义 | 1 |
| canal.mq.bufferMemory | kafka为`ProducerConfig.BUFFER_MEMORY_CONFIG` <br> rocketMQ无意义 | 33554432 |
| canal.mq.producerGroup | kafka无意义 <br> rocketMQ为ProducerGroup名 | Canal-Producer |
| canal.mq.canalBatchSize | 获取canal数据的批次大小 | 50 |
| canal.mq.canalGetTimeout | 获取canal数据的超时时间 | 100 |
| canal.mq.flatMessage | 是否为json格式 <br> 如果设置为false,对应MQ收到的消息为protobuf格式<br>需要通过CanalMessageDeserializer进行解码 | true |
| canal.mq.transaction | kafka消息投递是否使用事务, 主要针对flatMessage的异步发送和动态多topic消息投递进行事务控制来保持和canal binlog position的一致性, flatMessage模式下建议开启(需要kafka版本支持)。如果设置为true, flatMessage消息将会采用逐条同步的方式投递, 可能会产生消息丢失或者重复投递<br> rocketMQ无意义 | false |
| --- | --- | --- |
| canal.mq.topic | mq里的topic名 | 无 |
| canal.mq.dynamicTopic | mq里的动态topic规则, 1.1.3版本支持 | 无 |