chenjl/canal
1
0
Fork 0
mirror of https://github.com/alibaba/canal.git synced 2026-11-04 00:30:15 +08:00
Code Issues Packages Projects Releases Wiki Activity

增加kafka producer sender的callback，canal和kafka同步提交回滚

Browse Source 
去除一个canal实例对应多个kafka topic的机制，一个实例只对应一个topic
kafka模式下server端的批次大小不能超过1M，最大为900K
This commit is contained in:
mcy
2018-09-03 17:40:30 +08:00
parent ee5775ce05
commit ebf9139762
6 changed files with 66 additions and 52 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
deployer/src/main/resources/kafka.yml
View File

@@ -3,15 +3,11 @@ retries: 0
batchSize: 16384
lingerMs: 1
bufferMemory: 33554432
filterTransactionEntry: true
canalBatchSize: 50 # Canal的batch size, 默认50K, 由于kafka最大消息体限制请勿超过1M(900K以下)
canalDestinations:
- canalDestination: example
topic: example
partition:
# 一个destination可以对应多个topic
#topics:
# - topic: example
# partition: