Commit Graph

96 Commits

Author SHA1 Message Date
agapple
35e0e882c1 fixed hash mode 2018-12-11 20:41:21 +08:00
agapple
0197482618 fixed partitionHash format 2018-12-11 20:17:08 +08:00
agapple
277a273ebc fixed pull #1266 , optimizer code 2018-12-11 13:40:32 +08:00
machey
547cbf82c8 对原生message发送mq的分区支持 2018-12-10 01:03:18 +08:00
machey
03ee9c7ecf 根据主键Hash增加正则表达式支持,pk通配符指定自动获取支持 2018-12-10 00:09:49 +08:00
mcy
339ecdd817 fixed #1229 2018-11-29 17:38:13 +08:00
agapple
df4c66b9e2 Merge pull request #1193 from woshijay7788/feature_kafka_config
add max.request.size config
2018-11-25 11:55:51 +08:00
guixincui
90dab6831b 修改接口引用 2018-11-24 23:40:18 +08:00
gl
839d5415fc add max.request.size config 2018-11-24 22:48:54 +08:00
agapple
cc97f3b331 Merge pull request #1171 from rewerma/master
adapter 分批同步
2018-11-21 22:09:33 +08:00
agapple
638952fad1 fixed binlog seek & aliyun ak/sk 2018-11-21 13:51:34 +08:00
mcy
56ec66f90e adapter 分批同步 2018-11-21 13:46:30 +08:00
maowei.ymw
50630cc934 Support client connect rocketmq in aliyun 2018-11-19 14:33:59 +08:00
Renkai
8af1301062 Kafka增加参数acks和compressionType 2018-11-13 18:29:25 +08:00
mcy
2d41bb9960 修改mq配置针对destination级别重启 2018-11-09 18:19:51 +08:00
mcy
7d7c82ce91 修改mq配置针对destination级别重启 2018-11-09 18:12:04 +08:00
mcy
2a38bca34b 代码整理 2018-11-09 16:52:34 +08:00
mcy
c5bd42bbf1 canal server端 MQ 配置修改
MQ配置可动态加载
2018-11-09 16:39:52 +08:00
mcy
f7ea8df89e rdb新增同步测试完成 2018-11-08 11:19:50 +08:00
mcy
b71e299161 kafka单个partition的发送未改为同步发送的bug fix 2018-11-07 11:37:16 +08:00
jiacheo
edb5f294ef fix:rollback之后继续commit,会产生 CanalServerException: ack error , clientId:1001 batchId:12 is not exist , please check 的错误。 2018-11-05 22:00:56 +08:00
rewerma
d3e1ddd234 Merge pull request #1084 from rewerma/master
fix #1083
2018-11-01 14:47:33 +08:00
mcy
b9c4884af1 fix #1083 2018-11-01 14:46:29 +08:00
七锋
dd8243a56d fixed issue #1075, support message transactor filter 2018-10-30 23:48:05 +08:00
七锋
be5f1546ca fixed issue #1063 , rocketmq bugfix 2018-10-29 16:56:29 +08:00
七锋
071545987b fixed mq config 2018-10-28 21:15:57 +08:00
七锋
a0b38a9cac fixed MQConnector 2018-10-28 19:52:26 +08:00
duhengforever
ebaf78f5aa Resolve conflict with master branch 2018-10-28 16:18:13 +08:00
duhengforever
b484593869 Add flat message support to rocketmq 2018-10-28 16:09:31 +08:00
七锋
346d091d00 fixed issue #1032 , support raw config 2018-10-25 13:11:34 +08:00
七锋
c75c248086 fixed issue #1019 , support canal embedded with Entry 2018-10-24 13:45:58 +08:00
titeng.jiang
5bc5eec85e Fix Kafka FlatMessage Model Null Value set to "" 2018-10-24 10:02:50 +08:00
mcy
e4b6385dcc 调整kafka同步发送和消费,确保消息不丢失 2018-10-03 16:32:08 +08:00
七锋
eb2a83b975 fixed test 2018-09-30 11:33:48 +08:00
七锋
9344ed121f format & import 2018-09-30 10:52:41 +08:00
duhengforever
5ae16b1c7c Merge canal repo master 2018-09-27 17:09:00 +08:00
duhengforever
821f3eced5 Add mq adapter
Signed-off-by: duhengforever <duhengforever@gmail.com>
2018-09-25 10:22:31 +08:00
mcy
19b7f730b6 整理代码 2018-09-20 18:06:47 +08:00
mcy
e566160f1e 整理代码 2018-09-20 17:24:32 +08:00
mcy
74890050d0 kafka生产端增加按pk hash到对应partition功能 2018-09-20 16:48:14 +08:00
mcy
0cda90cdea 默认将数据发现kafka的partition 0,避免多分区的数据一致性问题
后续将支持通过id hash分发数据
2018-09-20 16:17:38 +08:00
duhengforever
d5aa324ce4 Add RocketMQ canal connector 2018-09-20 15:48:52 +08:00
七锋
09df602f3b support filterTransactionEntry 2018-09-20 11:30:10 +08:00
mcy
7005c11ac2 fix序列化的一些问题, kafka生产端统一使用异步 2018-09-17 11:10:50 +08:00
mcy
f3d1c8b754 Merge branch 'master' of https://github.com/rewerma/canal 2018-09-14 11:24:27 +08:00
mcy
e8e0032404 增加扁平Message用于卡夫卡数据投递 2018-09-14 11:22:47 +08:00
WithLin
ca61be5f5a fix upgrade proto2 to proto3 2018-09-13 18:37:26 +08:00
agapple
1ab1f119b8 Merge pull request #931 from rewerma/master
fix #904: 空记录时sleep 1s防止循环get数据过快
2018-09-12 13:22:19 +08:00
mcy
a6798c61df 空数据sleep 100ms 2018-09-12 09:03:43 +08:00
machey
8ae8f526a6 fix #904: 空记录时sleep 1s防止循环get数据过快 2018-09-11 22:47:53 +08:00