Commit Graph

99 Commits

Author SHA1 Message Date
mcy
f7ea8df89e rdb新增同步测试完成 2018-11-08 11:19:50 +08:00
mcy
b71e299161 kafka单个partition的发送未改为同步发送的bug fix 2018-11-07 11:37:16 +08:00
jiacheo
edb5f294ef fix:rollback之后继续commit,会产生 CanalServerException: ack error , clientId:1001 batchId:12 is not exist , please check 的错误。 2018-11-05 22:00:56 +08:00
rewerma
d3e1ddd234 Merge pull request #1084 from rewerma/master
fix #1083
2018-11-01 14:47:33 +08:00
mcy
b9c4884af1 fix #1083 2018-11-01 14:46:29 +08:00
七锋
dd8243a56d fixed issue #1075, support message transactor filter 2018-10-30 23:48:05 +08:00
七锋
be5f1546ca fixed issue #1063 , rocketmq bugfix 2018-10-29 16:56:29 +08:00
七锋
b9f40f326f [maven-release-plugin] prepare for next development iteration 2018-10-29 14:57:39 +08:00
七锋
774aeeea68 [maven-release-plugin] prepare release canal-1.1.1 2018-10-29 14:57:25 +08:00
七锋
071545987b fixed mq config 2018-10-28 21:15:57 +08:00
七锋
a0b38a9cac fixed MQConnector 2018-10-28 19:52:26 +08:00
duhengforever
ebaf78f5aa Resolve conflict with master branch 2018-10-28 16:18:13 +08:00
duhengforever
b484593869 Add flat message support to rocketmq 2018-10-28 16:09:31 +08:00
七锋
346d091d00 fixed issue #1032 , support raw config 2018-10-25 13:11:34 +08:00
七锋
c75c248086 fixed issue #1019 , support canal embedded with Entry 2018-10-24 13:45:58 +08:00
titeng.jiang
5bc5eec85e Fix Kafka FlatMessage Model Null Value set to "" 2018-10-24 10:02:50 +08:00
mcy
e4b6385dcc 调整kafka同步发送和消费,确保消息不丢失 2018-10-03 16:32:08 +08:00
七锋
eb2a83b975 fixed test 2018-09-30 11:33:48 +08:00
七锋
9344ed121f format & import 2018-09-30 10:52:41 +08:00
duhengforever
5ae16b1c7c Merge canal repo master 2018-09-27 17:09:00 +08:00
duhengforever
821f3eced5 Add mq adapter
Signed-off-by: duhengforever <duhengforever@gmail.com>
2018-09-25 10:22:31 +08:00
mcy
19b7f730b6 整理代码 2018-09-20 18:06:47 +08:00
mcy
e566160f1e 整理代码 2018-09-20 17:24:32 +08:00
mcy
74890050d0 kafka生产端增加按pk hash到对应partition功能 2018-09-20 16:48:14 +08:00
mcy
0cda90cdea 默认将数据发现kafka的partition 0,避免多分区的数据一致性问题
后续将支持通过id hash分发数据
2018-09-20 16:17:38 +08:00
duhengforever
d5aa324ce4 Add RocketMQ canal connector 2018-09-20 15:48:52 +08:00
七锋
09df602f3b support filterTransactionEntry 2018-09-20 11:30:10 +08:00
mcy
7005c11ac2 fix序列化的一些问题, kafka生产端统一使用异步 2018-09-17 11:10:50 +08:00
mcy
f3d1c8b754 Merge branch 'master' of https://github.com/rewerma/canal 2018-09-14 11:24:27 +08:00
mcy
e8e0032404 增加扁平Message用于卡夫卡数据投递 2018-09-14 11:22:47 +08:00
WithLin
ca61be5f5a fix upgrade proto2 to proto3 2018-09-13 18:37:26 +08:00
agapple
1ab1f119b8 Merge pull request #931 from rewerma/master
fix #904: 空记录时sleep 1s防止循环get数据过快
2018-09-12 13:22:19 +08:00
mcy
a6798c61df 空数据sleep 100ms 2018-09-12 09:03:43 +08:00
machey
8ae8f526a6 fix #904: 空记录时sleep 1s防止循环get数据过快 2018-09-11 22:47:53 +08:00
WithLin
a497962153 Fix upgrade protobuf version 2018-09-07 14:27:19 +08:00
mcy
728550cac3 增加kafka producer send结果同步判断 2018-09-04 09:56:51 +08:00
mcy
81c216f1c1 增加kafka get的超时时间 2018-09-04 09:39:02 +08:00
mcy
17f345bfe5 0.11的环境未测过,先去除kafka的事务 2018-09-03 18:07:43 +08:00
mcy
ebf9139762 增加kafka producer sender的callback,canal和kafka同步提交回滚
去除一个canal实例对应多个kafka topic的机制,一个实例只对应一个topic
kafka模式下server端的批次大小不能超过1M,最大为900K
2018-09-03 17:40:30 +08:00
machey
ee5775ce05 去掉kafka server端TRANSACTIONBEGIN和TRANSACTIONEND的判断 2018-09-02 20:21:07 +08:00
mcy
bcf30a9a05 去掉kafka canalBatchSize使用默认50 2018-08-28 15:52:36 +08:00
machey
4fe6c36c49 Merge branch 'develop-tmp'
# Conflicts:
#	kafka-client/pom.xml
#	kafka/pom.xml
2018-08-23 23:59:20 +08:00
mcy
e7f07d7d3e 整合canal.server和canal.kafka 2018-08-23 17:33:15 +08:00
七锋
9bde69b6d6 [maven-release-plugin] prepare for next development iteration 2018-08-20 13:29:12 +08:00
七锋
dd8b1ce955 [maven-release-plugin] prepare release canal-1.1.0 2018-08-20 13:28:57 +08:00
Chuanyi Li
2784f33b52 Improve metrics. 2018-08-19 17:01:03 +08:00
七锋
0131c3ad13 fixed merge code 2018-08-17 19:55:08 +08:00
七锋
c421ff718b preapre for 1.1.0 release 2018-08-17 19:55:08 +08:00
七锋
cc31e2db7c fixed docker build 2018-08-17 19:55:07 +08:00
Chuanyi Li
3053b9635a Add header size for each packet. 2018-08-16 07:59:45 +08:00