Commit Graph

131 Commits

Author SHA1 Message Date
七锋
9344ed121f format & import 2018-09-30 10:52:41 +08:00
duhengforever
5ae16b1c7c Merge canal repo master 2018-09-27 17:09:00 +08:00
duhengforever
821f3eced5 Add mq adapter
Signed-off-by: duhengforever <duhengforever@gmail.com>
2018-09-25 10:22:31 +08:00
mcy
19b7f730b6 整理代码 2018-09-20 18:06:47 +08:00
mcy
e566160f1e 整理代码 2018-09-20 17:24:32 +08:00
mcy
74890050d0 kafka生产端增加按pk hash到对应partition功能 2018-09-20 16:48:14 +08:00
mcy
0cda90cdea 默认将数据发现kafka的partition 0,避免多分区的数据一致性问题
后续将支持通过id hash分发数据
2018-09-20 16:17:38 +08:00
duhengforever
d5aa324ce4 Add RocketMQ canal connector 2018-09-20 15:48:52 +08:00
七锋
09df602f3b support filterTransactionEntry 2018-09-20 11:30:10 +08:00
mcy
7005c11ac2 fix序列化的一些问题, kafka生产端统一使用异步 2018-09-17 11:10:50 +08:00
mcy
f3d1c8b754 Merge branch 'master' of https://github.com/rewerma/canal 2018-09-14 11:24:27 +08:00
mcy
e8e0032404 增加扁平Message用于卡夫卡数据投递 2018-09-14 11:22:47 +08:00
WithLin
ca61be5f5a fix upgrade proto2 to proto3 2018-09-13 18:37:26 +08:00
agapple
1ab1f119b8 Merge pull request #931 from rewerma/master
fix #904: 空记录时sleep 1s防止循环get数据过快
2018-09-12 13:22:19 +08:00
mcy
a6798c61df 空数据sleep 100ms 2018-09-12 09:03:43 +08:00
machey
8ae8f526a6 fix #904: 空记录时sleep 1s防止循环get数据过快 2018-09-11 22:47:53 +08:00
WithLin
a497962153 Fix upgrade protobuf version 2018-09-07 14:27:19 +08:00
mcy
728550cac3 增加kafka producer send结果同步判断 2018-09-04 09:56:51 +08:00
mcy
81c216f1c1 增加kafka get的超时时间 2018-09-04 09:39:02 +08:00
mcy
17f345bfe5 0.11的环境未测过,先去除kafka的事务 2018-09-03 18:07:43 +08:00
mcy
ebf9139762 增加kafka producer sender的callback,canal和kafka同步提交回滚
去除一个canal实例对应多个kafka topic的机制,一个实例只对应一个topic
kafka模式下server端的批次大小不能超过1M,最大为900K
2018-09-03 17:40:30 +08:00
machey
ee5775ce05 去掉kafka server端TRANSACTIONBEGIN和TRANSACTIONEND的判断 2018-09-02 20:21:07 +08:00
mcy
bcf30a9a05 去掉kafka canalBatchSize使用默认50 2018-08-28 15:52:36 +08:00
machey
4fe6c36c49 Merge branch 'develop-tmp'
# Conflicts:
#	kafka-client/pom.xml
#	kafka/pom.xml
2018-08-23 23:59:20 +08:00
mcy
e7f07d7d3e 整合canal.server和canal.kafka 2018-08-23 17:33:15 +08:00
七锋
9bde69b6d6 [maven-release-plugin] prepare for next development iteration 2018-08-20 13:29:12 +08:00
七锋
dd8b1ce955 [maven-release-plugin] prepare release canal-1.1.0 2018-08-20 13:28:57 +08:00
Chuanyi Li
2784f33b52 Improve metrics. 2018-08-19 17:01:03 +08:00
七锋
0131c3ad13 fixed merge code 2018-08-17 19:55:08 +08:00
七锋
c421ff718b preapre for 1.1.0 release 2018-08-17 19:55:08 +08:00
七锋
cc31e2db7c fixed docker build 2018-08-17 19:55:07 +08:00
Chuanyi Li
3053b9635a Add header size for each packet. 2018-08-16 07:59:45 +08:00
七锋
8a74504fe3 preapre for 1.1.0 release 2018-08-14 13:29:03 +08:00
七锋
11d4761bcb fixed docker build 2018-08-14 13:23:24 +08:00
Chuanyi Li
e8aee3a276 Configurable metrics server port. 2018-08-13 21:50:50 +08:00
Chuanyi Li
75de57c102 Prometheus refactor. 2018-08-09 23:51:26 +08:00
Chuanyi Li L
2084b1fc37 Add listener to write. 2018-08-09 23:51:25 +08:00
Chuanyi Li
da5fb30191 canal server metrics refactor. 2018-08-09 23:45:38 +08:00
Chuanyi Li L
01e74c73e2 Reformat code. 2018-08-09 23:43:26 +08:00
Chuanyi Li L
782ef7fe14 Netty server/client profiler skeleton. 2018-08-09 23:43:26 +08:00
Chuanyi Li L
bd14848600 Builder of Aggregator. 2018-08-09 23:42:27 +08:00
Chuanyi Li
1c245280c7 netty3 future listener for metrics. 2018-08-09 23:42:27 +08:00
qmzhang
3c716e2a43 instance由manager管理时,CanalParameter#MetaMode增加本地文件方式,本地meta.dat存储位点信息; 2018-08-05 19:40:14 +08:00
Chuanyi Li
c0a40499b0 Canal monitoring(prometheus module) snapshot version. 2018-07-29 14:55:38 +08:00
七锋
b19eaeb89a fixed issue #726 , 单链接复用ByteBuffer数组 2018-07-19 17:55:53 +08:00
七锋
5582a38930 fixed issue #726, 优化SessionHandler里直接拼byte[],绕过protobuf的多次拷贝 2018-07-19 13:35:38 +08:00
七锋
10bb800f85 fixed issue #726 , 优化SessionHandler的传输处理,提前序列化Entry 2018-07-18 18:21:45 +08:00
七锋
a4255a6377 fixed format 2018-06-14 19:25:34 +08:00
七锋
fa34eb0e59 fixed client idleTimeout 1 hour 2018-06-12 13:20:41 +08:00
Chuanyi Li
00890f87e5 Communication log optimization. 2018-01-18 21:11:46 +08:00