chenjl/canal
1
0
Fork 0
mirror of https://github.com/alibaba/canal.git synced 2026-11-04 00:30:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,235 Commits 13 Branches 38 Tags
50ea6870dc79b4459be941436fdfb91a2c3b3467
Commit Graph

107 Commits

Author SHA1 Message Date
duhengforever
5ae16b1c7c Merge canal repo master 2018-09-27 17:09:00 +08:00
duhengforever
a37a7ff142 Add RocketMQ example and polish mq abstract class 2018-09-27 10:34:17 +08:00
duhengforever
821f3eced5 Add mq adapter 
Signed-off-by: duhengforever <duhengforever@gmail.com>
 2018-09-25 10:22:31 +08:00
七锋
9535e82da6 fixed readme 2018-09-21 15:40:18 +08:00
mcy
4f2b4cea53 整理代码 2018-09-20 17:25:32 +08:00
mcy
e566160f1e 整理代码 2018-09-20 17:24:32 +08:00
mcy
74890050d0 kafka生产端增加按pk hash到对应partition功能 2018-09-20 16:48:14 +08:00
duhengforever
d5aa324ce4 Add RocketMQ canal connector 2018-09-20 15:48:52 +08:00
rewerma
e9439125bd Merge branch 'master' into master 2018-09-18 10:18:22 +08:00
Chuanyi Li
cae6df1457 Update grafana tmpl. 2018-09-15 13:28:27 +08:00
mcy
e8e0032404 增加扁平Message用于卡夫卡数据投递 2018-09-14 11:22:47 +08:00
七锋
f5bf1667a9 fixed mq and client launcher 2018-09-04 12:35:20 +08:00
mcy
81c216f1c1 增加kafka get的超时时间 2018-09-04 09:39:02 +08:00
mcy
ebf9139762 增加kafka producer sender的callback，canal和kafka同步提交回滚 
去除一个canal实例对应多个kafka topic的机制，一个实例只对应一个topic
kafka模式下server端的批次大小不能超过1M，最大为900K
 2018-09-03 17:40:30 +08:00
mcy
bcf30a9a05 去掉kafka canalBatchSize使用默认50 2018-08-28 15:52:36 +08:00
machey
4fe6c36c49 Merge branch 'develop-tmp' 
# Conflicts:
#	kafka-client/pom.xml
#	kafka/pom.xml
 2018-08-23 23:59:20 +08:00
mcy
e7f07d7d3e 整合canal.server和canal.kafka 2018-08-23 17:33:15 +08:00
lixiang
1bef1b72bc Client QPS指标的datasource配置项由"Prometheus"改为取$datasource参数 2018-08-21 17:20:00 +08:00
七锋
cb884094d5 fixed metrics 2018-08-20 13:01:22 +08:00
Chuanyi Li
02757693b4 Remove TPS(events) in tmpl. 2018-08-20 08:02:20 +08:00
Chuanyi Li
2784f33b52 Improve metrics. 2018-08-19 17:01:03 +08:00
Chuanyi Li
4a10986b5f Introduce grafana template, update images. 2018-08-18 11:15:53 +08:00
七锋
0131c3ad13 fixed merge code 2018-08-17 19:55:08 +08:00
七锋
cc31e2db7c fixed docker build 2018-08-17 19:55:07 +08:00
七锋
10114f4a9f fixed issue #727 , support rds binlog dump 2018-08-17 19:55:07 +08:00
七锋
11d4761bcb fixed docker build 2018-08-14 13:23:24 +08:00
agapple
72213bb80d Merge pull request #833 from lcybo/master 
store增加bufferSize，metrics server端口可配置
 2018-08-13 22:42:01 +08:00
Chuanyi Li
a3bf1d59e6 Add size label for store metrics. 2018-08-13 21:03:30 +08:00
七锋
d3f52c6d3d fixed issue #727 , support rds binlog dump 2018-08-13 10:16:28 +08:00
七锋
7fd958a490 fixed issue #801 , support canal docker 2018-08-03 17:48:32 +08:00
七锋
26edbeaa28 fixed kafka performance 2018-08-02 13:58:41 +08:00
七锋
8e856acac5 fixed issue #742, improve h2 config 2018-07-17 22:32:57 +08:00
Chuanyi Li
be605617c3 Parallel参数细节的完善 2018-07-05 20:24:42 +08:00
七锋
da8bf59d5b fixed issue #726 , 多线程解析binlog DML事件,提升性能 2018-07-04 23:37:20 +08:00
rewerma
0d6757c257 增加kafka的日志 2018-06-12 09:46:01 +08:00
rewerma
31f72e1aac 增加 kafaka producer 直接从canal server消费数据发送 2018-06-11 19:52:55 +08:00
七锋
0f33c8c89c fixed issue #677 , add gtidon default value 2018-06-07 14:03:33 +08:00
七锋
3c913d1e22 fixed issue #126, support gtid 2018-05-07 18:33:37 +08:00
hiwjd
21f3f8c973 支持通过GTID同步binlog 2018-05-04 16:47:03 +08:00
agapple
8d6f19cc33 fixed default value 2017-10-15 16:19:02 +08:00
agapple
1463463f1e fixed data 2017-10-15 16:08:29 +08:00
agapple
77342663e3 fixed rds binlog local 2017-10-15 15:55:30 +08:00
agapple
e01e48ff65 fixed h2 support 2017-10-14 01:14:13 +08:00
agapple
4f00f5ea8d fixed tsdb test 2017-10-14 00:12:43 +08:00
agapple
19707f92d4 merge tsdb meta support and refactor 2017-09-30 23:21:17 +08:00
kaimingwan
e8da1c884b table meta support 2017-09-22 22:01:57 +08:00
agapple
8e88dc87f7 fixed https://github.com/alibaba/canal/pull/334 2017-07-05 12:35:42 +08:00
yinxiu
6b20959a2d fix bug of repeat log manager 2017-04-06 20:13:59 +08:00
yinxiu
a78622ae02 rename log manager module and ajust xml 2017-03-28 20:33:14 +08:00
lubiao
350f8637c3 1、BinLogFileQueue的listBinlogFiles方法中对binlog文件名进行更严格的验证，必须以数字结尾 
2、LocalBinLogConnection类中解决如下bug
	2.1第二个dump方法中增加代码"decoder.handle(LogEvent.FORMAT_DESCRIPTION_EVENT);",解决"((QueryLogEvent)event).getQuery()"语句出现乱码的问题(BEGIN后面多了4个字节),出现乱码不会进入if语句，导致找到的binlog位点不准确
	2.2第一个dump方法中，被注释的decode代码才是正确的，和DirectLogFetcher不同，此处需要构造子循环进行遍历
	2.3第一个dump方法中，将每个binlog-file的首个event设置为RotateLogEvent，否则会导致所有event的binlogFileName都是默认的mysql-bin.000001。这么改完之后，和DirectLogFetcher的行为相契合，后者在每个binlogfile的首个event就是RotateLogEvent
3、LocalBinlogEventParser中增加元数据处理的相关代码，不加的话，所有的event都不带列名，基本上没法儿使用
 2016-10-11 17:28:24 +08:00