chenjl/canal
1
0
Fork 0
mirror of https://github.com/alibaba/canal.git synced 2026-11-04 00:30:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
543 Commits 13 Branches 38 Tags
8ae8f526a6e6b10896864ef56216c58886c23889
Commit Graph

65 Commits

Author SHA1 Message Date
machey
8ae8f526a6 fix #904: 空记录时sleep 1s防止循环get数据过快 2018-09-11 22:47:53 +08:00
mcy
728550cac3 增加kafka producer send结果同步判断 2018-09-04 09:56:51 +08:00
mcy
81c216f1c1 增加kafka get的超时时间 2018-09-04 09:39:02 +08:00
mcy
17f345bfe5 0.11的环境未测过，先去除kafka的事务 2018-09-03 18:07:43 +08:00
mcy
ebf9139762 增加kafka producer sender的callback，canal和kafka同步提交回滚 
去除一个canal实例对应多个kafka topic的机制，一个实例只对应一个topic
kafka模式下server端的批次大小不能超过1M，最大为900K
 2018-09-03 17:40:30 +08:00
machey
ee5775ce05 去掉kafka server端TRANSACTIONBEGIN和TRANSACTIONEND的判断 2018-09-02 20:21:07 +08:00
mcy
bcf30a9a05 去掉kafka canalBatchSize使用默认50 2018-08-28 15:52:36 +08:00
machey
4fe6c36c49 Merge branch 'develop-tmp' 
# Conflicts:
#	kafka-client/pom.xml
#	kafka/pom.xml
 2018-08-23 23:59:20 +08:00
mcy
e7f07d7d3e 整合canal.server和canal.kafka 2018-08-23 17:33:15 +08:00
七锋
9bde69b6d6 [maven-release-plugin] prepare for next development iteration 2018-08-20 13:29:12 +08:00
七锋
dd8b1ce955 [maven-release-plugin] prepare release canal-1.1.0 2018-08-20 13:28:57 +08:00
Chuanyi Li
2784f33b52 Improve metrics. 2018-08-19 17:01:03 +08:00
七锋
0131c3ad13 fixed merge code 2018-08-17 19:55:08 +08:00
七锋
c421ff718b preapre for 1.1.0 release 2018-08-17 19:55:08 +08:00
七锋
cc31e2db7c fixed docker build 2018-08-17 19:55:07 +08:00
Chuanyi Li
3053b9635a Add header size for each packet. 2018-08-16 07:59:45 +08:00
七锋
8a74504fe3 preapre for 1.1.0 release 2018-08-14 13:29:03 +08:00
七锋
11d4761bcb fixed docker build 2018-08-14 13:23:24 +08:00
Chuanyi Li
e8aee3a276 Configurable metrics server port. 2018-08-13 21:50:50 +08:00
Chuanyi Li
75de57c102 Prometheus refactor. 2018-08-09 23:51:26 +08:00
Chuanyi Li L
2084b1fc37 Add listener to write. 2018-08-09 23:51:25 +08:00
Chuanyi Li
da5fb30191 canal server metrics refactor. 2018-08-09 23:45:38 +08:00
Chuanyi Li L
01e74c73e2 Reformat code. 2018-08-09 23:43:26 +08:00
Chuanyi Li L
782ef7fe14 Netty server/client profiler skeleton. 2018-08-09 23:43:26 +08:00
Chuanyi Li L
bd14848600 Builder of Aggregator. 2018-08-09 23:42:27 +08:00
Chuanyi Li
1c245280c7 netty3 future listener for metrics. 2018-08-09 23:42:27 +08:00
qmzhang
3c716e2a43 instance由manager管理时，CanalParameter#MetaMode增加本地文件方式，本地meta.dat存储位点信息； 2018-08-05 19:40:14 +08:00
Chuanyi Li
c0a40499b0 Canal monitoring(prometheus module) snapshot version. 2018-07-29 14:55:38 +08:00
七锋
b19eaeb89a fixed issue #726 , 单链接复用ByteBuffer数组 2018-07-19 17:55:53 +08:00
七锋
5582a38930 fixed issue #726, 优化SessionHandler里直接拼byte[],绕过protobuf的多次拷贝 2018-07-19 13:35:38 +08:00
七锋
10bb800f85 fixed issue #726 , 优化SessionHandler的传输处理,提前序列化Entry 2018-07-18 18:21:45 +08:00
七锋
a4255a6377 fixed format 2018-06-14 19:25:34 +08:00
七锋
fa34eb0e59 fixed client idleTimeout 1 hour 2018-06-12 13:20:41 +08:00
Chuanyi Li
00890f87e5 Communication log optimization. 2018-01-18 21:11:46 +08:00
agapple
20942533e6 [maven-release-plugin] prepare for next development iteration 2017-12-04 14:43:29 +08:00
agapple
6b2d80a145 [maven-release-plugin] prepare release canal-1.0.25 2017-12-04 14:43:16 +08:00
kaimingwan
e8da1c884b table meta support 2017-09-22 22:01:57 +08:00
agapple
989a69e7be fixed format & import 2017-07-05 12:41:11 +08:00
Jason Huang
8600e9825b fix bug： 
现实运用中出现：client已经不存在但server端的连接仍然是存活状态。
在此种网络异常状态时，stop canal server会一直hang住。
原因：异常网络连接由于无数据传输，导致 io worker线程一直loop selector而无法退出。

解决方案：1. 设置keepalive 由os 监控。
        2. 设置netty idle 机制，定时检测并主动close socket。(fix 时间单位bug)
        3. 每次新创建socket channel时存储在一个容器内，在stop canal
server时，从容器内主动释放所有socket channel。
 2017-06-26 19:24:15 +08:00
agapple
4d624cf184 [maven-release-plugin] prepare for next development iteration 2017-04-01 21:18:31 +08:00
agapple
7e026f2495 [maven-release-plugin] prepare release canal-1.0.24 2017-04-01 21:18:11 +08:00
agapple
ff97dcbbc9 format & import 2017-01-19 13:07:53 +08:00
agapple
f745c698e9 [maven-release-plugin] prepare for next development iteration 2016-12-30 14:57:19 +08:00
agapple
5f4bbab722 [maven-release-plugin] prepare release canal-1.0.23 2016-12-30 14:57:07 +08:00
agapple
6284a429a0 fixed lazy 2016-10-11 21:37:39 +08:00
lubiao
8626c6ee24 1、SessionHandler类中执行SUBSCRIPTION时，应该先尝试启动runningMonitor再调用embeddedServer的subscribe方法 
2、embeddedServer的subscribe方法中应该首先进行checkStart操作，否则可能引起metaManager的脏启动
3、SessionHandler中增加日志
 2016-10-11 18:46:30 +08:00
agapple
3a5a4b06a9 [maven-release-plugin] prepare for next development iteration 2016-06-30 16:59:17 +08:00
agapple
ba173fcd48 [maven-release-plugin] prepare release canal-1.0.22 2016-06-30 16:59:05 +08:00
agapple
4f504aab31 fixed testcase compiler error 2016-02-24 17:05:14 +08:00
agapple
bf10b16138 migrate 2016-02-04 11:22:36 +08:00