chenjl/canal
1
0
Fork 0
mirror of https://github.com/alibaba/canal.git synced 2026-11-04 00:30:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,522 Commits 13 Branches 38 Tags
41bf3e2289bbc3584e38355b28df15edead0e01a
Commit Graph

347 Commits

Author SHA1 Message Date
dengliming
e4726972de refactor: delete duplicate code (#2748) 2020-08-20 21:18:51 +08:00
chank
746d51e621 Change maven repository to HTTPS (#2763) 
* change maven repository to https

* change maven repository to https
 2020-08-20 21:18:25 +08:00
Tocker
b82c8bca83 Fix:Alibaba Coding Guidelines-Object的equals方法容易抛空指针异常，应使用常量或确定有值的对象来调用equals。 (#2919) 2020-08-20 21:17:44 +08:00
agapple
afbf125231 fixed format 2020-03-05 15:26:59 +08:00
agapple
b2b2a82554 client-adapter 写入kudu (#2396) 
* client-adapter 提交写入kudu适配器

* kudu etl 处理数据缓存提交问题

* Update KuduTemplate.java

* 1.写入kudu前获取元数据方式更改
2.解决etl批量导入kudu数据少量丢失问题

* 1.修改文件头注释
2.调整kudu更新事件update为upsert
 2020-03-05 15:22:01 +08:00
agapple
5e761e14fa format 2020-02-28 13:15:27 +08:00
844392610
92f04f86cb 添加目标表不区分大小写的支持，并可开关（默认为区分大小写） (#2329) 
* 添加目标表不区分大小写的支持，并可开关（默认为区分大小写）

* 添加目标表不区分大小写的支持，并可开关（默认为区分大小写）-format
 2020-02-28 12:22:17 +08:00
zhshy11
bd56438eca sql语句增加引号，兼容mysql关键字 (#2358) 2020-02-28 11:47:38 +08:00
rewerma
265a8e8594 模块化mq connector (#2562) 
* add connector module, add kafka producer connector module for server

* add rocketMQ producer connector module for server

* add rabbitMQ producer connector module for server

* optimize code, add annotation

* add canal message consumer connector for canal-adapter module
 2020-02-28 11:00:08 +08:00
rewerma
b6333f018f Revert "修复kafka消费回滚的bug (#2521)" (#2526) 
This reverts commit 31acfc0101.
 2020-01-02 17:04:57 +08:00
rewerma
31acfc0101 修复kafka消费回滚的bug (#2521) 2020-01-02 16:15:47 +08:00
rewerma
6d9ea57186 修复子线程阻塞造成不能中止的问题 (#2508) 2019-12-26 19:29:48 +08:00
agapple
31562919bb rename canal-admin project to admin 2019-10-09 14:50:08 +08:00
agapple
9c75e25da7 optimizer pom dependency 2019-10-09 14:18:37 +08:00
rewerma
460479390a bug fix (#2249) 2019-09-26 10:58:28 +08:00
agapple
46fe40ed47 use es6x/es7x instead of elaticsearch project 2019-09-25 19:31:52 +08:00
agapple
d86b0e6e67 fixed testcase 2019-09-25 19:16:33 +08:00
EdgarScott
fff623acb1 Add unit tests (#2235) 
* Add Unit Tests for the following classes:

com.alibaba.otter.canal.client.adapter.support.JdbcTypeUtilTest
com.alibaba.otter.canal.client.adapter.support.UtilTest
com.taobao.tddl.dbsync.binlog.JsonConversion_Json_ValueTest
com.taobao.tddl.dbsync.binlog.JsonDiffConversionTest
com.taobao.tddl.dbsync.binlog.LogBufferTest
com.taobao.tddl.dbsync.binlog.LogEventTest
com.taobao.tddl.dbsync.binlog.event.LogHeaderTest
com.taobao.tddl.dbsync.binlog.event.RowsLogBufferTest
com.alibaba.otter.canal.parse.driver.mysql.packets.client.RegisterSlaveCommandPacketTest
com.alibaba.otter.canal.parse.driver.mysql.utils.ByteHelperTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DdlResultTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DruidDdlParserTest

These tests were written using Diffblue Cover

* Add dependencies and refactor
 2019-09-25 18:53:24 +08:00
rewerma
f45c0206da Add elasticsearch 7.x version adapter support (#2246) 
* init es data sync upgrade

* Add elasticsearch 7.x version adapter support
 2019-09-25 18:51:34 +08:00
gaecfov
61726c7e05 fix: ES配置文件监控问题 (#2202) 
* fix:
ES监控配置文件时如果第一次因为文件错误新增失败后，再次修改不会新增的问题
ES监控配置文件添加的Config缓存没有带Instance导致匹配不到的问题

* fix：ES配置文件监控不生效
 2019-09-17 09:22:55 +08:00
耐小心
79552e0a37 rabbitmq(amqp)MQ支持 (#2156) 2019-09-16 12:43:02 +08:00
rewerma
5214257cd4 ES子表含group的where条件拼接 (#2190) 
* ES子表含group的where条件拼接

* modify
 2019-09-16 09:47:02 +08:00
gaecfov
365ca4d01f fix：当查询列包含常量拼接时解析主键字段进行条件拼接时会多出 where null=null (#2188) 2019-09-16 09:44:59 +08:00
Jony
c093fbb8f6 动态刷新同步锁状态 (#2181) 
* 解决修改数据库远程配置，canal-adapter 一直循环destroy、init。

* 解决动态添加instance和对应的adapter无锁状态问题。
 2019-09-12 08:52:33 +08:00
rewerma
31bb85bea3 fix bug #2023 and code optimize (#2167) 
* 减少等待刷新状态时间

* fix bug #2023
 2019-09-12 08:47:22 +08:00
Jony
60e26d1ddd 解决修改数据库远程配置，canal-adapter 一直循环destroy、init。 (#2137) 2019-09-04 12:25:54 +08:00
agapple
2bde4327c7 [maven-release-plugin] prepare for next development iteration 2019-09-02 14:24:16 +08:00
agapple
d53bfd7ee7 [maven-release-plugin] prepare release canal-1.1.4 2019-09-02 14:24:03 +08:00
agapple
bf89974f7c fixed issue #2099 , support remote config poll 2019-08-27 16:11:20 +08:00
agapple
e376a129ed fixed canal-admin vue 2019-08-24 16:54:27 +08:00
wangwengeek
983ff5fc73 查询数据过长变成byte数组转化为json解决 (#2090) 
Caused by: com.alibaba.fastjson.JSONException: syntax error, pos 2, json : [B@406b7f2 #2089
 2019-08-23 17:38:22 +08:00
rewerma
fdd0763567 新增es adapter rest client和认证机制 (#2046) 
* 新增es adapter rest client和认证机制

* 修改getMapping位置

* 代码调整

* 代码调整

* 整理代码

* fix #2048
 2019-08-21 12:44:57 +08:00
jason-liew
db23f15b61 fix: hbase etl sql syntax error in some case (#2034) 2019-08-21 12:44:04 +08:00
rewerma
7cec0994e9 Merge branch 'master' into master 2019-07-14 19:24:42 +08:00
rewerma
8639b45fe9 fix #1761 (#1973) 
* Message转Dml对null值的判断

* Message转Dml对null值的判断

* Message转Dml对null值的判断

* fix #1761
 2019-07-12 09:52:36 +08:00
mcy
317439670c modify 2019-07-11 10:16:12 +08:00
mcy
b43043f4e4 Merge remote-tracking branch 'origin/master' 2019-07-09 19:09:24 +08:00
mcy
60a46ae941 fix #1761 2019-07-09 19:08:35 +08:00
靳光宇
0cf18976d9 Update HbaseSyncService.java (#1936) 
Fix batch update or delete with only affects the first data issue
 2019-06-28 14:56:51 +08:00
agapple
8728beb4b6 fixed compile 2019-06-18 22:18:30 +08:00
agapple
6c494f8892 add rocketmq-client pom version 2019-06-18 21:28:55 +08:00
rewerma
ce7948d6e7 fix Message转Dml对null值的bug (#1808) 
* Message转Dml对null值的判断

* Message转Dml对null值的判断

* Message转Dml对null值的判断
 2019-05-28 00:03:55 +08:00
Heng Du
d0a83aad27 Support seamless docking with Alibaba Cloud RocketMQ commercial service (#1849) 2019-05-27 23:51:32 +08:00
mcy
4f7842c843 Message转Dml对null值的判断 2019-05-14 17:38:01 +08:00
mcy
b870e7ecd0 Message转Dml对null值的判断 2019-05-14 17:35:34 +08:00
mcy
331dd63c5f Message转Dml对null值的判断 2019-05-14 17:31:51 +08:00
JKTerrific
72c4daba5f 1：添加对于查询结果中，MAX( CASE a.key WHEN 'WORD1' THEN a.value ELSE 0 END ) AS… (#1794) 
* 1：添加对于查询结果中，MAX( CASE a.key WHEN 'WORD1' THEN a.value ELSE 0 END ) AS WORD1 的竖表转横表的支持
2：添加对于查询条件尾部，使用GROUP BY _id 等分组语句时出现的sql解析异常问题

* fix index out of range
 2019-05-11 17:33:59 +08:00
Jet
7427a74612 improve es etl (#1758) 
* fix typo in trace log

* improve es etl

* improve es etl log

* improve es etl by add threadCount

* improve es etl by add threadCount

* improve es etl query

* remove comment
 2019-05-11 17:26:08 +08:00
Jet
8f088cddc0 Fix es bulk (#1743) 
thanks
 2019-04-25 09:36:09 +08:00
Jet
e94ee64316 fix typo in trace log (#1738) 2019-04-24 09:57:05 +08:00