chenjl/canal
1
0
Fork 0
mirror of https://github.com/alibaba/canal.git synced 2026-11-04 00:30:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,476 Commits 13 Branches 38 Tags
33733aef252e1869e2e4f926e4c4a16e33c290f6
Commit Graph

1476 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
agapple
afbf125231 fixed format 2020-03-05 15:26:59 +08:00
agapple
b2b2a82554 client-adapter 写入kudu (#2396) 
* client-adapter 提交写入kudu适配器

* kudu etl 处理数据缓存提交问题

* Update KuduTemplate.java

* 1.写入kudu前获取元数据方式更改
2.解决etl批量导入kudu数据少量丢失问题

* 1.修改文件头注释
2.调整kudu更新事件update为upsert
 2020-03-05 15:22:01 +08:00
wanshao
30a1b067a8 fix(project): no need to process tinyint(1) specially #631 2020-02-28 14:34:30 +08:00
wanshao
beaca165d0 Merge branch 'master' of github.com:alibaba/canal 2020-02-28 14:24:33 +08:00
wanshao
c21c18458b fix(project): fix isDdl judge #2599 2020-02-28 14:21:12 +08:00
agapple
5e761e14fa format 2020-02-28 13:15:27 +08:00
agapple
18418ebd98 merge pull/2120 2020-02-28 12:29:41 +08:00
844392610
92f04f86cb 添加目标表不区分大小写的支持，并可开关（默认为区分大小写） (#2329) 
* 添加目标表不区分大小写的支持，并可开关（默认为区分大小写）

* 添加目标表不区分大小写的支持，并可开关（默认为区分大小写）-format
 2020-02-28 12:22:17 +08:00
littleneko
0d5505aa2c fix_json_type_opaque_parse_err (#2318) 
对于`JSONB_TYPE_OPAQUE`类型的解析计算`q_max_bytes`时，多算了`1`字节
 2020-02-28 12:15:09 +08:00
zhshy11
bd56438eca sql语句增加引号，兼容mysql关键字 (#2358) 2020-02-28 11:47:38 +08:00
agapple
b9a157657f merge /pull/2373 2020-02-28 11:46:28 +08:00
agapple
523e8b85e6 format 2020-02-28 11:40:14 +08:00
agapple
ab74b2c82c fixed mq spi package 2020-02-28 11:32:30 +08:00
rewerma
265a8e8594 模块化mq connector (#2562) 
* add connector module, add kafka producer connector module for server

* add rocketMQ producer connector module for server

* add rabbitMQ producer connector module for server

* optimize code, add annotation

* add canal message consumer connector for canal-adapter module
 2020-02-28 11:00:08 +08:00
jianqingdu
4fc7e5f7d9 fix bug: wrong quit command implementation (#2554) 2020-02-28 10:52:35 +08:00
Li Qiang
9cc8caa834 feature(canal):support start with timestamp position(empty journal_file,set position=0),#2594 (#2595) 2020-02-28 10:50:38 +08:00
Li Qiang
a71375dad5 fix(canal):fix endless local binlog mode with exception. (#2597) 2020-02-28 10:48:54 +08:00
Rg
70d8a379f2 add Rust canal client support (#2518) 2020-01-15 20:12:28 +08:00
rewerma
b6333f018f Revert "修复kafka消费回滚的bug (#2521)" (#2526) 
This reverts commit 31acfc0101.
 2020-01-02 17:04:57 +08:00
rewerma
31acfc0101 修复kafka消费回滚的bug (#2521) 2020-01-02 16:15:47 +08:00
rewerma
6d9ea57186 修复子线程阻塞造成不能中止的问题 (#2508) 2019-12-26 19:29:48 +08:00
Li Qiang
c4c0255073 Update README.md 2019-11-04 10:20:00 +08:00
agapple
1fa9020599 format 2019-10-15 21:38:48 +08:00
agapple
dd7554374f format 2019-10-15 21:35:57 +08:00
shicongyang
65b5325ca6 建议增加一个属性，针对根据某一字段hash时，hash算法可以不根据database算出 #2248 (#2294) 2019-10-15 21:32:42 +08:00
agapple
b64a3e301a fixed issue #2286 , ArithmeticException zero 2019-10-10 15:37:17 +08:00
agapple
31562919bb rename canal-admin project to admin 2019-10-09 14:50:08 +08:00
agapple
9c75e25da7 optimizer pom dependency canal-1.1.5-alpha-1 2019-10-09 14:18:37 +08:00
agapple
7d91850be6 fixed issue #2257 , time 100 parse bugfix 2019-10-09 13:39:22 +08:00
agapple
4af3b24b69 fixed issue #2281 , null reject 2019-10-08 18:50:37 +08:00
craigwu9
e4e66b143c make canal.admin.port canal.admin.user canal.admin.passwd can be override by system env properties (#2274) 
* Update SimpleAdminConnectors.java

add more information about which server execute failed

* Update CanalStarter.java

make canal.admin.port canal.admin.user canal.admin.passwd can be override by system env
 2019-09-30 20:45:00 +08:00
agapple
dd93e2b0c4 fixed issue #2258 , optimizer rabbitmq send perf & matchTopics only match one Topic 2019-09-30 20:42:52 +08:00
agapple
d505b5ab9d fixed issue #2258 , optimizer rocketmq send perf 2019-09-30 20:19:25 +08:00
agapple
0fb717a97f fixed issue #2258 , optimizer kafka send perf 2019-09-30 14:24:59 +08:00
一杯Hash
c634f98fca bugfix mysql >= 8.0, 缓存层移除，EbeanServer 运行 Fail，Unknown system variable query_cache_size error！ (#2264) 
threw exception; nested exception is javax.persistence.PersistenceException: java.sql.SQLException: Unknown system variable 'query_cache_size'
 2019-09-29 10:51:17 +08:00
rewerma
460479390a bug fix (#2249) 2019-09-26 10:58:28 +08:00
Li Qiang
26013e239d Update README.md 2019-09-25 19:49:22 +08:00
agapple
46fe40ed47 use es6x/es7x instead of elaticsearch project 2019-09-25 19:31:52 +08:00
Koshoooooo
0c27bcf73e Fix issue #2221 (#2242) 
fastjson修复了拒绝服务安全问题，升级到当前1.2.58的兼容安全版本1.2.58.sec06
 2019-09-25 19:28:13 +08:00
agapple
d86b0e6e67 fixed testcase 2019-09-25 19:16:33 +08:00
EdgarScott
fff623acb1 Add unit tests (#2235) 
* Add Unit Tests for the following classes:

com.alibaba.otter.canal.client.adapter.support.JdbcTypeUtilTest
com.alibaba.otter.canal.client.adapter.support.UtilTest
com.taobao.tddl.dbsync.binlog.JsonConversion_Json_ValueTest
com.taobao.tddl.dbsync.binlog.JsonDiffConversionTest
com.taobao.tddl.dbsync.binlog.LogBufferTest
com.taobao.tddl.dbsync.binlog.LogEventTest
com.taobao.tddl.dbsync.binlog.event.LogHeaderTest
com.taobao.tddl.dbsync.binlog.event.RowsLogBufferTest
com.alibaba.otter.canal.parse.driver.mysql.packets.client.RegisterSlaveCommandPacketTest
com.alibaba.otter.canal.parse.driver.mysql.utils.ByteHelperTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DdlResultTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DruidDdlParserTest

These tests were written using Diffblue Cover

* Add dependencies and refactor
 2019-09-25 18:53:24 +08:00
rewerma
f45c0206da Add elasticsearch 7.x version adapter support (#2246) 
* init es data sync upgrade

* Add elasticsearch 7.x version adapter support
 2019-09-25 18:51:34 +08:00
gaecfov
61726c7e05 fix: ES配置文件监控问题 (#2202) 
* fix:
ES监控配置文件时如果第一次因为文件错误新增失败后，再次修改不会新增的问题
ES监控配置文件添加的Config缓存没有带Instance导致匹配不到的问题

* fix：ES配置文件监控不生效
 2019-09-17 09:22:55 +08:00
耐小心
79552e0a37 rabbitmq(amqp)MQ支持 (#2156) 2019-09-16 12:43:02 +08:00
agapple
5ec2087257 fixed issue #2197 , startup.bat fix 2019-09-16 09:58:27 +08:00
rewerma
5214257cd4 ES子表含group的where条件拼接 (#2190) 
* ES子表含group的where条件拼接

* modify
 2019-09-16 09:47:02 +08:00
gaecfov
365ca4d01f fix：当查询列包含常量拼接时解析主键字段进行条件拼接时会多出 where null=null (#2188) 2019-09-16 09:44:59 +08:00
agapple
419a73b3de fixed issue #2168, ignore create database 2019-09-12 09:08:30 +08:00
Jony
c093fbb8f6 动态刷新同步锁状态 (#2181) 
* 解决修改数据库远程配置，canal-adapter 一直循环destroy、init。

* 解决动态添加instance和对应的adapter无锁状态问题。
 2019-09-12 08:52:33 +08:00
rewerma
31bb85bea3 fix bug #2023 and code optimize (#2167) 
* 减少等待刷新状态时间

* fix bug #2023
 2019-09-12 08:47:22 +08:00