chenjl/canal
1
0
Fork 0
mirror of https://github.com/alibaba/canal.git synced 2026-11-04 00:30:15 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,680 Commits 13 Branches 38 Tags
c998b3f100abd2827277939971ab2a62f68e4486
Commit Graph

96 Commits

Author SHA1 Message Date
nakeiven
c998b3f100 Feature/adapter postgresql 20250124 (#5390) 
* adapter tcp模式mysql数据全量同步至postgresql时 报错
fix issue 2146

* fix issue 1980

* feat 增加 当dbType 为 postgresql时，返回双引号(避免表名为postgresql的关键字时，sql查询报错)

---------

Co-authored-by: guodong.zhang <zgd8988@126.com>
 2025-01-24 17:14:41 +08:00
Yazid Lee
9373429015 fix: resource loading failure caused by incorrect parameter order in StringUtils.startsWithIgnoreCase (#5173) 2024-06-26 15:53:24 +08:00
jianghang.loujh
7bb619cf12 fixed #5154,avoid spring RCE 2024-06-06 15:29:17 +08:00
jianghang.loujh
8ca900377a merge & reformat code 2024-03-08 11:58:46 +08:00
jackzlz
6dffcc8573 yml解析支持占位符 (#5045) 2024-03-08 11:56:30 +08:00
wbxlll
711971599f fix issue client-adapter.rdb模块在转换时间时丢失精度 #5052 (#5053) 
* fix the issue that client-adapter.rdb module loses precision when converting microsencond time

* fix the issue that client-adapter.rdb module loses precision when converting to java.sql.Time or java.sql.Timestamp

* fix the issue that client-adapter.rdb module loses precision when converting to java.sql.Time or java.sql.Timestamp
 2024-03-08 11:50:53 +08:00
cooper lee
cda330e49e Fix Configuration property name '-id' is not valid on canal 1.1.7 alpha 3 #4879 (#4887) 
* Fix Configuration property name '-id' is not valid

* Fix Configuration property name '-id' is not valid
读取原配置文件
 2023-09-21 10:53:47 +08:00
weirhp
d623bea71a 解决rdb下有多个配制，会导致配置相互覆盖的问题 (#4560) 
恩baseProperties这个变量是共享的，不能修改这个变量的属性值。要不后续的配置都会改变。关联issue为4355
 2023-09-04 17:23:26 +08:00
rewerma
cd798b71e9 add proxy for SPI (#4520) 
* 测试类报错

* add proxy for SPI
 2022-12-06 17:35:30 +08:00
rewerma
eee73dc4b1 optimize YAML config loader (#4332) 2022-08-01 20:15:14 +08:00
zhuchao941
4315f203a2 repair issue #3401 (#3923) 
* 解决OutAdapter单例导致的问题，如 1.多个es7 outAdapter的多线程问题（共享同一个es bulk request），2.多个es7 outAdapter共用一份es配置问题

* 1. 优化adapter和监听器之间的代码结构
2. 监听器只处理匹配的配置文件
3. bugfix-es adapter配置文件回调时漏写esVersion
理论上一个adapter实例对应一个config配置文件

Co-authored-by: agapple <jianghang.loujh@alibaba-inc.com>
 2022-05-13 15:02:06 +08:00
mclubing
2623d08b8c rdb配置不支持yaml后缀文件 (#3964) 
增加rdb配置支持yaml后缀文件
 2022-05-13 11:26:04 +08:00
364102729
0a2254eeaf add tablestore adapter (#3754) 
* add tablestore adapter

* add tablestore adapter

* fix bug add add log when etl fail

* fix bug，tinyint(1)以及rowupdatechange

Co-authored-by: agapple <jianghang115@gmail.com>
 2021-10-09 16:06:13 +08:00
arthasking123
d67bea8f3d repair issue #3678,#3680 (#3684) 
* repair issue #3678,#3680

* repair issue #3678,#3680
 2021-10-09 15:30:32 +08:00
agapple
1369418c6a fixed code format & merge 2021-04-19 10:55:43 +08:00
zavakid
df24596092 = code cleanup 
- for loop replaceable with enhanced 'for' loop
  - using diamond in generic type
  - collapse try catch exception
  - using try-with-resource
  - using  List#sort instead of Collections#sort
  - replaced lambda with method reference
  - using native compare method to compare numbers
  - using switch instead of if for in ESSyncUtil
 2020-09-17 23:22:25 +08:00
zavakid
43c23ffb97 = remove unused improt 2020-09-17 22:40:06 +08:00
zavakid
e7658879bc = cold cleanup 
* using lambda if possible (we are already building in Java8)
  * using diamond when new generic instance
  * remove used improt
 2020-09-17 17:46:20 +08:00
agapple
b79af46054 merge code and fixed issue #2755 #2756 #2735 #2714 #2711 #2710 #2616 #2602 #2585 #2565 #2935 #2434 #2623 #2418 #2387 2020-08-22 13:07:24 +08:00
dengliming
e4726972de refactor: delete duplicate code (#2748) 2020-08-20 21:18:51 +08:00
Tocker
b82c8bca83 Fix:Alibaba Coding Guidelines-Object的equals方法容易抛空指针异常，应使用常量或确定有值的对象来调用equals。 (#2919) 2020-08-20 21:17:44 +08:00
rewerma
265a8e8594 模块化mq connector (#2562) 
* add connector module, add kafka producer connector module for server

* add rocketMQ producer connector module for server

* add rabbitMQ producer connector module for server

* optimize code, add annotation

* add canal message consumer connector for canal-adapter module
 2020-02-28 11:00:08 +08:00
rewerma
6d9ea57186 修复子线程阻塞造成不能中止的问题 (#2508) 2019-12-26 19:29:48 +08:00
EdgarScott
fff623acb1 Add unit tests (#2235) 
* Add Unit Tests for the following classes:

com.alibaba.otter.canal.client.adapter.support.JdbcTypeUtilTest
com.alibaba.otter.canal.client.adapter.support.UtilTest
com.taobao.tddl.dbsync.binlog.JsonConversion_Json_ValueTest
com.taobao.tddl.dbsync.binlog.JsonDiffConversionTest
com.taobao.tddl.dbsync.binlog.LogBufferTest
com.taobao.tddl.dbsync.binlog.LogEventTest
com.taobao.tddl.dbsync.binlog.event.LogHeaderTest
com.taobao.tddl.dbsync.binlog.event.RowsLogBufferTest
com.alibaba.otter.canal.parse.driver.mysql.packets.client.RegisterSlaveCommandPacketTest
com.alibaba.otter.canal.parse.driver.mysql.utils.ByteHelperTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DdlResultTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DruidDdlParserTest

These tests were written using Diffblue Cover

* Add dependencies and refactor
 2019-09-25 18:53:24 +08:00
耐小心
79552e0a37 rabbitmq(amqp)MQ支持 (#2156) 2019-09-16 12:43:02 +08:00
agapple
e376a129ed fixed canal-admin vue 2019-08-24 16:54:27 +08:00
rewerma
ce7948d6e7 fix Message转Dml对null值的bug (#1808) 
* Message转Dml对null值的判断

* Message转Dml对null值的判断

* Message转Dml对null值的判断
 2019-05-28 00:03:55 +08:00
Heng Du
d0a83aad27 Support seamless docking with Alibaba Cloud RocketMQ commercial service (#1849) 2019-05-27 23:51:32 +08:00
Jet
7427a74612 improve es etl (#1758) 
* fix typo in trace log

* improve es etl

* improve es etl log

* improve es etl by add threadCount

* improve es etl by add threadCount

* improve es etl query

* remove comment
 2019-05-11 17:26:08 +08:00
rewerma
16f335c381 修复rest etl 存在SQL注入风险 (#1685) 
* kafka 模式默认开启事务异步发送

* fix adapter etl rest sql inject bug
 2019-04-15 23:58:12 +08:00
mcy
06bfcda275 code optimization 2019-03-20 10:41:51 +08:00
mcy
6b3bf31404 adapter代码整理优化 2019-03-19 17:49:00 +08:00
agapple
5c96bf282e Merge pull request #1590 from rewerma/master 
fix #1585
 2019-03-17 10:29:12 +08:00
kangzhidong
078673c6a9 fix the error log does not contain table name 2019-03-13 16:55:38 +08:00
mcy
43045bc672 use system time zone for es datetime field formatter 2019-03-13 10:01:16 +08:00
machey
1781381187 modify 2019-03-01 00:19:47 +08:00
machey
5d4210bd22 modify 2019-02-28 23:31:07 +08:00
machey
9888fae559 负时区的bug 2019-02-28 23:22:02 +08:00
rewerma
81ab7e9783 Merge branch 'master' into master 2019-02-28 19:37:27 +08:00
mcy
b891afa50e 增加时区判断 2019-02-28 19:28:17 +08:00
mcy
e7f069850f fixed #1538 2019-02-28 17:29:06 +08:00
mcy
f21abc13af fixed #1538 2019-02-26 10:23:38 +08:00
agapple
072420c32b fixed 2019-02-25 15:18:04 +08:00
agapple
1473a4a6b5 Merge pull request #1523 from rewerma/master 
es adapter新增upsert属性
 2019-02-25 14:50:58 +08:00
mcy
01dc8ce2b8 YmlConfigBinder代码整理 2019-02-20 15:00:48 +08:00
jiucheng
f7e490f7a0 1、adapter/rdb，从库表字段(varchar,char,text,longtext)非空约束时，无法同步问题修正 
2、主库存在0000-00-00 00:00:00时间时，从库表字段是非空约束时，无法同步问题修正
 2019-02-20 10:10:14 +08:00
jiucheng
8cadd585c6 adapter rdb无法同步ddl更新问题修正 
adapter/support/MessageUtil.java
 2019-02-20 09:49:15 +08:00
rewer
0c5f5c128f 整理代码 2019-02-07 13:49:35 +08:00
mcy
5284aa9793 fix bugs 2019-02-01 16:20:53 +08:00
mcy
597a08ac37 通过groupId过滤对应的adapter配置 2019-02-01 13:51:49 +08:00