Commit Graph

142 Commits

Author SHA1 Message Date
agapple
4e0b8a0278 fixed admin 2019-08-31 12:24:41 +08:00
rewerma
274e91f8aa bug fix (#2122)
* admin端口调整完成

* server端适配调整

* 调整部分功能

* 单机/集群admin调试完成

* 重新发布前端页面

* bug fix

* 解决server端admin配置会被远程覆盖的问题
解决default-instance.xml无法加载远程zkServers配置的问题

* 集群模式下取活动实例的问题
2019-08-31 12:22:16 +08:00
agapple
3d4dbc9a8c fixed issue #2099 , support user/passwd acl and canal admin operator 2019-08-26 18:16:33 +08:00
rewerma
fdd0763567 新增es adapter rest client和认证机制 (#2046)
* 新增es adapter rest client和认证机制

* 修改getMapping位置

* 代码调整

* 代码调整

* 整理代码

* fix #2048
2019-08-21 12:44:57 +08:00
rewerma
7cec0994e9 Merge branch 'master' into master 2019-07-14 19:24:42 +08:00
rewerma
64ff140304 modify 2019-07-11 01:05:11 +08:00
agapple
a847660a45 fixed issue #1826 , remove kafka transaction send 2019-06-26 16:02:19 +08:00
agapple
4957083493 fixed issue #1897 , memory event store ack null 2019-06-25 17:32:46 +08:00
agapple
5bea876ec9 fixed issue #1352, add pkNames for flatMessage partition 2019-06-18 21:44:52 +08:00
BillowX
74489d1bba 当MQ配置为Kafka时,支持配置Kerberos认证 (#1895) 2019-06-18 15:02:14 +08:00
Z6N
5ac0f7b710 按主键散列,未设置主键时无限空指针异常 (#1889)
当按注解散列时,如果监控的表未显示设置主键,将会导致flatMessage.getPkNames()为空,导致无限空指针异常
2019-06-18 15:01:00 +08:00
agapple
058e1fc546 fixed delete message send mq bugfix 2019-05-28 00:14:20 +08:00
nieyuan1991
f9989e0856 fix:未捕获kafka事务异常,造成canal ack异常 (#1814) 2019-05-28 00:02:25 +08:00
Marsss___
37fc248ebf 删除操作计算hash值的情况没有考虑,导致删除时的分区和插入时的分区不一致 (#1848) 2019-05-27 23:54:25 +08:00
Heng Du
d0a83aad27 Support seamless docking with Alibaba Cloud RocketMQ commercial service (#1849) 2019-05-27 23:51:32 +08:00
rewerma
16f335c381 修复rest etl 存在SQL注入风险 (#1685)
* kafka 模式默认开启事务异步发送

* fix adapter etl rest sql inject bug
2019-04-15 23:58:12 +08:00
Xin Wang
8cb85753bb open the switch to get codecov test coverage (#1671)
* add codecov for test coverage
2019-04-09 19:11:48 +08:00
agapple
69df50fe17 fixed issue #1672 , CanalKafkaProducer send 2019-04-08 19:57:00 +08:00
agapple
82ed9db8ae fixed rocketmq partition out of range 2019-04-03 11:26:31 +08:00
agapple
a7f9a779ad fixed issue #1640 , support schema partition 2019-03-28 17:01:36 +08:00
wangsaner
9826948ebb 修改canal.mq.partitionHash散列规则,
当指明pk级做分区(schema.table:pk1^pk2)时,由table.hashCode()^column.getValue().hashCode()改为database.hashCode()^column.getValue().hashCode(),从而支持同库下不同表hash至相同分区
2019-03-28 16:01:02 +08:00
agapple
97640b717b fixed compiler 2019-03-28 10:23:33 +08:00
wangsaner
739963acd0 fixed issue #1636
非flat模式,当MQ主题为多分区时,数据拆分只取了for循环里面的最后一份数据,
导致消费端只能消费到一个分区的数据
2019-03-27 21:57:04 +08:00
agapple
0ec4699149 fixed format & support Mysql Auth Switch Protocol 2019-03-27 11:54:40 +08:00
agapple
661d119265 fixed issue #1625, mq dymaic topic match 2019-03-25 17:54:35 +08:00
agapple
531b535228 fixed bug 2019-03-21 20:26:00 +08:00
agapple
024ffc2aa2 fixed mq partition num priority 2019-03-21 19:39:21 +08:00
agapple
a81d2710ff fixed MQ partition 2019-03-21 19:27:39 +08:00
mcy
971c9a88c2 modify 2019-03-12 17:07:33 +08:00
mcy
ad39559f8c fix #1585 2019-03-12 16:56:59 +08:00
TomlongTK
fd4c8db92b fix issue 1532
因为binlog日志同表名大小写的原因导致kafka的日志恢复并resize,报错之后引起集群崩溃
现在修改为投递消息的topic不区分表名大小写
2019-02-26 14:23:29 +08:00
agapple
072420c32b fixed 2019-02-25 15:18:04 +08:00
agapple
62338a945e Merge pull request #1496 from rewerma/master
远程配置代码整理
2019-02-18 21:08:02 +08:00
i404
44beaf1916 修复当 canal.mq.flatMessage = true 时,MQMessageUtils::messagePartition 数据分区错误的 bug 2019-02-14 18:26:01 +08:00
mcy
ad62275cd7 增加kafka自定义properties 2019-02-05 19:20:36 +08:00
mcy
197ca67c8b 测试调整 2019-01-21 09:56:35 +08:00
machey
851637611f modify 2019-01-20 15:02:06 +08:00
machey
4ebf17f57b 代码调整 2019-01-20 14:30:20 +08:00
machey
2f214ce3a6 采用事务批量异步投递kafka flatMessage
fixed #1454
2019-01-20 14:20:06 +08:00
mcy
ca41be8412 fixed #1420 2019-01-15 11:38:00 +08:00
mcy
18b304f99d specified mq dynamic topic 2019-01-14 14:25:47 +08:00
mcy
b00d347eb0 rdb adapter 增加 truncate dml适配 fixed #1408
fixed #1403
2019-01-11 13:40:37 +08:00
agapple
de501c85a1 fixed issue #1374 , support queryLogEvent partition 2019-01-07 13:39:04 +08:00
mcy
7c79714528 增加远程db config配置 2018-12-29 20:21:03 +08:00
mcy
150a13824b 修改 kafka 异步发送 flat message 2018-12-27 17:52:33 +08:00
mcy
d9e259dde4 增加支持按库名、表名动态发送topic支持 2018-12-27 15:40:04 +08:00
agapple
35e0e882c1 fixed hash mode 2018-12-11 20:41:21 +08:00
agapple
0197482618 fixed partitionHash format 2018-12-11 20:17:08 +08:00
agapple
277a273ebc fixed pull #1266 , optimizer code 2018-12-11 13:40:32 +08:00
machey
547cbf82c8 对原生message发送mq的分区支持 2018-12-10 01:03:18 +08:00