debezium之mysql配置

实验环境

全部部署于本地虚拟机

1 mysql

参考 官方文档 和 根据官方示例镜像(debezium/example-mysql,mysql版本为8.0.32)

1.1 创建用户

官方镜像里一共有三个账号
debezium:connect用户
mysqluser:普通用户
replicator:用于主从?

设置命令

create user 'debezium'@'%' identified by "dbz";
create user 'mysqluser'@'%' identified by "mysqlpw";
create user 'replicator'@'%' identified by "replicator";
GRANT SELECT, RELOAD, SHOW DATABASES, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'debezium'@'%';
GRANT USAGE ON *.* TO 'mysqluser'@'%';
GRANT ALL PRIVILEGES ON `inventory`.* TO 'mysqluser'@'%';
GRANT REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'replicator'@'%';
flush privileges;

查询命令

select host,user from mysql.user;
show grants for `debezium`@`%`;

1.2 设置binlog

镜像配置文件

/etc/mysql/conf.d/mysql.cnf

[mysqld]
skip-host-cache
skip-name-resolve
user=mysql
symbolic-links=0
# ----------------------------------------------
# Enable the binlog for replication & CDC
# ----------------------------------------------
# Enable binary replication log and set the prefix, expiration, and log format.
# The prefix is arbitrary, expiration can be short for integration tests but would
# be longer on a production system. Row-level info is required for ingest to work.
# Server ID is required, but this will vary on production systems
server-id = 223344
log_bin = mysql-bin
expire_logs_days = 1
binlog_format = row

default_authentication_plugin = mysql_native_password

查询命令

SELECT variable_value as "BINARY LOGGING STATUS (log-bin) ::" FROM performance_schema.global_variables WHERE variable_name='log_bin';

1.3 使能GTIDs(实际镜像中未开启)

查询命令

SHOW VARIABLES LIKE 'gtid_mode';

1.4 配置会话定时器(实际镜像中为默认值 28800)

查询命令

show variables like 'interactive_timeout';
show variables like 'wait_timeout';

1.5 Enabling query log events(实际镜像中未开启)

查询命令

show variables like 'binlog_rows_query_log_events';

1.6 确认binlog row value options

查询命令

确保不为“PARTIAL_JSON”即可

show global variables where variable_name = 'binlog_row_value_options';

配置命令

set @@global.binlog_row_value_options="" ;

2 启动kafka(未完成)

参考博文
单节点kafka部署笔记

3 启动connector(未完成)

下载docker镜像

docker pull quay.io/debezium/postgres
posted @ 2023-06-23 21:55  virtualzzf  阅读(411)  评论(0编辑  收藏  举报