# 实验 11：使用 TiCDC 复制 TiDB 变更事件 ## 概述 在本实验中，你将使用 TiUP 将 TiCDC 添加到现有的 TiDB 集群中，并创建一个从 TiDB 到 MySQL 的复制任务，然后移除 TiCDC 节点。以下展示了 TiDB 集群的部署拓扑图。 ![60%](https://lab-static.pingcap.com/quick-demo/TiDBClusterDeploymentTopologyExercisewithTiCDC_aa_003_20230301.png) + TiCDC 用于将上游 TiDB 实例的增量数据复制到下游数据库（这里是 MySQL 实例）。以下展示了 `TiCDC` 的拓扑图。 ![60%](https://lab-static.pingcap.com/quick-demo/TiCDCLabToplogy_aa_003_20220626.png) > [!TIP] > 点击 **开始** 启动实验环境。 > 环境准备就绪后，点击底部工具栏中的 **前进** 进入 **模块 1**。 > 然后，按照实验指南的步骤连接到实践环境并开始你的任务。 ## 模块 1：部署 TiCDC ### 步骤 1：登录远程 Linux + 点击这里 - [终端 1](ssh://monitor1-ssh#1) 打开一个新的终端，连接到为你的实践实验分配的虚拟机。 + 登录后显示的横幅： ```output , #_ ~\_ ####_ Amazon Linux 2 ~~ \_#####\ ~~ \###| ~~ \#/ ___ ~~ V~' '-> ~~~ / A newer version of Amazon Linux is available! ~~._. _/ _/ _/ Amazon Linux 2023, GA and supported until 2028-03-15. _/m/' https://aws.amazon.com/linux/amazon-linux-2023/ ``` ### 步骤 2. 检查 TiDB 集群的状态 ```bash tiup cluster display tidb-test ``` ```output tiup is checking updates for component cluster ... Starting component `cluster`: /root/.tiup/components/cluster/v1.10.2/tiup-cluster display tidb-test Cluster type: tidb Cluster name: tidb-test Cluster version: v7.5.1 Deploy user: tidb SSH type: builtin Dashboard URL: http://10.90.1.34:2379/dashboard Grafana URL: http://10.90.4.231:3000 ID Role Host Ports OS/Arch Status Data Dir Deploy Dir -- ---- ---- ----- ------- ------ -------- ---------- 10.90.4.231:9093 alertmanager 10.90.4.231 9093/9094 linux/x86_64 Up /tidb-data/alertmanager-9093 /tidb-deploy/alertmanager-9093 10.90.4.231:3000 grafana 10.90.4.231 3000 linux/x86_64 Up - /tidb-deploy/grafana-3000 10.90.1.34:2379 pd 10.90.1.34 2379/2380 linux/x86_64 Up|L|UI /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.2.38:2379 pd 10.90.2.38 2379/2380 linux/x86_64 Up /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.3.188:2379 pd 10.90.3.188 2379/2380 linux/x86_64 Up /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.4.231:9090 prometheus 10.90.4.231 9090/12020 linux/x86_64 Up /tidb-data/prometheus-9090 /tidb-deploy/prometheus-9090 10.90.1.69:4000 tidb 10.90.1.69 4000/10080 linux/x86_64 Up - /tidb-deploy/tidb-4000 10.90.2.35:4000 tidb 10.90.2.35 4000/10080 linux/x86_64 Up - /tidb-deploy/tidb-4000 10.90.4.53:9000 tiflash 10.90.4.53 9000/8123/3930/20170/20292/8234 linux/x86_64 Up /tidb-data/tiflash-9000 /tidb-deploy/tiflash-9000 10.90.1.162:20160 tikv 10.90.1.162 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 10.90.2.108:20160 tikv 10.90.2.108 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 10.90.3.12:20160 tikv 10.90.3.12 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 Total nodes: 12 ``` ### 步骤 3. 查看 `solution-three-nodes-scale-out-ticdc.yaml` 文件 ```bash cat solution-three-nodes-scale-out-ticdc.yaml ``` ```output cdc_servers: - host: 10.90.2.84 gc-ttl: 86400 data_dir: "/cdc-data" - host: 10.90.2.134 gc-ttl: 86400 data_dir: "/cdc-data" - host: 10.90.2.214 gc-ttl: 86400 data_dir: "/cdc-data" ``` ### 步骤 4. 部署 `TiCDC` 节点 ```bash tiup cluster scale-out tidb-test --user ec2-user -i ~/.ssh/pe-class-key-oregon.pem solution-three-nodes-scale-out-ticdc.yaml ``` ```output ... Do you want to continue? [y/N]: (default=N) y ... Scaled cluster `tidb-test` out successfully ``` ### 步骤 5. 检查 TiDB 集群的状态 ```bash tiup cluster display tidb-test ``` ```output tiup is checking updates for component cluster ... Starting component `cluster`: /home/ec2-user/.tiup/components/cluster/v1.12.1/tiup-cluster display tidb-test Cluster type: tidb Cluster name: tidb-test Cluster version: v7.5.1 Deploy user: tidb SSH type: builtin Dashboard URL: http://10.90.1.34:2379/dashboard Grafana URL: http://10.90.4.231:3000 ID Role Host Ports OS/Arch Status Data Dir Deploy Dir -- ---- ---- ----- ------- ------ -------- ---------- 10.90.4.231:9093 alertmanager 10.90.4.231 9093/9094 linux/x86_64 Up /tidb-data/alertmanager-9093 /tidb-deploy/alertmanager-9093 10.90.1.34:8300 cdc 10.90.1.34 8300 linux/x86_64 Up /cdc-data /tidb-deploy/cdc-8300 10.90.2.38:8300 cdc 10.90.2.38 8300 linux/x86_64 Up /cdc-data /tidb-deploy/cdc-8300 10.90.3.188:8300 cdc 10.90.3.188 8300 linux/x86_64 Up /cdc-data /tidb-deploy/cdc-8300 10.90.4.231:3000 grafana 10.90.4.231 3000 linux/x86_64 Up - /tidb-deploy/grafana-3000 10.90.1.34:2379 pd 10.90.1.34 2379/2380 linux/x86_64 Up|L|UI /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.2.38:2379 pd 10.90.2.38 2379/2380 linux/x86_64 Up /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.3.188:2379 pd 10.90.3.188 2379/2380 linux/x86_64 Up /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.4.231:9090 prometheus 10.90.4.231 9090/12020 linux/x86_64 Up /tidb-data/prometheus-9090 /tidb-deploy/prometheus-9090 10.90.1.69:4000 tidb 10.90.1.69 4000/10080 linux/x86_64 Up - /tidb-deploy/tidb-4000 10.90.2.35:4000 tidb 10.90.2.35 4000/10080 linux/x86_64 Up - /tidb-deploy/tidb-4000 10.90.4.53:9000 tiflash 10.90.4.53 9000/8123/3930/20170/20292/8234 linux/x86_64 Up /tidb-data/tiflash-9000 /tidb-deploy/tiflash-9000 10.90.1.162:20160 tikv 10.90.1.162 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 10.90.2.108:20160 tikv 10.90.2.108 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 10.90.3.12:20160 tikv 10.90.3.12 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 Total nodes: 15 ``` ### 步骤 6. 检查 TiCDC 集群的状态 ```bash tiup ctl:v7.5.1 cdc capture list --pd=http://${HOST_PD1_PRIVATE_IP}:2379 ``` ```output ... Starting component `ctl`: /home/ec2-user/.tiup/components/ctl/v7.5.1/ctl cdc capture list --pd=http://10.80.0.224:2379 [ { "id": "1c15e075-1435-464c-af66-92ba0286a7fe", "is-owner": false, "address": "10.90.1.34:8300", "cluster-id": "default" }, { "id": "4399c858-e811-4d9e-9b08-fb5690c097ec", "is-owner": true, "address": "10.90.2.38:8300", "cluster-id": "default" }, { "id": "5982fa7d-c755-409a-88d5-03527c8a0fcd", "is-owner": false, "address": "10.90.3.188:8300", "cluster-id": "default" } ] ``` ## 模块 2：创建复制任务 ### 步骤 1. 通过 `SSH` 连接到 PD1 ```bash ./ssh-to-pd1.sh ``` ```output ... Last login: Sun Oct 15 21:44:34 2023 ... ``` ### 步骤 2. 在 PD1 上启动 MySQL server ```bash sudo service mysqld start ``` ### 步骤 3. 登录 MySQL + 使用密码 `q1w2e3R4_`，以 `root@'localhost'` 身份登录 3306 端口的 MySQL server。 ```bash mysql -u root -p -h 127.0.0.1 -P 3306 -pq1w2e3R4_ ``` ### 步骤 4. 为变更 Capture 任务创建一个用户 ```sql CREATE USER cdc_user@'%' IDENTIFIED BY 'q1w2e3R4_'; ``` ```output mysql> CREATE USER cdc_user@'%' IDENTIFIED BY 'q1w2e3R4_'; Query OK, 0 rows affected (0.00 sec) ``` ```sql GRANT ALL PRIVILEGES on *.* to cdc_user@'%'; ``` ```output mysql> GRANT ALL PRIVILEGES on *.* to cdc_user@'%'; Query OK, 0 rows affected (0.00 sec) ``` ```sql EXIT; ``` ```output mysql> EXIT; ``` ### 步骤 5. 为上游 MySQL 数据库加载时区 ```bash mysql_tzinfo_to_sql /usr/share/zoneinfo | mysql -u root mysql -pq1w2e3R4_ ``` ```output mysql: [Warning] Using a password on the command line interface can be insecure. Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/leapseconds' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/tzdata.zi' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/zone.tab' as time zone. Skipping it. Warning: Unable to load '/usr/share/zoneinfo/zone1970.tab' as time zone. Skipping it. ``` ### 步骤 6. 为下游 MySQL 准备数据 + 通过 3306 端口连接到下游 MySQL 数据库，并创建一个名为 `test`的新数据库，以及一个名为 `T1`的表。`T1` 表应具有一个名为 `id` 的主键列和一个名为 `name` 的 `VARCHAR(20)` 列。然后退出 MySQL 客户端。 ```bash mysql -u root -h 127.0.0.1 -P 3306 -pq1w2e3R4_ ``` ```sql DROP DATABASE IF EXISTS test; CREATE DATABASE test; CREATE TABLE test.T1(id INT PRIMARY KEY, name VARCHAR(20)); SELECT * FROM test.T1; ``` ```sql EXIT; ``` ### 步骤 7. 打开第二个终端（终端 2），并在 TiDB 上准备数据 + 点击这里 - [终端 2](ssh://monitor1-ssh#2) 打开一个新的终端，连接到为你的实践实验分配的虚拟机。 + 登录后显示的横幅： ```output , #_ ~\_ ####_ Amazon Linux 2 ~~ \_#####\ ~~ \###| ~~ \#/ ___ ~~ V~' '-> ~~~ / A newer version of Amazon Linux is available! ~~._. _/ _/ _/ Amazon Linux 2023, GA and supported until 2028-03-15. _/m/' https://aws.amazon.com/linux/amazon-linux-2023/ ``` ```bash mysql -h${HOST_DB1_PRIVATE_IP} -P4000 -uroot ``` ```sql DROP DATABASE IF EXISTS test; CREATE DATABASE test; CREATE TABLE test.T1(id INT PRIMARY KEY, name VARCHAR(20)); SELECT * FROM test.T1; EXIT; ``` ### 步骤 8. 在终端 2 中，创建一个复制任务 + 在[终端 2](ssh://monitor1-ssh#2) 的 `monitor1` 中, 执行 `cdc:v7.5.1 cli` 命令来创建一个复制任务。请注意 `cdc:v7.5.1` 版本，如果你省略版本标签，最新版本可能与我们的 TiDB 集群不兼容。你可能会收到一条警告消息，指出某些表不符合复制条件，因为它们没有主键或或非空唯一键。这些是之前练习遗留的表。只需选择 `Y` 忽略这些表。 + 以下是对命令的一些详细解释： + `--pd=http://${HOST_PD1_PRIVATE_IP}:2379`：其中一个 PD 节点的 IP 地址。 + `--sink-uri="mysql://cdc_user:q1w2e3R4_@${HOST_PD1_PRIVATE_IP}:3306/"`：复制任务的下游地址为 ${HOST_PD1_PRIVATE_IP}，端口为 3306。 + `--changefeed-id="replication-task-1" --sort-engine="unified"`: 复制任务的 ID。 ```bash tiup cdc:v7.5.1 cli changefeed create --pd=http://${HOST_PD1_PRIVATE_IP}:2379 \ --sink-uri="mysql://cdc_user:q1w2e3R4_@${HOST_PD1_PRIVATE_IP}:3306/" \ --changefeed-id="replication-task-1" --sort-engine="unified" ``` ```output tiup cdc:v7.5.1 cli changefeed create --pd=http://${HOST_PD1_PRIVATE_IP}:2379 \ > --sink-uri="mysql://cdc_user:q1w2e3R4_@${HOST_PD1_PRIVATE_IP}:3306/" \ > --changefeed-id="replication-task-1" --sort-engine="unified" Starting component `cdc`: /home/ec2-user/.tiup/components/cdc/v7.5.1/cdc cli changefeed create --pd=http://10.80.0.224:2379 --sink-uri=mysql://cdc_user:q1w2e3R4_@10.80.0.224:3306/ --changefeed-id=replication-task-1 --sort-engine=unified Create changefeed successfully! ID: replication-task-1 Info: {"upstream-id":0,"sink-uri":"mysql://cdc_user:q1w2e3R4_@10.80.0.224:3306/","opts":{},"create-time":"2023-02-13T12:54:53.673149259Z","start-ts":439430124303286275,"target-ts":0,"admin-job-type":0,"sort-engine":"unified","sort-dir":"","config":{"case-sensitive":true,"enable-old-value":true,"force-replicate":false,"check-gc-safe-point":true,"filter":{"rules":["*.*"],"ignore-txn-start-ts":null},"mounter":{"worker-num":16},"sink":{"dispatchers":null,"protocol":"","column-selectors":null,"schema-registry":""},"cyclic-replication":{"enable":false,"replica-id":0,"filter-replica-ids":null,"id-buckets":0,"sync-ddl":false},"consistent":{"level":"none","max-log-size":64,"flush-interval":1000,"storage":""}},"state":"normal","error":null,"sync-point-enabled":false,"sync-point-interval":600000000000,"creator-version":"v6.1.0"} ``` ### 步骤 9. 在终端 2 中，查询复制任务列表 ```bash tiup cdc:v7.5.1 cli changefeed list --pd=http://${HOST_PD1_PRIVATE_IP}:2379 ``` ```output Starting component `cdc`: /home/ec2-user/.tiup/components/cdc/v7.5.1/cdc cli changefeed list --pd=http://10.80.0.224:2379 [ { "id": "replication-task-1", "summary": { "state": "normal", "tso": 439430205069852673, "checkpoint": "2023-02-13 13:00:01.713", "error": null } } ] ``` ### 步骤 10. 在终端 2 中，查询指定的复制任务 ```bash tiup cdc:v7.5.1 cli changefeed query --pd=http://${HOST_PD3_PRIVATE_IP}:2379 --changefeed-id=replication-task-1 ``` ```output Starting component `cdc`: /home/ec2-user/.tiup/components/cdc/v7.5.1/cdc cli changefeed query --pd=http://10.80.0.12:2379 --changefeed-id=replication-task-1 { "upstream_id": 7231813390813770262, "namespace": "default", "id": "replication-task-1", "sink_uri": "mysql://cdc_user:xxxxx@10.90.3.188:3306/", "config": { "memory_quota": 1073741824, "case_sensitive": true, "enable_old_value": true, "force_replicate": false, "ignore_ineligible_table": false, "check_gc_safe_point": true, "enable_sync_point": false, "bdr_mode": false, "sync_point_interval": 600000000000, "sync_point_retention": 86400000000000, "filter": { "rules": [ "*.*" ], "event_filters": null }, "mounter": { "worker_num": 16 }, "sink": { "protocol": "", "schema_registry": "", "csv": { "delimiter": ",", "quote": "\"", "null": "\\N", "include_commit_ts": false }, "column_selectors": null, "transaction_atomicity": "", "encoder_concurrency": 16, "terminator": "\r\n", "date_separator": "none", "enable_partition_separator": false }, "consistent": { "level": "none", "max_log_size": 64, "flush_interval": 2000, "storage": "" } }, "create_time": "2023-05-11 07:09:04.259", "start_ts": 441395168967655437, "resolved_ts": 441395195247853571, "target_ts": 0, "checkpoint_tso": 441395195247853571, "checkpoint_time": "2023-05-11 07:10:44.372", "sort_engine": "unified", "state": "normal", "error": null, "error_history": null, "creator_version": "", "task_status": [ { "capture_id": "4399c858-e811-4d9e-9b08-fb5690c097ec", "table_ids": [], "table_operations": null }, { "capture_id": "5982fa7d-c755-409a-88d5-03527c8a0fcd", "table_ids": [], "table_operations": null }, { "capture_id": "1c15e075-1435-464c-af66-92ba0286a7fe", "table_ids": [ 80 ], "table_operations": null } ] } ``` ### 步骤 11. 在终端 2 中，向上游 TiDB 插入数据 ```bash mysql -h${HOST_DB1_PRIVATE_IP} -P4000 -uroot ``` ```sql SELECT * FROM test.T1; ``` ```output mysql> SELECT * FROM test.T1; Empty set (0.01 sec) ``` ```sql INSERT INTO test.T1 VALUES(1, 'Tom'); ``` ```output mysql> INSERT INTO test.T1 VALUES(1, 'Tom'); Query OK, 1 row affected (0.00 sec) ``` ```sql SELECT * FROM test.T1; ``` ```output mysql> SELECT * FROM test.T1; +----+------+ | id | name | +----+------+ | 1 | Tom | +----+------+ 1 row in set (0.00 sec) ``` ```sql EXIT; ``` ### 步骤 12. 在终端 1 中，检查下游 MySQL 中的结果 ```bash mysql -u cdc_user -h ${HOST_PD1_PRIVATE_IP} -P 3306 -pq1w2e3R4_ ``` ```sql SELECT * FROM test.T1; ``` ```output mysql> SELECT * FROM test.T1; +----+------+ | id | name | +----+------+ | 1 | Tom | +----+------+ 1 row in set (0.00 sec) ``` ```sql EXIT; ``` ```output mysql> EXIT; ``` ## 模块 3：移除 TiCDC 集群 ### 步骤 1. 在终端 2 中，暂停复制任务 ```bash tiup cdc:v7.5.1 cli changefeed pause --pd=http://${HOST_PD1_PRIVATE_IP}:2379 --changefeed-id replication-task-1 ``` ### 步骤 2. 在终端 2 中，移除复制任务 ```bash tiup cdc:v7.5.1 cli changefeed remove --pd=http://${HOST_PD1_PRIVATE_IP}:2379 --changefeed-id replication-task-1 ``` ### 步骤 3. 在终端 2 中，查询复制任务 ```bash tiup cdc:v7.5.1 cli changefeed list --pd=http://${HOST_PD3_PRIVATE_IP}:2379 ``` ```output Starting component `cdc`: /home/ec2-user/.tiup/components/cdc/v7.5.1/cdc cli changefeed list --pd=http://10.80.0.12:2379 [] ``` ### 步骤 4. 移除 TiCDC 集群 ```bash tiup cluster scale-in tidb-test --node ${HOST_PD1_PRIVATE_IP}:8300 --node ${HOST_PD2_PRIVATE_IP}:8300 --node ${HOST_PD3_PRIVATE_IP}:8300 --yes ``` ```output ... Scaled cluster `tidb-test` in successfully ``` ### 步骤 5. 检查 TiDB 集群的状态 ```bash tiup cluster display tidb-test ``` ```output tiup is checking updates for component cluster ... Starting component `cluster`: /home/ec2-user/.tiup/components/cluster/v1.12.1/tiup-cluster display tidb-test Cluster type: tidb Cluster name: tidb-test Cluster version: v7.5.1 Deploy user: tidb SSH type: builtin Dashboard URL: http://10.90.1.34:2379/dashboard Grafana URL: http://10.90.4.231:3000 ID Role Host Ports OS/Arch Status Data Dir Deploy Dir -- ---- ---- ----- ------- ------ -------- ---------- 10.90.4.231:9093 alertmanager 10.90.4.231 9093/9094 linux/x86_64 Up /tidb-data/alertmanager-9093 /tidb-deploy/alertmanager-9093 10.90.4.231:3000 grafana 10.90.4.231 3000 linux/x86_64 Up - /tidb-deploy/grafana-3000 10.90.1.34:2379 pd 10.90.1.34 2379/2380 linux/x86_64 Up|L|UI /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.2.38:2379 pd 10.90.2.38 2379/2380 linux/x86_64 Up /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.3.188:2379 pd 10.90.3.188 2379/2380 linux/x86_64 Up /tidb-data/pd-2379 /tidb-deploy/pd-2379 10.90.4.231:9090 prometheus 10.90.4.231 9090/12020 linux/x86_64 Up /tidb-data/prometheus-9090 /tidb-deploy/prometheus-9090 10.90.1.69:4000 tidb 10.90.1.69 4000/10080 linux/x86_64 Up - /tidb-deploy/tidb-4000 10.90.2.35:4000 tidb 10.90.2.35 4000/10080 linux/x86_64 Up - /tidb-deploy/tidb-4000 10.90.4.53:9000 tiflash 10.90.4.53 9000/8123/3930/20170/20292/8234 linux/x86_64 Up /tidb-data/tiflash-9000 /tidb-deploy/tiflash-9000 10.90.1.162:20160 tikv 10.90.1.162 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 10.90.2.108:20160 tikv 10.90.2.108 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 10.90.3.12:20160 tikv 10.90.3.12 20160/20180 linux/x86_64 Up /tidb-data/tikv-20160 /tidb-deploy/tikv-20160 Total nodes: 12 ``` ## 实验结束