# 2021-03-15-19:21:30+0800 offline tikv-0 of cluster 1371284885024542720

- Cause: The machine of tikv-0 is down and cannot be recoverd, refer to [incident #3653](https://docs.google.com/document/d/1h_ijWJxr4yfHhke8_YYhQeDRuUAaOy9-R8eRBA3TIqQ/edit#) for detail
- Operation:

```bash
# take a backup of current tc
kubectl get tc -n ${NS} -o yaml > tc_backup.yaml

# edit target tidbcluster resource, add the following annotation,
# annotations:
#   tikv.tidb.pingcap.com/delete-slots: '[0]'
kubectl edit tc -n ${NS}

# wait the scale-in complete
kubectl get po -n ${NS} --watch
```

- Impact: The regions in tikv-0 will be transferd to tikv-3 and tikv-0 will be deleted
- Recovery Operation: apply the `tc_backup.yaml` back to the cluste
- Time window: 18:24~22:00, Mar 15, 2021 
