# 2022-04-25-11:15:40-0700 scale down graceful-shutdown-tidb-webhook and restart db-tidb-0 pod

- Cause:
  db-tidb-0 pod is OOM killed customer ran script with threads=20000

```
sysbench tidb-workload run --time=1800 --threads=20000 --mysql-user=root --mysql-password= --mysql-host=private-tidb.a22525ad.75e6a3fa.us-central1.prod.gcp.tidbcloud.com --mysql-port=4000 --mysql-db=nylas_poc --report-interval=1
```

- Operation:
  scale down graceful-shutdown-tidb-webhook

```
Error from server: admission webhook "graceful-shutdown-tidb-webhook.tidb-admin.svc" denied the request: Get "http://db-tidb-0.db-tidb-peer.tidb1379661944607554068.svc:8080/down": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
```

command:

```
kubectl edit deploy graceful-shutdown-tidb-webhook  -n tidb-admin
set replica to 0
kubectl delete pods db-tidb-0 -n tidb1379661944607554068
```

- Impact:
  db-tidb-0 pod restarted
  cluster is back up
- Recovery operation:
- Time window:
  apr 25 2022 11:10 AM PST -- 11:11 AM PST