A subset of keepers nodes hosted on GCP US-east1 has lost connectivity.

Incident Report for ClickHouse Cloud

Resolved

This incident has been resolved.

Posted Dec 13, 2023 - 20:03 UTC

Update

All the keepers affected have been recovered. We are continuing to identify the root cause of the issue.

Posted Dec 13, 2023 - 17:27 UTC

Monitoring

We replaced the nodes and are monitoring the situation. We are still working on identifying the root cause.

Posted Dec 13, 2023 - 15:58 UTC

Update

We are continuing to investigate this issue.

Posted Dec 13, 2023 - 15:57 UTC

Investigating

We are investigating an issue happening in US-east1 in GCP. It appears that a subset of the nodes hosting keepers has temporarily lost connectivity, and we are investigating the root cause.

Posted Dec 13, 2023 - 15:54 UTC

This incident affected: Google Cloud Provider (GCP) (us-east1).