August 21, 2023

A disk filled up overnight

Norsolia Studio · 3 min read

A logging change quietly ballooned a file and a disk hit 94%. Our rule is to pause uploads below 3 GB free, and it fired before anything corrupted. We found the log, rotated it, and added an alert on free space. No data lost, but a reminder that the boring limits earn their keep.

incident ops

All posts