mastodon.nl is part of the decentralized social network powered by Mastodon.
Mastodon voor de Nederlandse community - door de Nederlandse community - in stand gehouden door Stichting Activityclub

Server stats:

4.5K
active users

Learn more

What’s your worst ops blunder?

Mine is the time I took down an entire AWS account by miss-spelling an environment variable 😳

Orrrr the time I accidentally deleted all the code from self hosted GitLab right before end of day

Bèr Kessels 🐝 🚐 🏄 🌱

@ellie For some reason, I thought I needed access to prod DB from my dev machine (basically me being lazy and not doing the debugging and reproduction properly)

So the DB_URL env var, pointed to the live database with payment details of over a million users in it.

Guess what happened when an hour later, I ran the tests in that terminal? Yeah, those with the before() function that called db_reset().

(We had backups. And failover. We're down for less than a minute. Still...)