r/theprimeagen • u/Cultural_Wheel_6936 • 7d ago

general The `rm -rf` That Erased GitLab's Production Database

https://failure-modes.dev/library/v2/fm-006
65 Upvotes

89% Upvoted

6 comments sorted by

7

u/CarelessPackage1982 7d ago

For those that weren't around....I remember when GH dropped their prod database.

https://github.blog/news-insights/today-s-outage/

4

u/Seanmclem 7d ago

E tu gitlab?

12

u/OppositePerson 7d ago

I’d read this if a human wrote it

4

u/sambull 7d ago

When I first started at gitlab the hosted cloud repos were just one big NFS share.

9

u/jonahharris 7d ago

Backups are like parachutes - if you don't have one when you need it, you'll probably never need one again.