All insights
Engineering#Reliability#DevOps#Lessons Learned
What Seven Years of Production Incidents Taught Me
Every outage teaches the same handful of lessons in a different costume. Here are the ones that actually changed how I build.
NA
Nafiz Anam
Lead Software Engineer
September 14, 2024
9 min read
1. Alerts Without Owners Are Noise
If a page doesn't have a named human responsible for acting on it, it will be ignored within a month.
2. Rollback Speed Matters More Than Deploy Speed
Optimize for how fast you can undo a bad change, not just how fast you can ship a good one.
3. Most "Database Issues" Are Actually Query Issues
Before scaling infrastructure, profile the slow query. It's cheaper and it's usually the real fix.
Work Together
Facing something similar in your product?
I help founders and technical teams design, build, and scale software products the right way. Let's talk about your specific challenges.