17
That time at a hackathon in Austin when a junior dev showed me my ML model was overfitting on noise
She pulled up my loss curves on her laptop and pointed out the exact epoch where I started memorizing random outliers, and I had to admit she was right after 3 hours of debugging together.
2 comments
Log in to join the discussion
Log In2 Comments
ruby4501mo ago
...and I actually just read something about how overfitting is like this hidden trap that even senior devs fall into all the time. It's so easy to get attached to your model and miss the obvious stuff when you've been staring at it for hours. I saw this one study where they found that taking a five minute break and looking at your loss curves fresh can catch like 70% of overfitting issues that people miss otherwise. That junior dev probably saved you a ton of time honestly, sometimes it takes someone who isn't buried in the code to spot the problem.
5
rowan7251mo ago
Wait, doesn't actually fighting with a model for 3 hours teach you way more than a five minute break would? I feel like that hands-on struggle where you finally SEE the exact noise you're memorizing is what makes it stick in your brain for real.
4