Like when you remember your prom, for example. You remember with who you went but not what you breakfast or what socks did you used... Unless it is relevant for the story of your life.
yeah the breakfast detail is so random but you're right — it only matters if it shapes the story. do you find yourself trying to hold onto the small stuff anyway or just let it go?