I think it's normal to lose hair in amounts greater than what you specify. I don't believe that's indicative of any appreciable hair loss. My wife loses tons of hair on a daily basis, and has been doing so for years, and her hair doesn't appear to be thinning.
I think a visual inspection of whether you're thinning on top is a much better indication than noticing a few hairs coming out each day.