I've had my fitbit for going on 3-ish years now and I've never had this issue. I go out walks for 1.5 to 2+ hours most days and use the live exercise tracking feature for it to log the distance as well, when I finish it and go back in, the time changes from however long I've been out to under 30 mins.
