They are supposed to affect it, so I'm not sure. Which fitbit do you have? I know some of them are supposed to log stairs climbed, but have no idea which. (Have flex myself.)
It's important to remember that your fitbit is basically just a pedometer with some nifty features to it. It won't give you your accurate burn without a HRM, maybe not even then.
I will manually enter all activity that is not normal walking. I personally don't count household chores, driving, etc. as activity, nor do I usually log stairs climbed unless I was to go 10+ stories at a time.