See Why does my Fitbit device count extra steps?
Fitbits worn on the wrist detect steps from the normal swinging of arms while walking. Fitbit tries to filter out other arm movements but can't always tell the difference. Most people find that over the course of a day, the error is relatively small.
But for certain activities with repeated regular arm movements, you might want to take it off and use that as a time to charge your fitbit. Such activities might include knitting, drumming, strumming guitar, etc. But even if you leave it on and get extra steps, that does not affect calorie burn or 'active minutes' as they come from heart rate, not steps.
Best Answer