I'm still in the stage of "Wear everything!" and hope to never grow out of it.
Everything means: Helmet, earplugs, back protector, heavy gloves, armored jacket, armored pants, and moto boots.
I typically don't ride to work since gearing up for me takes me longer than the drive to work is, and having to deal with all the gear once I get to the office is annoying (even though I do have my own office and a locker room down the hall).
To me it's not worth riding if I'm not willing to gear up.
The only time I'll ride without gear is to turn the bike around in the driveway or in the paddock at the track. But there I'm mostly duckwalking anyway so meh.
I've been tempted by the idea of wearing armor pieces under my clothes (shin guards, shorts, elbow/forearm guards), but then realize that cotton still sucks in the abrasion resistance department.