That clamp just holds that small cover on. It's mostly cosmetic, and heat shield for your leg. I've had an aftermarket exhaust for a long time, and I don't remember how close my leg got to it, it might not be much of an issue.
If it falls off, it won't affect your bike's operation at all, though it's probably not a good idea to be shedding parts as you go down the road.