don't worry about the other guys, worry about yourself and being more precise and faster. Maybe keep the bike, move up to B-group and monitor your laptimes. When you're no longer improving, maybe it's time to get some professional help, CSS, Yamaha ChampSchool, Ken Hill, etc. Perhaps when you can do 5-laps in row within 0.25s of each other and do back-to-back days with those times, you're at the limit of the bike?
I've chopped off 10-20s off my times this year at various tracks and I still have another 10 to go before reaching group-ave. limit of 250 racing class. It's so much fun! Especially passing up pretty much everyone in B-group, except for instructors. When I beat Dave Moss in 250 Superbike class, I think I'll be ready for bigger bike!
I think you should try B-group.