Golf/GTI VII :: Wide Inconsistency With Shift Times

I picked up a Mk7 Golf S a few weeks back with 5MT. I'm coming from driving 3 different B5.5 Passats over the last seven years (two 1.8T, one V6, all three manual). The first thing I noticed, and enjoyed, with the Mk7 is a much improved throttle response. No more stepping on the gas and waiting 1+ seconds for the tach to rev up on downshifts. However, after seven years of Passat driving I had grown accustomed to the consistent (albeit somewhat slow) shift times. All that said, downshifting on the Mk7 5MT feels a lot nicer than it ever did in a Passat.

My issue with the Mk7 is that there seems to be a wide degree of inconsistency with shift times. Sometimes the tach just hangs for a 1.25+ seconds when I shift to neutral while waiting for the RPMs to drop for the next (higher) gear. Other times the tach drops immediately. I've read that the gear ratios are somewhat steep for the 5MT, so I've been trying to adjust my expectations and foot movements accordingly. Additionally, I have been paying closer attention to when I get my foot off the throttle in preparation for a shift. However, the inconsistency is still there no matter where I shift in the RPM range. Does the flywheel in the 5MT weigh 30lbs? Is this purely user error, a transmission issue, or am I just crazy for expecting the tach to drop when I shift into neutral? Just trying to get a read on whether or not I am alone here.

Lastly, would a torque arm insert provide any potential improvement to shifter feel and the reduce the inconsistent shift times I am experiencing? I am not so keen on adding vibration to the cabin as the car is dead silent on the highway at 75mph, but if there would be a significant improvement in 1st/2nd/3rd gear shifts for city driving I might be willing to bite.