OK... so I'm back from the mechanic. Fluid change done, but they were quite busy so I just visually re-inspected everything myself when it's on the lift. Everything seems to be fine. They told me the prop shaft was not touched at all, though GM manual says it should be removed. The fluid change did seem to be useful, as they showed me a LOT of metal filings on the fluid that came out.
Initially the Vibe is still there (pun intended), but again fluctuating, sometimes at 80 sometimes nothing.
So when I came home, out of nowhere came the idea for me to check the tire pressure. Kept in mind the tires are quite hot, I checked the pressure, but noticed one of the rear tire is WAY higher than the others, like 3-4 psi more. So I let some air out to equalize it with the others, this time the vibe is VASTLY removed. I can hard accelerate and it's smooth, though my rear view mirror still shakes a bit with a blurry image.
I'm gonna check the pressure again when the tires are cool and pump them back to 31 psi. If this cures it, I'm going to bang my head on the wall real hard.