Actually the overall feeling here is that the spacer does make a difference. So you're in good company. :D
Since the spacer is easy to remove, I'd do that. Then see if it's the spacer or the transmission. I doubt that the spacer would cause problems but then again, it's good to check everything.
What did you have done to your transmission?