Brendan:
Are you sure you have the right starter plate? Mine was a FWD drilled to fit the starter on my AWD, but the angle was off as well as the position.
MD167356 - 2G AWD. It will be punched into the outside face of the plate.
MD194962 - 2G FWD

When I put my new plate up, the starter lined up perfectly. No play L or R. Also started up and engaged perfectly. There was no need to adjust it once installed and torqued.
The starter has a little lip on it that should fit perfectly into the precut hole.

Let me know how you're doing.