No problem. I can't see any issue with this at all and I've seen it done before. Just make sure you are still getting adequate lugnut engagement with the spacer installed. Depending on what size you use I would imagine you may need longer wheel studs, but I doubt you would with only 3mm, just make sure to verify!