If it is a grind, take it in.
If it's just a clunk... that's normal. Especially if it happens mostly when the transmission is cold. These are direct-input type transmissions so you get a lot of feedback through the shifter. They are beefy to handle the power so they aren't exactly the smoothest things around.