I did totally not understand the sequence of what happened, but going form D into N is totally fine. Also going back into D is "only" wearing out your clutch. Even on Automatics it's a part that can be replaced, but it's just a headache to do so.
Most people should just leave it in D all the time when they drive.
