Definitely keep in mind your financial situation. It's really a big deal when you start talking kids. Also, be aware your free time is going to go down as well, which means less time with the Z and less time being able to work on it, move it around in the garage, etc.
The Z is a spendy track car (tires, gas, insurance, etc), albeit certainly fun. But you can have loads of fun cheaper with a used Miata. Even if it ends up being unreliable, it'll still be cheaper overall.
Get your money out of the Z now, if you ever want to.
