All the time. It's a 370Z, not a Ferrari. You guys and your garage queen Z's
I live in the Midwest too and gravel roads are a fact of life around here. Sometimes it's a driveway, sometimes a section of a favorite paved road suddenly becomes gravel. Sometimes it's the only way to get to the party.
I've never noticed any problems with paint chips with any other cars from gravel roads, including a Solstice GXP that was lower than the Z. A gravel road will make a car dusty as hell, but thats the only "damage" I've ever experienced. Easily "fixed"; wash it!
Just take it easy; Don't peel out and spray rocks everywhere. Do not follow someone closely, as they can kick up rocks for quite a distance.
OTOH, I do avoid freshly tarred+chipped roads, as those suck because fresh tar will get thrown up onto the rocker panels and it's a PITA to remove.