I test drove the FR-S while shopping for the Z. Unfortunately I drove the Z first, so the FR-S was disappointing. The way I see it, you UPGRADE from the FR-S to the Z, not the other way around
Unless you're doing it to get better mileage, lower insurance costs(?), and cheaper maintenance, I'd avoid it.