Originally Posted by ChrisSlicks

Yes, they are all abrasive to a greater or lesser extent based on their purpose. Think of it like sanding, you start with the coarse grit to get the hard work done (removing material) and then you work your way down to the finer grits to remove the marks caused by the course sanding.

You could try some swirl/haze remover by hand but it will take a lot of elbow grease, the results from a machine polisher will always be the best.