i would be worried about the suspension components too on the rear driver side. a lot of damage is hidden underneath sometimes... and yes, pearl white is a very difficult color to paint match. they will probably paint the entire side of the car.
as for the accident you should be fine as far as who caused it. especially damage to the side of the car, insurance will quickly decide that you did not hit him, rather he hit you. my wife was hit the same way while driving a corolla (new at the teim) which i hated to hell and i was so frikken happy when this middle-aged woman backed into her while she drove by. it was a perfect accident. wife was not hurt, no kids in the car at the time, and enough damage to sell the pos and get a nicer dd.
still smelled fresh paint when i traded it in right after repair (before carfax).