Ok, so I went back and looked at some of my exhaust install photos and you're kind right. Its not super close but its close enough that you could bump them. Its also possible that I'm the only one concerned with this because I flail around wildly when working on cars.
Picture for position reference.