I'm not sure what she meant about the Muslims but, depending on my mood when asked, I'm either an atheist or an agnostic and it irritates me when some of the more radical non-religious people try to ban any religious display (eg, invocations before sports, creches).
I don't like having religion crammed down my throat but I don't consider being "forced" to listen to someone petition a higher power for a victory for their side and the safety of all to be a big invasion of my "rights."