Ah c'mon man...suspend reality for a minute.
In my mind Ambrose would have beat up Rollins in the Locker room, or the Bathroom, or the Hall or in the Boiler room.
In storyline he didn't care. He wasn't there to answer a challenge, he was just coming to get a peice of Rollins ass.