Everyone has been in that space, and to OP’s credit, some folks react in a much worse way.
OP, you reacted in a way that may have looked odd from the outside but as long as this isn’t a weekly occurrence talking to your boss like the parent comment says should resolve things.
Meanwhile, consider that some people respond to the same situation by yelling at the person who asked, or throwing things, or otherwise becoming violent. You got upset and removed yourself from the situation, which is the right thing to do.
The infinitive is the form of a verb that in English is said “to [x]”
For example, “to run” is the infinitive form of “run.”
OP probably meant “infinitely” worse.