Hello confusd,
Nice to meet you.
I had something quite similar happening recently.
I had a big crisis, and for the first time ever, I had my therapist calling me, every day for 4 days (until our session, actually) to help me calm down and not go into full full crisis mode.
During the session, I asked whether she wanted me to pay for it. She explained that no, it was an exceptional crisis situation, and it would be different if it was to happen on a regular basis. And I answered "yeah, no, I hope it won't, it would be a pain".... and immediately felt bad for implying that calling her was a pain, what kind of rude person says that... so I specified that it was the crisis I was talking about and... she had actually completely understood.
So: 1) your therapist probably understood, 2) but if it is bugging you, it probably can't hurt to bring it up. We usually have a "left-over" time in my sessions, especially during the sessions after a difficult session, precisely to ensure I can bring up any concern, any "oh, I actually meant" or "I am not sure what you meant"...
So it seems like it is important for you to clarify what you meant... go for it, worst case scenario, he will think you are very considerate of his feelings and will want to explore that! Good luck!