Do you have something urgent to tell him, and he can’t hear it? Then use your damned safeword, silly.
Whether you’re being punished or praised or patronized, the whole point of the safeword is to ensure your dom has any crucial info needed to make the best possible decisions about your well-being. To not use it when it’s necessary is unfair to everyone involved.