Lady Victoria did not mind how forgetful this guy was. But he had forgotten something so crucial to her that she had to punish him. She was so pissed that she felt only ballbusting him would make sense and would be equal to what he had forgotten as it was going to cost her a lot. The mistress endured that he felt pain commensurate to what he had done or rather forgotten.