Would you be mad if someone said they could have sexually assaluted you if they wanted, but chose not to?

That's grounds for a sexual harassment lawsuit. He's being a jerk and trying to intimidate you and indeed he has. This is serious! You need to do something about this right now! Tell your supervisor!