Is adultery as bad for a man as is for a woman?

I believe is worse because a woman can be physically and mentally harmed by . But if a woman commits adultery, then the man can only be mentally distraught.