paramour
n. Archaic or derog. Illicit lover of a married person. [french par amour by love]
n. A lover, of either sex; a wooer or a mistress (formerly in a good sense, now only in a bad one); one who takes the place, without possessing the rights, of a husband or wife; -- used of a man or a woman.