Macron, 46, was unusually candid and emotional about the ongoing speculation in certain right-wing circles about Brigitte Macron, whom he married in 2007.
"The worst thing is the false information and fabricated scenarios," Macron said at an International Women's Day event in Paris Friday after he guaranteed the right to abortion in France's Constitution.
"People eventually believe them and disturb you, even in your intimacy."
Brigitte's lookalike daughter, attorney Tiphaine Auzaine, 40, who rarely gives interviews, also addressed the painful rumors in an interview late last month in Paris Match.
"I have concerns about the level of society when I hear what is circulating on social networks about my mother being a man," Auzaine told the outlet.
"The confidence of what is affirmed and the credit given to what is proclaimed. Anyone can say anything about anyone, and it takes time to get it taken down."

Comment: She's not 'self-described', she is a journalist.
Both claimed in a since-deleted four-hour YouTube video in 2021 that Brigitte Macron was born as a baby boy called Jean-Michel Trogneux in 1953 — but that is actually the name of the first lady's brother.
Comment: That's their point: that Brigitte is in fact Jean-Michel Trogneux.
The women also alleged that Brigitte Macron's first husband, André-Louis Auzière, had never actually existed before he died in 2019 at age 68, the Daily Mail reported.
Rey claimed that Jean-Louis Auzière, André-Louis' uncle, had forged administrative documents to hide that his wife had given birth to all of Brigitte's three children, including Tiphaine Auzière, the outlet added.
Following appeals, Roy was fined the equivalent of just under $1,000 and Rey had to pay about $500.
The Macrons first met when Brigitte, then 40, taught drama at the Catholic Providence school in Amiens. The future president was 15 — and her daughter Laurence was his classmate.
Comment: Just the official story is all kinds of messed up, and illegal...
Though the French age of consent is 15, Brigitte was concerned about her relationship with Macron and how it would affect her kids.
"I took time so I would not wreck their lives," Brigitte told Paris Match last year.
"That lasted 10 years, the time to put them on the rails. You can imagine what they were hearing. But I didn't want to miss out on my life."
Once the couple tied the knot in 2007, Emmanuel, then-29, told his three stepchildren, "Thanks for accepting us, a not-quite-normal couple."
Comment: Here's the complete original research into Brigitte Macron's murky background:
From Jean-Michel to Brigitte Trogneux, Lies at The Elysée