Moe Green complains to Michael about Fredo: "He was banging cocktail waitresses two at a time." Maybe they were transgender, or crossdressers.
Perhaps Moe was jealous and wanted Fredo all to himself?
Didn't Toni Basil sing about it:
Oh Fredo, you're so fine, you're so fine you blow my mind. Hey Fredo!