He infers that this affair happened later on in time though.

She allegedly told Bobby Kennedy that she was in love with Sonny and this was the reason why Sonny was hounded by the law during this time period.

It just sounds like fantasy to me.