I assumed he DIDN'T have sex with her that time.. remember she was tied to the bed, so he said "We'd done it before.." meaning they had done the kinky stuff other times, but this time he blacked out so couldn't remember if he did anything or not.