Madison was absolutely a family. In the early 1970s, FBI files contain references to the Madison family being disbanded around '73. The family had been low key/borderline inactive for a period of time starting in the mid 1960s.