He is saying he always wanted out of the crime business and wanted to be legitimate. Let's not be fooled my Michael... he clearly didn't want out of the business at all, even by the end of Part III until Mary was killed.