Fredo possibly remaining a threat is uncertain which is why I think Michael killed him out of principle, and perhaps also out of anger and revenge.

"It was between the brothers Kay -- I had nothing to do with it."