Obviously Tommy held his hand against his lapel that way in order to make it seem as if his other two fingers were under his jacket, but that's not the case.

It was said that he didn't like the appellation "Three Finger Brown." The way he attempts to hide his hand there sort of lends credence to that.

Of course still another way to interpret his body language there is that he isn't really taking the oath.