Talk to him about it better, I know many who add friends only to their YM for many reasons and purposes but not to do something wrong.

If he is according to you having an affair with someone, why would he add her on YM if he can be with her all the time? I don't think that he is too stupid to do so. When people are really doing something wrong, they get extra cautious about it and that indeed means something wrong is happening.