The Husband cannot sue you for criminal conversation, only the Wife can. He may be able to convince his Wife to sue you, but that assumes she will still be speaking to him when she finds out he has two children with another woman.
Your bigger worry is alienation of affection, if you are the reason that these parties did not continue to have a happy marriage, then his Wife can sue you for Alienation of Affection. People have received substantial monetary awards for these law suits. However, in order to win a substantial award, it is likely you would have to have substantial assets, if not it is probably not worth the risk for her to sue you.
I cannot give you any assurances that you will not be sued for alienation of affection if you pursue child support, however you are legally entitled to child support and should be receiving it.
If you are still involved with this man, I would break it off now so that you mitigate your potential legal liability.
Helena M. Nevicosi
Attorney with Rosen Law Firm
4101 Lake Boone Trail, Suite 500
Raleigh, North Carolina 27607
919.787.6668 main phone
919.787.6361 main fax
301 McCullough Drive
Charlotte, NC 28262
Main Voice: 704.307.4600
Main Fax: 704.943.0044
1829 East Franklin Street, Bldg 600
Chapel Hill, NC 27514
919.321.0780 main phone
919.787.6668 main fax
The response posted above is based upon the limited factual information made available and is not intended as a full and complete response to the question. The only reliable manner to obtain complete and adequate legal advice is to consult with an attorney, fully explain your situation, and allow the attorney sufficient opportunity to research the applicable law and facts required to render an accurate opinion. The basic information provided above is intended as a public service but a full discussion with an attorney should be undertaken before taking any action.