Ask him if it is okay with him if you get a lover!
The majority of men that are unfaithful want to keep their family. Affairs end eventually. Only you can decide whether or not you want to stay in the marriage under these circumstances. What are your alternatives? Which alternative is the least painful?