Hi Wife,
None of us can answer whether or not your husband is gay...or will identify as gay in 1,5,10 years. But, if he wants to have sex with a man (as you say he does) he's not straight. Are you OK with that? If not, it's OK to say: This isn't what I signed up for. It's OK to insist on monogamy. You can still respect his identify without agreeing to anything you're uncomfortable with.