My partner has HSV 2 and we’ve been having sex

Do you guys think im safe if I have sex with him in his boxers and a condom? no skin to skin contact

It minimizes the risk, especially if he’s on daily Valtrex.