Can fibroids be caused by the lack of sex.

I have not had sex for almost 3 years because my husband is diabetic. My fibroid seem to have grown and i am still losing weight although i am in peri menopause. My doctor was so surprised to know that i am not having sex. I was advised to have hysterectomy because of my age but i am worried about having that surgery because i am hypertensive. My back hurts me so much at times i walk bend. What do you think.