Here's my opinion, and what worked for me, as a well-educated layman, but not a medical professional:
To be honest, Clomid is a crap drug. It raises FSH and LH and total testosterone, so your numbers look good on paper. But it also raises SHBG, leaving you with less free testosterone, so with that and the emotional side effects, most men feel terrible on Clomid, even if their numbers look good. For me personally, Clomid raised my SHBG extremely high (over 120, when the normal range is between 30-50), and I felt horrible until I cut it out.
From my own example, I have been on testosterone and other steroids for over 28 years now. Coming off test was never an option for me. I was azoospermatic (zero sperm) when I began my fertility protocol. The first seven months, I was only on 200-300mg Test per week, 50mg Clomid, 25mg Proviron, and HCG. This only raised my sperm count to 7 million/ml TMC. Then I added in HMG, against my fertility doctor's wishes, and over the next four months my sperm count went up to 31 million/ml TMC, and my wife was pregnant. Our baby daughter is almost a year old now, big (98th percentile in height and weight) and happy and healthy, and toddling all around the house getting into trouble LOL. But she is an incredible blessing to us, and we are happy to have her.
What worked for me was:
200-300mg Test per week
500iu HCG every other day
30-60iu HMG every day (FSH and LH have very short half-lives in the body)
25mg Proviron per day
Your doctor is an idiot, but he is a useful idiot if he will prescribe HCG and FSH (Gonal-F) to you. Gonal-F is very expensive, but if insurance will cover it for you (rare that they cover it for men's fertility), then you are truly blessed. My doctor is a "fertility expert" very well-recommended in the area, but he wouldn't prescribe HMG to me, and if I had followed his very conservative advice, I never would have had my daughter. So do what you feel to be right. Sadly, doctors are often too afraid of liability to be useful; at least that is what I have found in my journey through life. A good doctor is rare, but worth their weight in gold.
How is your libido now? If it's poor, then I would add test back in at whatever TRT level you feel comfortable doing. If you are using FSH and HCG, then you are not producing your own hormones, you are injecting them from a bottle. So you are bypassing the usual negative feedback from the pituitary if you decide to use exogenous testosterone, and it will not negatively impact your fertility. I used test all the way through my protocol, and still recovered my fertility, so if it worked for me and many other men, it will probably work for you as well, barring any other pre-existing fertility conditions.
Daily or even twice-daily injections of HMG and FSH have been shown to work best in studies, due to the short half-lives of FSH and LH. EOD or twice-weekly injections are typically prescribed because normal people hate injections and won't comply with a protocol of frequent shots. EOD or twice per week will definitely work, but as with many things, small frequent daily injections work even better. But that's up to you, what you can afford, and what you are willing to do for success.
I'm not you, but if I were you, I would modify your plan to:
TRT dose of testosterone
500iu HCG EOD
150iu Gonal-F EOD (if you can afford it)
No AI unless you need it
Best of luck to you, and I will be praying for your success! If I could do it, you can do it as well! Have faith and keep trying!