A guess
My guess (and that's pretty much what it is) would be that you'll need to wait several half-lives of the substance with the longest half-life.
So, look up the half-life of Clomid and Arimidex.
Then, try to find out what the lowest active dosage is - the lowest dose that has any effect.
Then, see how many half-life times have to pass to be well past this lowest active dosage level.
For example, suppose the half-life on 50 mg of Clomid is 5 days, and the lowest active dose is 5 mg.
After 5 days, the 50 mg is down to 25 mg.
After 5 more days, the 25 mg is now down to 12.5 mg.
After 5 more days, the 12.5 mg is down to 6.25 mg.
After 5 more days, the 6.25 mg is down to 3.125 mg.
So, given this example, you're waiting 20 day minimum for the dosage to be below the minimum active dose.
Now, the question is are there residual side effects that have to be taken into account, and/or any problem with the liver enzyme pathways that clear this?
As you can see, it gets complicated fast, but this might be a place to start.