I absolutely believe that performing narrow stance squats and leg presses help to 'build' the vastus lateralis.
I too have genetically larger inner thighs and since I changed my stance to narrow (6-8"), feet pointing straight, I have vastly improved my sweep, to the point where it NO longer is a problem!
Leg extensions (pigeon toes) and DB lunges are good as well but nothing improves the sweep more than heavy "parallel" squats and leg presses, performed with a narrow stance and with your feet pointing straight forward (no angle from heel to toe).
JD~