You shouldnt have to go down much Ali. He has me doing them and I actually was using more weight with single arm laterals then I was regular ones in a about 2-3 workouts.
I will give this variation a try. Are you basically holding on to a something with the non working hand to keep your balance?