If you are flat + any body fat (more the worse), it will give you a feeling of what you are experiencing right now. When the muscles are full with glycogen, they will look much better. If you are following a lower carb diet approach, just stick in there and as you lean up, it will get better as bodyfat drops.
Also, if you are carrying a lot of water and fat, and the further you are away from stage ready, when you diet down, you are going to lose that and your clothes will be baggier. This doesn't mean muscle is wasting away, you just have to expect that to happen before going into the diet, and definately while following it. If glycogen is depleted, it will be even worse.
The only way to really fix that is to stay fully glycogenated, or buy new clothes that fit tighter again. However, if low-carbing, then it may be hard regardless until you carb-up again.
Just stick with the diet, and as you lean up, you will appear bigger.
If you have doubts on your diet, then just post it up to be looked at by the members here.
btw.....don't forget it's not always gonna be how big you look in clothes, but how big you are and the illusion you present when it is off. A lean tapered body will not always look bigger in a shirt, but when off, it can make guys 20-30lbs heavier look bad. You cannot wear the same clothes at 220-lbs as you do if bulked to 260+ lbs
BMJ