In the picture above you'll see two gravel vacuums. Ignore the white pieces of plastic I shoved into them for another project. They're basically pieces of hose or tubing several feet long with a wider end we use in the tank to clean the gravel. If you can't aquire one at a store you can maybe make one out of some items around the house to work the same way.
Place the big end in the tank, give the other end of the tube a little suck like a straw to get water coming out. Then while water is coming out, move the big end in the tank up and down into the gravel to vacuum out any wastes. Only change a small amount of water at a time to start. Maybe 1/10th or 10%. Do this about once a week and add new clean water to the tank afterwards.
It's not good for the fish to be moved around, it stresses them out and it's not good to clean the tank entirely. As an added benefit, you can never break the tank in the process. Glass gets slippery and I've seen many people drop them hauling them out to be cleaned.