Recent developments of phosphate glasses for a variety of technological applications, from rare-earth ion hosts for solid state lasers to low temperature sealing glasses, have led to renewed interest in understanding the structures of these unusual materials. In this review, spectroscopic and diffraction studies of simple phosphate glasses, including v-P2O5 and binary phosphate compositions, are described. Special attention is given to the structures of anhydrous ultraphosphate glasses, which have received close attention from the glass community only in the past six years.