Fingering instabilities similar to those commonly observed in viscous systems have been observed in purely elastic layers that are strained in tension. The instability is driven by the release of lateral constraints within a confined elastic layer and is observed when the lateral confinement significantly exceeds the thickness of the elastic layer. Our results show convincingly that yielding or flow of a material is not required in order for fingering to be initiated in a confined material.