Small unmanned aerial vehicles (UAV) are typically driven by Lithium polymer batteries. The batteries have their own dynamics, which changes during discharge. Classical approaches to altitude control assume a time-invariant system and therefore fail. Adaptive controllers require an identified system model which is often unavailable. Battery dynamics can be characterized and used for a battery model-based controller. This controller is useful in situations when no feedback from actuators (such as RPM or thrust) is available. After measuring the battery dynamics for two distinct types of batteries, a controller is designed and experimentally verified, showing a consistent performance during entire discharge test and a consequent flight verification.