One of the key components of a hybrid electric vehicle (HEV) drive train is its secondary energy storage device. The automotive industry is still in the process of debating on the fact, as to which device provides the best option in HEVs, for the purpose of load leveling. This paper aims at providing a fair idea with regards to the selection of secondary energy sources, based on vehicle performance characteristics and overall drive train efficiency. The performances of lead-acid (PBA), lithium-ion (Li-Ion), nickel-cadmium (Ni-Cd), nickel-metal hydride (Ni-MH), and nickel-zinc (Ni-Zn) batteries, as well as ultra-capacitors (UC) are investigated over city and highway driving schedules for a heavy-duty diesel-parallel hybrid transit bus application. Based on the simulation studies for the above-mentioned storage devices, the Ni-MH, PBA, and the ultra-capacitor technologies demonstrate best results in terms of fuel economy and percentage drive train efficiency. On the other hand, the Ni-Zn and Li-Ion batteries show much promise, but still demand a great deal of research and development work, before they become a viable option for HEV applications. Finally, the paper compares and summarizes critical performance characteristics for the energy storage devices under investigation.