We theoretically describe and study coupling between two whispering-gallery-mode microcavities through a side coupled fiber taper. The two microcavities can couple to each other bidirectionally with only one fiber taper waveguide due to the modal coupling between a pair of whispering-gallery modes traveling in opposite directions. By choosing appropriate physical parameters, some interesting spectra, such as electromagnetically-induced transparency-like coherent transmission and band-like reflection, can be obtained in such a system. Slow light is discussed in this paper as a direct application of the coupled microresonator structure. This structure also has potential application in coupled cavity quantum electrodynamics.