In this paper, we propose a new efficient entropy coding scheme, namely context-based binary arithmetic coding for bit-plane coding (CBACBP), for the enhancement layer of fine granular scalable (FGS) video coding. The basic structure of proposed CBACBP is based on the traditional bit-plane coding of MPEG-4 FGS. However, in order to enhance the coding efficiency of bit-plane coding, a newly designed context-based binary arithmetic coding scheme is used. In CBACBP, we apply three types of probability estimation techniques. The first type relies on local information of a given symbol to code, such as bit-plane level, data level and frequency component. In the second type, the preceding symbols in the same and/or higher bit-planes are used. In the third type, we consider complexity of a block including the symbol based on the number of coded nonzero coefficients in the block. Experimental results show that the proposed CBACBP improves the PSNR up to 1.2 and 0.5 dB compared with MPEG-4 FGS and JSVM, respectively.