Optical technologies for recent computer networks should provide high performance, ability to easy expansion and ensuring greater data's safety. They are very popular and still very much under research. The paper concerns optical switching problem for broadcast, multicast and unicast traffic. Improvement of architecture represented by input-output matrix and broadcast-multicast matrix, which deals with the considered types of transmission, is presented. For the proposed system, new modified algorithms like LSA, QLSA, Exact and J-family are provided and investigated. In order to evaluate properties of developed algorithms, the experimentation system has been designed and implemented. As main index of performance the total penalty TP is used. The idea of experimentation system, some results of research and properties of algorithms are discussed.