RM-Transformer: A Transformer-based Model for Mandarin Speech Recognition

A network called RM-Transformer is proposed in this paper for Mandarin speech recognition. The proposed RMTransformer can make full use of features from different layers in the network instead of features solely from the top layer, which is used in the traditional models. Moreover, the proposed network has excellent capability in addressing the ambiguity problems caused by homophone phenomenon in Mandarin speech recognition task. Empirical evaluations have been conducted in two widely used datasets, which are Aishell-l and Aidatatang-200zh. Experimental results can verify the effectiveness of the proposed scheme.