Transfer Learning for Indonesian Named Entity Recognition

Transfer learning enables machine learning system to use previously acquired knowledge from source task on target task. Source task and target task should be correlated. Successful transfer learning would improve system performance on target task especially when target data is small. In this paper, the source task is Indonesian part-of-speech (POS) tagging system and the target task is Indonesian named entity recognition (NER) tagging system. A bidirectional gated recurrent unit and conditional random field (GRU-CRF) sequence labeller is crafted as the model for the feature representation transfer to be applied. We compared F1 evaluation results between system that used transfer and system that did not use transfer and saw an improvement around 0.02 on the transferred model when 100% training data was used and around 0.15 when 1% training data was used.