By Topic

Turkish word n-gram analyzing algorithms for a large scale Turkish corpus - TurCo

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

The purchase and pricing options are temporarily unavailable. Please try again later.
2 Author(s)
Cebi, Y. ; Dept. of Comput. Eng., Dokuz Eylul Univ., Izmir, Turkey ; DalkiliƧ, G.

To calculate some statistical properties of a language, first you need to take some samples of that language. That sample is called a corpus. An unbalanced large scale Turkish text corpus (TurCo) having ∼362 MB capacity and more than 50 million words was prepared by using 12 different resources including Web sites and novels in Turkish language. Different algorithms were tested to obtain the n-gram (1≤n≤5) values. Efficiencies of different algorithms have been examined by applying them onto the each piece of the corpus one by one. Only detailed results of the two algorithms created without using database tables are given, because all the other algorithms need to run more than one day which makes those tests inefficient.

Published in:

Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004. International Conference on  (Volume:2 )

Date of Conference:

5-7 April 2004