Discovering Web access patterns and trends by applying OLAP and data mining technology on Web logs

As a confluence of data mining and World Wide Web technologies, it is now possible to perform data mining on Web log records collected from the Internet Web-page access history. The behaviour of Web page readers is imprinted in the Web server log files. Analyzing and exploring regularities in this behaviour can improve the system performance, enhance the quality and delivery of Internet information services to the end user, and identify populations of potential customers for electronic commerce. Thus, by observing people using collections of data, data mining can bring a considerable contribution to digital library designers. In a joint effort between the TeleLearning-NCE (Networks of Centres of Excellence) project on the Virtual University and the NCE-IRIS project on data mining, we have been developing a knowledge discovery tool, called WebLogMiner, for mining Web server log files. This paper presents the design of WebLogMiner, reports current progress and outlines future work in this direction.