By Topic

An enhanced intelligent forum crawler

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Hwei-Ming Ying ; Cryptography & Security Dept., Inst. for Infocomm Res., Singapore, Singapore ; Vrizlynn L. L. Thing

As online forums contain a vast amount of information that can aid in the early detection of fraud cases and extremist activities, accurate and efficient forum crawlers are very important in the field of digital forensics to acquire useful information and knowledge. In this paper, we conduct an analysis on an existing work, iRobot, which is an intelligent forum crawler. We identify the drawbacks of iRobot in its vertex-based traversal path selection, edge-based traversal path seletion, informativeness estimation and detection of duplicate pages. We also propose algorithms which are better suited for these tasks and present the proofs that they can achieve a much higher accuracy and efficiency. Finally, we conduct an empirical evaluation on the “” and “” forum sites to demonstrate the actual accuracy improvement of our proposed informativeness estimation.

Published in:

2012 IEEE Symposium on Computational Intelligence for Security and Defence Applications

Date of Conference:

11-13 July 2012