DOI: 10.3724/SP.J.1087.2013.03368

Journal of Computer Applications (计算机应用) 2013/33:12 PP.3368-3371

Parallel recognition of illegal Web pages based on improved KNN classification algorithm

There are many illegal Web pages on the Internet, which may have pornographic, violent, gambling or reactionary content. Without being filtered effectively, they will exercise a malign influence on the searching services. An improved K-Nearest Neighbors (KNN) classification algorithm to promote the recognition accuracy was proposed and implemented on a virtualized platform following the MapReduce model provided by the open source software Hadoop, which made it distributed and parallel. Through experiments and comparison with the existing work, it is proved that the proposed recognition method improves the accuracy and efficiency greatly.

Key words:illegal Web page,text classification,K-Nearest Neighbors (KNN) classification algorithm,Hadoop,MapReduce

ReleaseDate:2014-07-21 16:59:20