Web robots are applications which recursively and automatically overview the content of website documents. Some robots
are considered to be malicious. Hence, identifying web robots is a classification challenge. In this research we mainly present a hybrid
particle swarm optimization method and fuzzy system aiming at increasing efficiency over Web robot detection and simulation by
MATLAB software. Evaluation criteria are considered: Specificity, Accuracy, F- Measure, Recall and Precision. Results of the study for
the proposed method are respectively: 99.81, 96.92, 96.10, 91.39 and 99.58. The yields for proposed basic fuzzy system and fuzzy
network algorithm and ANFIS neural fuzzy network algorithm indicate the priority of the proposed method other than algorithms being
compared.
Published In:IJCSN Journal Volume 7, Issue 4
Date of Publication : August 2018
Pages : 272-278
Figures :07
Tables : 03
Mohammad Ordouei :
Computer Engineering Dep., Islamic Azad University (IAU)
Tehran,Iran
Iman Namdar :
Computer Engineering Dep., Islamic Azad University (IAU)
Tehran,Iran
Web robot detection; fuzzy system; particle swarm optimization algorithm
This paper aimed at providing a hybrid method to improve
web robots accuracy. Of the features of proposed method
than similar works we consider:
- Providing a novel method to detect Web robots
influence
- Improve efficiency detecting web robots
The paper investigated through MATLAB software, the
results were compared using algorithms. To test the
performance of the proposed method some criteria
including Precision, Accuracy, F-Measure, Recall and
Specificity were considered. Conducting experiments
yielded that the proposed algorithm was better than the
other ones.
[1] D. Doran, S.S. Gokhale, "A classification framework
for web robots", Journal of the Association for
Information Science and Technology, 63(12), 2549-
2554, 2012.
[2] G. Klir, B. Yuan, "Fuzzy sets and fuzzy logic", (Vol.
4), New Jersey: Prentice hall, 1995.
[3] B. Han, X. Bian, "A hybrid PSO-SVM-based model
for determination of oil recovery factor in the lowpermeability
reservoir", Petroleum, 2017.
[4] M. Hasanipanah, A. Shahnazar, H. B. Amnieh, D.J.
Armaghani, "Prediction of air-overpressure caused by
mine blasting using a new hybrid PSO-SVR model",
Engineering with Computers, 33(1), 23-31, 2017.
[5] R. Dong, J. Xu, B. Lin, "ROI-based study on impact
factors of distributed PV projects by LSSVM-PSO",
Energy, 124, 336-349, 2017.
[6] D. Stevanovic, A. An, N. Vlajic, "Feature evaluation
for web crawler detection with data mining techniques",
Expert Systems with Applications, 39(10), 8707-8717,
2012.
[7] D. Doran, S. S. Gokhale, "Web robot detection
techniques: overview and limitations", Data Mining
and Knowledge Discovery, 22(1-2), 183-210, 2011.
[8] A. Kalantari, A. Kamsin, S. Shamshirband, A. Gani, H.
Alinejad-Rokny, A. T. Chronopoulos, "Computational
intelligence approaches for classification of medical
data: State-of-the-art, future challenges and research
directions", Neurocomputing, 2017.