Skip to main content
Presentation
Long Range Dependence (LRD) in the Arrival Process of Web Robots
International Proceedings of Computer Science and Information Technology
  • Derek Doran, Wright State University - Main Campus
  • Swapna S. Gokhale
Document Type
Conference Proceeding
Publication Date
8-1-2012
Find this in a Library
Catalog Record
Disciplines
Abstract

There is strong evidence to suggest that a significant proportion of traffic on Web servers, across many domains, can be attributed to Web robots. With the advent of the Social Web, widespread use of semantic Web technologies, and development of service-oriented Web applications, it is expected that this proportion will only rise over time. One of the most important distinctions between robots and humans is the pattern with which they request resources from a Web server. In this paper, we examine the arrival process of Web robot requests across Web servers from three diverse domains. We find that, regardless of the domain, Web robot traffic exhibits long range dependence (LRD) similar to human traffic. We discuss why, at least in some cases, LRD in robot traffic may not be generated by heavy-tailed response sizes as in the case of human traffic.

Comments

Presented at the International Conference on Intelligent Network and Computing, New Delhi, India, August 18-19, 2012.

Citation Information
Derek Doran and Swapna S. Gokhale. "Long Range Dependence (LRD) in the Arrival Process of Web Robots" International Proceedings of Computer Science and Information Technology Vol. 47 (2012) p. 176 - 180 ISSN: 9789810730321
Available at: http://works.bepress.com/derek_doran/12/