[c147] Katsanos C., Tselios N., Avouris N. (2009). Are ten participants enough for evaluating information scent of Web page hyperlinks?. In Proceedings of the 12th IFIP TC13 Conference in Human-Computer Interaction, Interact 2009, LNCS 5726, Part I (pp. 419-422), Uppsala, Sweden: Springer Verlag, August 24-28, 2009, doi: 10.1007/978-3-642-03655-2_45 (pdf)
Information scent of hyperlinks, that is the userʼs assessment of semantic relevance of navigation options in a webpage, has been identified as a critical factor in Web navigation. An important question in this context is to identify the minimum number of participants required to measure reliably information scent. A two phase study was conducted in an attempt to provide an answer to this question. In the first phase, involving 101 participants, ratings produced by different size subsets of participants were compared to those of the whole set. In the second phase, the ratings of these different size subsets of participants where compared with measures of behavior of 54 participants, who performed the same information navigation tasks using a typical web browser. Results indicate that representative estimates of information scent can be obtained from 10 participants in both cases. This finding has important implications for future scent-related studies.
Information scent, Web usability study, cost-benefit analysis.