Greg Pass
ABSTRACT
We survey many of the measures used to describe and evaluate the efficiency and effectiveness of large-scale search services. These measures, herein visualized versus verbalized, reveal a domain rich in complexity and scale. We cover six principle facets of search: the query space, users' query sessions, user behavior, operational requirements, the content space, and user demographics. While this paper focuses on measures, the measurements themselves raise questions and suggest avenues of further investigation.
- S. Beitzel, E. Jensen, D. Lewis, A. Chowdhury, A. Kolcz, and O. Frieder, "Improving Automatic Query Classification via Semi-supervised Learning," presented at The Fifth IEEE International Conference on Data Mining, New Orleans, Louisiana, U.S.A., 2005. Google Scholar
Digital Library
- A. Chowdhury, "Automatic Evaluation of Web Search Services," in Advances in Computers, vol. ISBN: 0-12-012164-6, 2005.Google Scholar
- W. Xi, K. Sidhu, and A. Chowdhury, "Latent Query Stability," presented at International Conference on Information and Knowledge Engineering IKE, 2003.Google Scholar
- S. Beitzel, E. Jensen, A. Chowdhury, D. Grossman, and O. Frieder, "Hourly Analysis of a Very Large Topically Categorized Web Query Log," presented at ACM-SIGIR, 2004. Google ScholarDigital Library
- S. Beitzel, E. Jensen, A. Chowdhury, D. Grossman, and O. Frieder, "Hourly Analysis of a Very Large Topically Categorized Web Query Log," JASIST, vol. (to appear), 2006.Google Scholar
- N. Belkin, R. Oddy, and H. Brooks, "ASK for information retrieval. Part I: Background and theory; Part II: Results of a design study," Journal of Documentation, vol. 38, pp. 61--71, 145--164, 1982.Google ScholarCross Ref
- G. Murray, J. Lin, and A. Chowdhury, "Characterizing Web Search User "Sessions" with Hierarchical Agglomerative Clustering," presented at under review, 2006.Google Scholar
- D. He, A. Göker, and D. Harper, "Combining Evidence for Automatic Web Session Identification," Information Processing & Management vol. 38, pp. 727--742, 2002. Google ScholarDigital Library
- A. Broder, "A taxonomy of web search," presented at SIGIR Forum, 2002. Google ScholarDigital Library
- D. Rose and D. Levinson, "Understanding User Goals in Web Search," presented at WWW, 2004. Google ScholarDigital Library
- E. Jensen, S. Beitzel, A. Chowdhury, and O. Frieder, "A Framework for Determining Necessary Query Set Sizes to Evaluate Web Search Effectiveness," presented at WWW, 2005. Google ScholarDigital Library
- S. Beitzel, E. Jensen, A. Chowdhury, G. Pass, and O. Frieder, "Surrogate Scoring for Improved Metasearch Precision," presented at Proceedings of the 2005 ACM Conference on Research and Development in Information Retrieval, Salvador, Brazil, 2005. Google ScholarDigital Library
- A. Chowdhury and G. Pass, "Operational Requirements for Scalable Search Systems," presented at ACM-CIKM Conference for Information and Knowledge Management, 2003. Google ScholarDigital Library
- A. Gulli and A. Signorini, "The Indexable Web is More than 11.5 Billion Pages," presented at WWW, 2005. Google ScholarDigital Library
- P. Boutin, "Brewster Kahle made a copy of the Internet, Now, he wants your files," vol. 2005: Slate, 2005.Google Scholar
- L. Gravano, V. Hatzivassiloglou, and R. Lichtenstein, "Categorizing Web Queries According to Geographical Locality," presented at ACM-CIKM, 2003. Google ScholarDigital Library
Index Terms
- A picture of search
Recommendations
Supporting exploratory search tasks with interactive user modeling
ASIST '13: Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information BoundariesThis paper presents the design and study of interactive user modeling to support exploratory search tasks. Contrary to traditional interactions, such as query based search, query suggestions, or relevance feedback, interactive user modeling allows a ...
A New Algorithm for Inferring User Search Goals with Feedback Sessions
For a broad-topic and ambiguous query, different users may have different search goals when they submit it to a search engine. The inference and analysis of user search goals can be very useful in improving search engine relevance and user experience. ...
Utilization of Fuzzy Theory in the Modeling of Users of Adaptive Hypermedia Systems
ACHI '08: Proceedings of the First International Conference on Advances in Computer-Human InteractionMost of the software systems are not developed taking into account the heterogeneous needs of users. It is known that each user has different levels of knowledge, goals, abilities, and preferences. This fact emphasizes the need of developing systems ...
Comments