Svoboda | Graniru | BBC Russia | Golosameriki | Facebook

research-article

Augmenting web pages and search results to support credibility assessment

Authors:

Meredith MorrisAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1245 - 1254

https://doi.org/10.1145/1978942.1979127

Published: 07 May 2011 Publication History

Abstract

The presence (and, sometimes, prominence) of incorrect and misleading content on the Web can have serious consequences for people who increasingly rely on the internet as their information source for topics such as health, politics, and financial advice. In this paper, we identify and collect several page features (such as popularity among specialized user groups) that are currently difficult or impossible for end users to assess, yet provide valuable signals regarding credibility. We then present visualizations designed to augment search results and Web pages with the most promising of these features. Our lab evaluation finds that our augmented search results are particularly effective at increasing the accuracy of users'" credibility assessments, highlighting the potential of data aggregation and simple interventions to help people make more informed decisions as they search for information online.

Supplementary Material

index.html (index.html)

Slides from the presentation

Download
.99 KB

Audio only (1979127.mp3)

Download
8.03 MB

Video (1979127.mp4)

Download
110.64 MB

References

[1]

Banko, M., Cafarella, M.J., Soderland, S., Broadhead, M., and Etzioni, O. Open information extraction from the Web. IJCAI 2007, 2670--2676.

Digital Library

[2]

Bhavnani, S. Domain-Specific Search Strategies for the Effective Retrieval of Healthcare and Shopping Infor-mation. CHI 2002 Extended Abstracts, 610--611.

Digital Library

[3]

Brin, S. and Page, L. The anatomy of a large-scale hy-pertextual Web search engine. ISDN 1998, 107--117.

Digital Library

[4]

Cavarlee, J. and Liu, L. Countering Web spam with credibility-based link analysis. PODC 2007, 157--166.

Digital Library

[5]

Chi, E., Pirolli, P., Chen, K., and Pitkow, J. Using in-formation scent to model user information needs and ac-tions and the Web. CHI 2001, 490--497.

Digital Library

[6]

Cutrell, E. and Guan,Z. What are you looking for? An eye-tracking study of information usage in Web search. CHI 2007, 407--416.

Digital Library

[7]

Dignan, L. Gartner Puts Phishing Tab at $3.2 Billion. ZDNet. December 17, 2007.

[8]

Ennals, R. Byler, D., Agosta, J.M. and Rosario, B. What is Disputed on the Web? WICOW 2010, 67--74.

Digital Library

[9]

Fallows, D. Search Engine Users. Pew Internet and American Life Project, 2005.

[10]

Ferebee, S. An examination of the influence of in-volvement level of Web site users on the perceived cred-ibility of Web sites. PERSUASIVE 2007, 176--186.

Digital Library

[11]

Fogg, B.J. Marshall, Laraki, O., Osipovich, A., Varma, C. Fang, N., Paul, J., Rangekar, A., Shon, J., Swani, P., and Treinen, M. What makes Web sites credible?: A re-port on a large quantitative study. CHI 2001, 61--68.

Digital Library

[12]

Fogg, B.J. Persuasive Technology: Using Computers to Change What We Think and Do. Morgan Kaufmann, 2002.

Digital Library

[13]

Fogg, B. J. Prominence-interpretation theory: explaining how people assess credibility online. CHI 2003 Extend-ed Abstracts, 722--723.

Digital Library

[14]

Fogg, B.J., Soohoo, C., Danielson, D.R., Marable, L., Stanford, J., and Tauber, E.R. How do users evaluate the credibility of Web sites?: A study with over 2,500 par-ticipants. DUX 2003, 1--15.

Digital Library

[15]

Gamon, M., Basu, S., Belenko, D., Fisher, D., Hurst, M., and Konig, A.C. BLEWS: Using Blogs to Provide Context for News Articles. ICWSM 2008.

[16]

Gyongyi, Z., Molina, H.G., and Pederson, J. Combating Web spam with TrustRank. VLDB 2004, 576--587.

Digital Library

[17]

Hargittai, E., Fullerton, F., Menchen-Trevino, E. and Thomas, D. Trust online: young adults' evaluation of Web content. International Journal of Communications, 2010.

[18]

Hilligoss, B. and Rieh, S.Y., Developing a unifying framework of credibility assessment: construct, heuristics, and interaction in context. Information Processing and Management, 44(4), 2008, 1467--1484.

Digital Library

[19]

Ivory, M. and Hearst, M. Statistical profiles of highly-rated Web sites. CHI 2002, 367--374.

Digital Library

[20]

Joachims, T., Granka, L., Pan, B., Hembrooke, H., and Gay, G. Accurately interpreting clickthrough data as implicit feedback. SIGIR 2005, 154--161.

Digital Library

[21]

Jenkins, H. Confronting the Challenges of Participatory Culture: Media Education for the 21st Century. 2006.

[22]

Kapoun, J. Teaching Undergrads WEB Evaluation: A Guide for Library Instruction. C&RL News, July/August 1998, 522--523.

[23]

Kittur, A., Suh, B. and Chi, E. Can you ever trust a wiki?: Impacting perceived trustworthiness in Wikipe-dia. CSCW 2008, 477--480.

Digital Library

[24]

Lazar, J., Meiselwitz, G., and Feng, J. Understanding Web Credibility: A Synthesis of the Research Literature. Foundations and Trends in HCI, 1(2), 2007.

Digital Library

[25]

Leu, D.J. and Zawilinski, L. The New Literacies of Online Reading Comprehension. New England Reading Association Journal, 43(1), 2007, 1--7.

[26]

Lohr, S. This Boring Headline is Written for Google. The New York Times, April 9, 2006.

[27]

McKnight, D. and Kacmar, C. Factors and effects of information credibility. ICEC 2007, 423--432.

Digital Library

[28]

Metzger, M. J. Making sense of credibility on the Web: Models for evaluating online information and recom-mendations for future research. Journal of the American Society for Information Science and Technology, 58(13), 2007, 2078--2091.

Digital Library

[29]

Pew Research. Growing Number of Americans Say Obama is a Muslim. August 18, 2010.

[30]

Schneiderman, B. Designing trust into online experienc-es. CACM, 43(12), 2000, 57--59.

Digital Library

[31]

White, R., Dumais, S., and Teevan, J. Characterizing the influence of domain expertise on Web search behavior. WSDM 2009, 132--141.

Digital Library

[32]

White, R. and Morris, D. Investigating the querying and browsing behavior of advanced search engine users. SIGIR 2007, 255--262.

Digital Library

[33]

Wu, M., Miller, R., and Garfinkel, S. Do security toolbars actually prevent phishing attacks? CHI 2006.

Digital Library

Cited By

Zhang BNaderi NMishra RTeodoro D(2024)Online Health Search Via Multidimensional Information Quality Assessment Based on Deep Language Models: Algorithm Development and ValidationJMIR AI10.2196/426303(e42630)Online publication date: 2-May-2024
https://doi.org/10.2196/42630
Wani AJoshi ISingh P(2024)Navigating the Job-Seeking Journey: Challenges and Opportunities for Digital Employment Support in KashmirProceedings of the ACM on Human-Computer Interaction10.1145/36373758:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637375
Bink MElsweiler D(2024)Balancing Act: Boosting Strategies for Informed Search on Controversial TopicsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638329(254-265)Online publication date: 10-Mar-2024
https://dl.acm.org/doi/10.1145/3627508.3638329
Show More Cited By

Index Terms

Augmenting web pages and search results to support credibility assessment

Index terms have been assigned to the content through auto-classification.

Recommendations

Enhancing credibility judgment of web search results
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

In this paper, we propose a system for helping users to judge the credibility of Web search results and to search for credible Web pages. Conventional Web search engines present only titles, snippets, and URLs for users, which give few clues to judge ...
What makes Web sites credible?: a report on a large quantitative study
CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The credibility of web sites is becoming an increasingly important area to understand. To expand knowledge in this domain, we conducted an online study that investigated how different elements of Web sites affect people's perception of credibility. Over ...
How do credibility and utility play in the user experience of health informatics services?

While the use of health informatics is increasing in health care, how it is improving health care and how users accept the services has been little studied, and due to increasing uncertainty, credibility has become a key determinant of health ...

Comments

Information & Contributors

Information

Published In

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

121
Total Citations
View Citations
2,157
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)6

Reflects downloads up to 28 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang BNaderi NMishra RTeodoro D(2024)Online Health Search Via Multidimensional Information Quality Assessment Based on Deep Language Models: Algorithm Development and ValidationJMIR AI10.2196/426303(e42630)Online publication date: 2-May-2024
https://doi.org/10.2196/42630
Wani AJoshi ISingh P(2024)Navigating the Job-Seeking Journey: Challenges and Opportunities for Digital Employment Support in KashmirProceedings of the ACM on Human-Computer Interaction10.1145/36373758:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637375
Bink MElsweiler D(2024)Balancing Act: Boosting Strategies for Informed Search on Controversial TopicsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638329(254-265)Online publication date: 10-Mar-2024
https://dl.acm.org/doi/10.1145/3627508.3638329
Hughes EWang RJuneja PLi TMitra TZhang A(2024)Viblio: Introducing Credibility Signals and Citations to Video-Sharing PlatformsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642490(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642490
Mohanty VLuther K(2023)Photo Steward: A Deliberative Collective Intelligence Workflow for Validating Historical ArchivesProceedings of The ACM Collective Intelligence Conference10.1145/3582269.3615600(34-52)Online publication date: 6-Nov-2023
https://dl.acm.org/doi/10.1145/3582269.3615600
Aghajari ZBaumer EDiFranzo D(2023)Reviewing Interventions to Address Misinformation: The Need to Expand Our Vision Beyond an Individualistic FocusProceedings of the ACM on Human-Computer Interaction10.1145/35795207:CSCW1(1-34)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579520
Bink MSchwarz SDraws TElsweiler D(2023)Investigating the Influence of Featured Snippets on User AttitudesProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578323(211-220)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578323
Oliveira BTeixeira Lopes C(2023)The Evolution of Web Search User Interfaces - An Archaeological Analysis of Google Search Engine Result PagesProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578320(55-68)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578320
Wang ADe Jesus Sanchez LWintner AZhu YMustafaraj E(2023)Assessing Google Search’s New Features in Supporting Credibility judgments of Unknown WebsitesProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578277(303-307)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578277
Allen GBeijen MMaxwell DGadiraju U(2023)In a Hurry: How Time Constraints and the Presentation of Web Search Results Affect User Behaviour and ExperienceWeb Engineering10.1007/978-3-031-34444-2_16(221-235)Online publication date: 6-Jun-2023
https://dl.acm.org/doi/10.1007/978-3-031-34444-2_16
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents