Hey, Google, is it what the Holocaust looked like? Auditing algorithmic curation of visual historical content on Web search engines

R. Ulloa M. Makhortykh Aleksandra Urman

22 September 2022

In today's high-choice media environment, search engines play an integral role in informing individuals and societies about the latest events. The importance of search algorithms is even higher at the time of crisis, when users search for information to understand the causes and the consequences of the current situation and decide on their course of action. In our paper, we conduct a comparative audit of how different search engines prioritize visual information related to COVID-19 and what consequences it has for the representation of the pandemic. Using a virtual agent-based audit approach, we examine image search results for the term "coronavirus" in English, Russian and Chinese on five major search engines: Google, Yandex, Bing, Yahoo, and DuckDuckGo. Specifically, we focus on how image search results relate to generic news frames (e.g., the attribution of responsibility, human interest, and economics) used in relation to COVID-19 and how their visual composition varies between the search engines.

M. Makhortykh R. Ulloa Aleksandra Urman

26 Juni 2021

Web search engines influence perception of social reality by filtering and ranking information. However, their outputs are often subjected to bias that can lead to skewed representation of subjects such as professional occupations or gender. In our paper, we use a mixed-method approach to investigate presence of race and gender bias in representation of artificial intelligence (AI) in image search results coming from six different search engines. Our findings show that search engines prioritize anthropomorphic images of AI that portray it as white, whereas non-white images of AI are present only in non-Western search engines. By contrast, gender representation of AI is more diverse and less skewed towards a specific gender that can be attributed to higher awareness about gender bias in search outputs. Our observations indicate both the the need and the possibility for addressing bias in representation of societally relevant subjects, such as technological innovation, and emphasize the importance of designing new approaches for detecting bias in information retrieval systems.

S. Geiss Birgit Stark M. Steiner + 1 lainnya

24 Juni 2020

ABSTRACT Search engines are important political news sources and should thus provide users with diverse political information – an important precondition of a well-informed citizenry. The search engines’ algorithmic content selection strongly influences the diversity of the content received by the users – particularly since most users highly trust search engines and often click on only the first result. A widespread concern is that users are not informed diversely by search engines, but how far this concern applies has hardly been investigated. Our study is the first to investigate content diversity provided by five search engines on ten current political issues in Germany. The findings show that sometimes even the first result is highly diverse, but in most cases, more results must be considered to be informed diversely. This unreliability presents a serious challenge when using search engines as political news sources. Our findings call for media policy measures, for example in terms of algorithmic transparency.

Dechun Zhang

2020

Search engines play a vital role in positioning, organizing, and disseminating knowledge in China. Although there is a growing interest in China’s search engines, relatively few researches systematically examine their role involving nationalism. In order to address the research gap, this article compares the top thirty search results,from Baidu, 360 Search, Sogou Search, and Google regarding the “Meng Wanzhou Incident” while focusing on the overlap, ranking, and bias patterns. Furthermore, this study also analyses the differences between Wikipedia and China’s online encyclopedias concerning the “Meng Wanzhou Incident” in terms of content, structure, sources, and their main arguments. This article finds: 1) Chinese search engines favor their own services, thereby offering a unique and selective content bias; 2) Chinese search engines and online encyclopedias only provide Chinese sources that provide national biased knowledge, which raises search bias concerns; and 3) Chinese online encyclopedias offer a strong one-sided argument that is positive to China. Overall, this study finds that China’s search engines service the Chinese government’s self-interest by rendering overly biased social realities; moreover, they produce a logic of “imagined communities” to promote and stimulate feelings of nationalism.

M. Makhortykh R. Ulloa Aleksandra Urman

3 Mei 2021

We examine how six search engines filter and rank information in relation to the queries on the U.S. 2020 presidential primary elections under the default—that is nonpersonalized—conditions. For that, we utilize an algorithmic auditing methodology that uses virtual agents to conduct large-scale analysis of algorithmic information curation in a controlled environment. Specifically, we look at the text search results for “us elections,” “donald trump,” “joe biden,” “bernie sanders” queries on Google, Baidu, Bing, DuckDuckGo, Yahoo, and Yandex, during the 2020 primaries. Our findings indicate substantial differences in the search results between search engines and multiple discrepancies within the results generated for different agents using the same search engine. It highlights that whether users see certain information is decided by chance due to the inherent randomization of search results. We also find that some search engines prioritize different categories of information sources with respect to specific candidates. These observations demonstrate that algorithmic curation of political information can create information inequalities between the search engine users even under nonpersonalized conditions. Such inequalities are particularly troubling considering that search results are highly trusted by the public and can shift the opinions of undecided voters as demonstrated by previous research.