Knowing Unknowns in an Age of Information Overload

TL;DR

This work tackles information overload by introducing an information completeness metric that quantifies how much of the information spectrum a user observes during Internet browsing. It harnesses sentence-level embeddings to compare each viewed result against the full corpus, producing a cumulative completeness curve across top results. Validation uses 6.5 trillion results from 48 countries, linking completeness to broader media freedom patterns, and a randomized online experiment shows that awareness of completeness can modestly boost open-mindedness—especially toward factual information—and change browsing behavior toward deeper, more complete results. The findings highlight a path toward mitigating incomplete information exposure and fostering open-minded discourse in an age of information abundance, while acknowledging methodological and cultural limitations and suggesting avenues for future research.

Abstract

The technological revolution of the Internet has digitized the social, economic, political, and cultural activities of billions of humans. While researchers have been paying due attention to concerns of misinformation and bias, these obscure a much less researched and equally insidious problem - that of uncritically consuming incomplete information. The problem of incomplete information consumption stems from the very nature of explicitly ranked information on digital platforms, where our limited mental capacities leave us with little choice but to consume the tip of a pre-ranked information iceberg. This study makes two chief contributions. First, we leverage the context of internet search to propose an innovative metric that quantifies information completeness. For a given search query, this refers to the extent of the information spectrum that is observed during web browsing. We then validate this metric using 6.5 trillion search results extracted from daily search trends across 48 nations for one year. Second, we find causal evidence that awareness of information completeness while browsing the Internet reduces resistance to factual information, hence paving the way towards an open-minded and tolerant mindset.

Figures (11)

• Figure 1: A simplified low-dimensional vector representation of information relevance ($= cos(\beta)$) and information completeness ($= cos(\alpha)$). $\vec{q}$, $\vec{r_i}$, and $\vec{c}$ are the search query vector, search result vector, and the corpus vector respectively.
• Figure 2: Information completeness curve with completeness rising as more results are viewed. The dashed red line shows that the level of information completeness achieved when 10% of the search result corpus has been viewed.
• Figure 3: Total search volume fetched every day across 48 nations. Color intensity in map varies directly with the raw search result volume (units in billions).
• Figure 4: Search platform view before any query is entered. Instructions for study participants are noted at the top.
• Figure 5: Search platform view for treatment group participants when they enter a search query (e.g., 'patriotism in American youth'). An information completeness score is provided.