Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

LISP -- A Rich Interaction Dataset and Loggable Interactive Search Platform

Jana Isabelle Friese, Andreas Konstantin Kruff, Philipp Schaer, Norbert Fuhr, Nicola Ferro

TL;DR

The paper tackles the lack of reusable, well-documented IIR resources by introducing a comprehensive open dataset of 61 participants (122 sessions) augmented with perceptual speed and topic-interest profiles, plus a fully documented, adaptable loggable search platform (lisp). It combines data, study design, and infrastructure to attain high reuse and enables robust analysis and simulator validation in IIR. A proof-of-concept analysis demonstrates how perceptual speed and interest can influence search behavior at both coarse and fine-grained levels, underscoring the dataset’s potential for modeling personalized and context-aware search. The work provides a practical, open, and extensible resource that supports reproducible research, benchmarking, and development of user-centric or simulator-based IR approaches.

Abstract

We present a reusable dataset and accompanying infrastructure for studying human search behavior in Interactive Information Retrieval (IIR). The dataset combines detailed interaction logs from 61 participants (122 sessions) with user characteristics, including perceptual speed, topic-specific interest, search expertise, and demographic information. To facilitate reproducibility and reuse, we provide a fully documented study setup, a web-based perceptual speed test, and a framework for conducting similar user studies. Our work allows researchers to investigate individual and contextual factors affecting search behavior, and to develop or validate user simulators that account for such variability. We illustrate the datasets potential through an illustrative analysis and release all resources as open-access, supporting reproducible research and resource sharing in the IIR community.

LISP -- A Rich Interaction Dataset and Loggable Interactive Search Platform

TL;DR

The paper tackles the lack of reusable, well-documented IIR resources by introducing a comprehensive open dataset of 61 participants (122 sessions) augmented with perceptual speed and topic-interest profiles, plus a fully documented, adaptable loggable search platform (lisp). It combines data, study design, and infrastructure to attain high reuse and enables robust analysis and simulator validation in IIR. A proof-of-concept analysis demonstrates how perceptual speed and interest can influence search behavior at both coarse and fine-grained levels, underscoring the dataset’s potential for modeling personalized and context-aware search. The work provides a practical, open, and extensible resource that supports reproducible research, benchmarking, and development of user-centric or simulator-based IR approaches.

Abstract

We present a reusable dataset and accompanying infrastructure for studying human search behavior in Interactive Information Retrieval (IIR). The dataset combines detailed interaction logs from 61 participants (122 sessions) with user characteristics, including perceptual speed, topic-specific interest, search expertise, and demographic information. To facilitate reproducibility and reuse, we provide a fully documented study setup, a web-based perceptual speed test, and a framework for conducting similar user studies. Our work allows researchers to investigate individual and contextual factors affecting search behavior, and to develop or validate user simulators that account for such variability. We illustrate the datasets potential through an illustrative analysis and release all resources as open-access, supporting reproducible research and resource sharing in the IIR community.
Paper Structure (28 sections, 3 figures, 2 tables)

This paper contains 28 sections, 3 figures, 2 tables.

Table of Contents

  1. Motivation
  2. Related Work
  3. Resource Design and Development
  4. Dataset and System
  5. Data Collection
  6. Participant Recruitment
  7. Questionnaires
  8. Perceptual Speed Test
  9. Study Procedure
  10. Resource Description
  11. Interaction Log Dataset
  12. lisp - A Loggable Interactive Search Platform
  13. User Profile Data
  14. Influence of Perceptual Speed and Interest on Search Behaviors
  15. Outcome Measures
  16. ...and 13 more sections

Figures (3)

  • Figure 1: Screenshot of the search interface of lisp
  • Figure 2: Demographic and experience profile of the user sample (N = 61). Answer options that were not selected are not displayed.
  • Figure 4: Markov model of user interactions. Transitions from states marked with * to REVIEW and from REVIEW back to those states were omitted for clarity. Transition probabilities indicated at the arrows and mean interaction times per state are averaged across all sessions. As MARK and PAGE have no actual duration, they are assigned a nominal value of 1 second for completeness.