LitPivot: Developing Well-Situated Research Ideas Through Dynamic Contextualization and Critique within the Literature Landscape

Abstract

Developing a novel research idea is hard. It must be distinct enough from prior work to claim a contribution while also building on it. This requires iteratively reviewing literature and refining an idea based on what a researcher reads; yet when an idea changes, the literature that matters often changes with it. Most tools offer limited support for this interplay: literature tools help researchers understand a fixed body of work, while ideation tools evaluate ideas against a static, pre-curated set of papers. We introduce literature-initiated pivots, a mechanism where engagement with literature prompts revision to a developing idea, and where that revision changes which literature is relevant. We operationalize this in LitPivot, where researchers concurrently draft and vet an idea. LitPivot dynamically retrieves clusters of papers relevant to a selected part of the idea and proposes literature-informed critiques for how to revise it. A lab study ($n{=}17$) shows researchers produced higher-rated ideas with stronger self-reported understanding of the literature space; an open-ended study ($n{=}5$) reveals how researchers use LitPivot to iteratively evolve their own ideas.

Figures (6)

• Figure 1: The LitPivot interface. The left pane is a document editor with a toolbar toggle to highlight facets. The right pane is a paper panel that surfaces literature clusters. The interface colors text by idea facet: problem (purple), contribution (green), and evaluation (orange; currently missing). Clusters most relevant to the selected facet (here, the contribution statement) are starred. After selecting papers, the researcher can generate an assessment to compare the idea against selected work.
• Figure 2: LitPivot pipeline for literature retrieval and faceted paper clustering. (1) The researcher’s idea is used to retrieve an initial set of relevant papers via Asta PaperFinder. (2) GPT-4o extracts idea-relevant facets from each paper. (3) Sonnet-4 clusters the literature by facet, surfacing groups of papers most relevant to each part of the idea. (4) The system extracts papers that are meaningfully cited within the extracted facets and includes this in the literature set.
• Figure 3: Self-reported change in idea quality Distribution of change in Likert scores (post task - pre task) for perceived idea novelty, feasibility, and utility across conditions. Horizontal bars indicate median and quartile values; the red dashed line marks no change.
• Figure 4: When a change to one idea facet might require editing another idea facet, LitPivot highlights the corresponding affected idea facet in the text editor. Here, the problem statement facet is outlined.
• Figure 5: Baseline interface. The left pane contains is an idea editor where researchers can write out their research idea. The right pane shows a list of retrieved papers. At the bottom, a chat box allows researchers to ask questions about their idea or the listed literature.