How Does Cognitive Capability and Personality Influence Problem-Solving in Coding Interview Puzzles?
Dulaji Hidellaarachchi, Sebastian Baltes, John Grundy
TL;DR
The paper investigates how cognitive capability and personality jointly influence software problem-solving in coding interview-style tasks across 40 practitioners and 40 SE students. It employs IPIP-NEO-50 for personality and Baddeley’s Grammatical Reasoning Test for cognitive capability, plus nine applied questions (six coding, three logical). Conscientiousness and openness to experience emerge as the strongest positive correlates with both reasoning accuracy and overall problem-solving performance, while neuroticism shows a mild negative association. The findings suggest educational and industry practices that integrate structured reasoning tasks and account for personality-cognition profiles in recruitment and role allocation, while acknowledging limitations and outlining directions for longitudinal, diverse replications.
Abstract
Software engineering is a deeply cognitive activity shaped by individual differences that extend beyond technical skill. This study investigates how cognitive capability and personality traits jointly relate to software problem solving among 80 participants (40 software practitioners, 40 software engineering students). Cognitive capability was measured using Baddeleys three minute grammatical reasoning test, while personality was assessed using the IPIP NEO 50 test. Participants further completed nine interview style problem solving questions. Six questions were related to coding and three were related to logical reasoning. Descriptive and correlational analyses show that practitioners achieved slightly higher grammatical reasoning accuracy and overall task performance than students. Grammatical-reasoning accuracy correlated positively with problem solving performance, indicating that stronger cognitive capability is associated with better performance in coding and logical tasks. Personality performance links were systematic. We identified that the conscientiousness trait correlated most strongly with problem solving and with reasoning accuracy, while the openness to experience trait was positively related to both outcomes. Neuroticism showed small, negative associations with accuracy and performance. Taken together, our results suggest that conscientiousness and openness to experience characteristics complement reasoning accuracy to support software problem solving, whereas elevated negative affect may hinder precision under time pressure. Our findings suggest practical implications for education and industry such as integrating structured reasoning tasks in curricula, and considering personality cognition in recruitment and role allocation. We highlight directions for future research such as longitudinal and task diverse replications with larger samples.