ArXiv Proposes New Human-Centered XAI Framework Based on Information-Seeking Psychology

Summary:ArXiv has published a position paper arguing that Human-Centered Explainable AI (HCXAI) should incorporate insights from the psychology of information seeking. The study identifies three types of expected utility—instrumental, hedonic, and cognitive—that influence whether users engage with AI explanations. These utilities are shaped by cognitive biases such as the illusion of control, automation bias, and unrealistic optimism, which can lead to excessive or insufficient information-seeking. The

---

Key Research Highlights

ArXiv has published a position paper that proposes integrating insights from the psychology of information seeking into Human-Centered Explainable AI (HCXAI) to enhance user engagement and the effectiveness of AI explanations. The key points of the research are as follows:

1. Incorporating Information-Seeking Psychology

   • The study draws on Sharot and Sunstein's framework of information-seeking motives and identifies three types of expected utility that influence whether users engage with AI explanations:
     • Instrumental Utility: Whether the explanation helps users act better.
     • Hedonic Utility: Whether the explanation makes users feel better.
     • Cognitive Utility: Whether the explanation improves users' understanding.

2. Impact of Cognitive Biases

   • Users' evaluations of these utilities are shaped by well-documented cognitive biases, such as the illusion of control, automation bias, unrealistic optimism, impact bias, overconfidence, and confirmation bias. These biases can lead to two failure modes:
     • Excessive Information-Seeking: Users seek too much information, leading to fragmented attention and impaired decision-making.
     • Insufficient Information-Seeking: Users do not seek enough information, leaving critical risks and misunderstandings unexamined.

3. Challenges for Agentic AI Systems

   • For agentic AI systems, explanations must support not just understanding a single output but also anticipating cascading actions, assessing risks, and deciding when to intervene. This makes the design of effective explanations even more challenging.

4. Recommendations and Future Directions

   • The paper advocates for a shift from making explanations available to making them sought, by designing systems that account for when and why users actually want to know. This requires a deep understanding of user information needs and cognitive biases, as well as the development of appropriate interaction mechanisms.

Technical Highlights and Industry Impact

• Innovativeness: This is the first systematic integration of information-seeking psychology into the HCXAI field, providing a new theoretical framework for XAI design.
• Practicality: The proposed framework helps developers better understand user expectations for AI explanations, leading to more effective explanation mechanisms.
• Impact on Agentic AI: In agentic AI systems, the effectiveness of explanations is directly related to user trust and acceptance, making this research highly relevant to the development of agentic AI.

Developer Recommendations

1. Focus on User Needs: Prioritize user information needs and cognitive biases when designing AI explanations, rather than simply aiming for comprehensiveness.
2. Dynamically Adjust Explanation Strategies: Adjust the content and form of explanations based on user feedback and behavior to enhance engagement.
3. Combine with Psychological Research: Conduct in-depth research on user information-seeking behavior and cognitive biases and integrate them into XAI system design.

Conclusion

This research provides a new perspective on human-centered XAI design, emphasizing the importance of understanding user information-seeking psychology and proposing corresponding design recommendations. This will help improve the effectiveness and user acceptance of AI explanations, driving further development in the XAI field.

---

Source: ArXiv AI (cs.AI) (2026-08-31)

— END —

Tags: #Human-Computer Interaction #XAI #Information-Seeking Psychology #Cognitive Biases #Agentic AI