arXiv Research Unveils In-Context Learning Mechanisms: From Copying to Compositional Behavior in Language Models

Summary:A new arXiv study investigates the mechanisms of in-context learning (ICL) in language models, revealing that ICL is not a monolithic capability but rather a complex behavior encompassing copying, integration, and rule-following. Across 17 models, the research identifies that models begin prioritizing task-relevant prompt tokens early in training and exhibit stronger compositional abilities when trained on synthetic documents. In contrast, fine-tuning on rewritten real documents improves accurac

---

Background and Motivation

In the field of natural language processing, in-context learning (ICL) allows language models to adapt their behavior based on instructions and examples in a prompt. However, the mechanisms by which contextual information influences model predictions remain unclear. This study aims to delve into the acquisition and trainability of ICL.

Key Findings

1. Behavioral Separation and Diagnostic Testing: The study introduces a diagnostic test that separates the behavior of copying a nearby example from integrating information across the prompt. The results show that about one-third of the models prefer to copy the answer, while the rest tend to follow rules and generate consistent answers, indicating that ICL is not a monolithic capability.

2. Training Trajectory Analysis: Through checkpoint analysis, the study finds that models begin prioritizing task-relevant prompt tokens before their accuracy improves beyond chance level. This suggests that models start learning to effectively utilize contextual information early in training.

3. Impact of Training Methods: In matched training experiments, training on synthetic documents that define endings and then query them shifts models toward compositional responses, while fine-tuning on definition exercises built from rewritten real documents improves accuracy in tasks where prompt label meanings are reassigned. This indicates that different training methods can guide models toward different behavioral trajectories.

Engineering Trade-offs and Practical Applications

• Training Efficiency and Data Requirements: While synthetic document training is effective, it requires large amounts of high-quality data. In contrast, training on rewritten real documents has lower data quality requirements but may introduce bias.
• Model Robustness: Models that prioritize task-relevant information perform more stably when faced with adversarial examples but may overlook some subtle but important contextual information.

Developer Recommendations

1. Training Data Design: It is recommended to combine synthetic and real documents for training to balance compositional ability and accuracy.
2. Prompt Engineering: When designing prompts, task-relevant and conflicting information should be clearly distinguished to enhance the model's sensitivity to key information.
3. Diverse Evaluation Metrics: In addition to accuracy, attention should be paid to the model's ability to integrate contextual information to comprehensively evaluate ICL performance.

Future Research Directions

Future research can further explore the long-term impact of different training methods on ICL and how to design more effective diagnostic tests to comprehensively assess ICL capabilities.

---

Source: ArXiv NLP/LLM (cs.CL) (2026-10-15)

— END —

Tags: #In-Context Learning Follow #Language Models Follow #Training Methods Follow #arXiv Follow #NLP Follow