Contrastive-LM Releases CLM: An Open-Source Alternative to Jev for Agent Decision-Making

Summary:Contrastive-LM has released CLM, an open-source alternative to TypeSafe AI's Jev. CLM matches Jev's functionality, supporting its core decision primitives (Choice, Noul, Score) while offering significant latency improvements and caching optimizations through its decoupled state and action heads. CLM also allows user fine-tuning, making it adaptable to diverse tasks. Although it lags behind Jev in zero-shot generalization and context handling, CLM's open-source nature and performance advantages p

---

1. Core Features and Characteristics

The Contrastive-LM team has introduced CLM, a new model designed as an open-source alternative to TypeSafe AI's Jev. CLM matches Jev's functionality, supporting its core decision interfaces, including:

• Choice: Evaluates a discrete set of candidates and returns a categorical probability distribution.
• Noul: Outputs a calibrated true/false probability for a proposition or guardrail check.
• Score: Scores an input against an ordered rubric or scale.

CLM's API and functional interface are fully compatible with Jev, allowing existing Jev client code to migrate seamlessly to CLM.

2. Advantages of CLM

• Low Latency and Decoupled Caching: Jev is a proprietary cloud model that jointly evaluates state and decision options, while CLM decouples the state head from the action head. If an agent has a persistent set of tools or actions, CLM embeds these actions once and caches them. In benchmarks like interactive browser agents and gaming (T-Rex, Super Mario), CLM is 4 to 13 times faster than Jev.

• Open Weights and Fine-Tunability: Jev is a closed API with no user fine-tuning, whereas CLM's heads are lightweight open weights (~75 MB), allowing users to fine-tune based on their own agent trajectories.

• Coding Benchmark Verifiers: After fine-tuning, CLM achieves state-of-the-art verifier performance on Terminal-Bench 2.1 (87.6%) and DeepSWE (81.6%), while zero-shot Jev struggled on these benchmarks (DeepSWE score ~71%).

3. Jev's Continuing Advantages (CLM-8B Limitations)

Although CLM covers the entire feature surface of Jev, the current CLM-v0.1-8B release lags behind Jev in the following areas:

• Zero-Shot Broad Knowledge: Jev is backed by a larger, proprietary model. In zero-shot open-domain tasks, Jev still holds an edge in edge-case accuracy (e.g., Berkeley Function Calling Leaderboard v4: Jev scored 99.2% vs. CLM-8B's 95.2%; WikiRacing: Jev 30/30 vs. CLM-8B 26/30).

• Context Budget: Jev accepts requests up to a 64K token context out-of-the-box. CLM-8B was tested and calibrated at 2K to 8K context. While its Qwen3 backbone can accept longer prompts, representations past 8K haven't been calibrated for the reference head.

• Probability Normalization: CLM calculates probabilities via dot products and softmax over the candidates passed in that request. Its probabilities are inherently relative to the candidate set provided, whereas Jev's scoring is calibrated internally against absolute criteria.

4. Summary

If you're wondering whether you'll lose API features by using CLM instead of Jev, the answer is no. You get the full primitive set (Choice, Noul, Score) with massive latency gains and zero API costs. You only sacrifice some zero-shot generalization on niche out-of-domain tasks compared to TypeSafe's hosted service.

---

Source: Reddit r/LocalLLaMA (2026-09-24)

— END —

Tags: #Contrastive-LM #CLM #Open-Source Model #Agent Decision-Making #Low Latency