Skip to main content
ZICQ

Agents & Tool Calling

ZICQ LLM rankings update daily across intelligence, coding, price, and context for selection and comparison.

Last updated: 25 min ago (2026-11-18 10:41)
Clear
Sources and methodology

Ranked by OpenRouter benchmarks.agentic_index (agent / tool-calling index) plus the supported_parameters.tools flag — a reference for agent framework builders.

📊 Evaluation Benchmarks & Methodology
1. Source:Model metadata and pricing are synced hourly from OpenRouter (openrouter.ai), covering commercial, open-weight, and preview/experimental versions.
2. Benchmarks:Intelligence, coding, and agentic indices are sourced directly from Artificial Analysis (artificialanalysis.ai) official benchmark indices.
3. Overall Score Weights:Overall Score = 60% × Intelligence Index + 25% × Coding Index + 15% × Agentic Index. Models without benchmark data are ranked at the end.
4. Referral links:"Try it" buttons marked "Referral" are referral links; ZICQ may earn a commission. Referral relationships never affect rankings or scores.
Statistics for this selection
Models tracked 106
Free & tunable 0
Vision 95
Tool calling 103
Reasoning 84
Max context OpenAI: GPT-6 Astra 1.1M tokens
Average known input price $3.54 / 1M USD / 1M tokens
Cheapest model OpenAI: gpt-oss-20b $0.018 / 1M
TOP by Agentic OpenAI: GPT-6 Astra 51.0
⚡ Side-by-Side Model PK & Token Cost Calculator Click "+ Compare" on any model below to swap · Live monthly cost calculator · Shareable comparison URL
Metric OpenAI: GPT-6 Astra OpenAI OpenAI: GPT-6 Astra (batch) OpenAI OpenAI: GPT-5.6 Sol OpenAI
Intelligence / Coding / Agentic 56.9 / 76.9 / 51.0 56.9 / 76.9 / 51.0 0.0 / 78.3 / 47.4
Context Window 1.1M tokens 1.1M tokens 1.1M tokens
Input / Output Price (1M) $10.00 / $50.00 $5.00 / $25.00 $4.00 / $20.00
Est. Monthly Cost (30d) Adjust inputs to calculate Adjust inputs to calculate Adjust inputs to calculate
  1. #379
    OpenAI: GPT-5 (batch) OpenAI Doc & Vision Benchmarked

    GPT-5 is OpenAI’s most advanced model, offering major improvements in reasoning, code quality, and user experience. It is optimized for complex tasks that require step-by-step reasoning, instruction following, and accuracy...

    Tools Vision Docs Reasoning Structured
    Intelligence 0.0
    Agentic 0.0
    Context 400K Output ≤ 128K
    $0.62/1M $5.00/1M out cache $0.06/1M
    Solid Tool Calling
  2. #380
    OpenAI: GPT-5 Nano OpenAI Doc & Vision

    GPT-5-Nano is the smallest and fastest variant in the GPT-5 system, optimized for developer tools, rapid interactions, and ultra-low latency environments. While limited in reasoning depth compared to its larger...

    Tools Vision Docs Reasoning Structured
    Context 400K Output ≤ 128K
    $0.05/1M $0.40/1M out cache $0.01/1M
    Solid Tool Calling
  3. #381
    OpenAI: GPT-5 Nano (batch) OpenAI Doc & Vision

    GPT-5-Nano is the smallest and fastest variant in the GPT-5 system, optimized for developer tools, rapid interactions, and ultra-low latency environments. While limited in reasoning depth compared to its larger...

    Tools Vision Docs Reasoning Structured
    Context 400K Output ≤ 128K
    $0.02/1M $0.20/1M out cache $0.00/1M
    Solid Tool Calling
  4. #401
    OpenAI: o3 Pro OpenAI Doc & Vision

    The o-series of models are trained with reinforcement learning to think before they answer and perform complex reasoning. The o3-pro model uses more compute to think harder and provide consistently...

    Tools Vision Docs Reasoning Structured
    Context 200K Output ≤ 100K
    $20.00/1M $80.00/1M out
    Solid Tool Calling
  5. #407
    OpenAI: o3 OpenAI Doc & Vision

    o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following....

    Tools Vision Docs Reasoning Structured
    Context 200K Output ≤ 100K
    $2.00/1M $8.00/1M out cache $0.50/1M
    Solid Tool Calling
  6. #408
    OpenAI: o3 (batch) OpenAI Doc & Vision

    o3 is a well-rounded and powerful model across domains. It sets a new standard for math, science, coding, and visual reasoning tasks. It also excels at technical writing and instruction-following....

    Tools Vision Docs Reasoning Structured
    Context 200K Output ≤ 100K
    $1.00/1M $4.00/1M out cache $0.25/1M
    Solid Tool Calling
  7. #409
    OpenAI: o4 Mini (batch) OpenAI Doc & Vision

    OpenAI o4-mini is a compact reasoning model in the o-series, optimized for fast, cost-efficient performance while retaining strong multimodal and agentic capabilities. It supports tool use and demonstrates competitive reasoning...

    Tools Vision Docs Reasoning Structured
    Context 200K Output ≤ 100K
    $0.55/1M $2.20/1M out cache $0.14/1M
    Solid Tool Calling
  8. #410
    OpenAI: GPT-4.1 OpenAI Doc & Vision

    GPT-4.1 is a flagship large language model optimized for advanced instruction following, real-world software engineering, and long-context reasoning. It supports a 1 million token context window and outperforms GPT-4o and...

    Tools Vision Docs Structured
    Context 1.0M Output ≤ 32K
    $2.00/1M $8.00/1M out cache $0.50/1M
    Solid Tool Calling
  9. #411
    OpenAI: GPT-4.1 (batch) OpenAI Doc & Vision

    GPT-4.1 is a flagship large language model optimized for advanced instruction following, real-world software engineering, and long-context reasoning. It supports a 1 million token context window and outperforms GPT-4o and...

    Tools Vision Docs Structured
    Context 1.0M Output ≤ 32K
    $1.00/1M $4.00/1M out cache $0.25/1M
    Solid Tool Calling
  10. #412
    OpenAI: GPT-4.1 Mini OpenAI Doc & Vision Benchmarked

    GPT-4.1 Mini is a mid-sized model delivering performance competitive with GPT-4o at substantially lower latency and cost. It retains a 1 million token context window and scores 45.1% on hard...

    Tools Vision Docs Structured
    Intelligence 0.0
    Agentic 0.0
    Context 1.0M Output ≤ 32K
    $0.40/1M $1.60/1M out cache $0.10/1M
    Solid Tool Calling
  11. #413
    OpenAI: GPT-4.1 Mini (batch) OpenAI Doc & Vision Benchmarked

    GPT-4.1 Mini is a mid-sized model delivering performance competitive with GPT-4o at substantially lower latency and cost. It retains a 1 million token context window and scores 45.1% on hard...

    Tools Vision Docs Structured
    Intelligence 0.0
    Agentic 0.0
    Context 1.0M Output ≤ 32K
    $0.20/1M $0.80/1M out cache $0.05/1M
    Solid Tool Calling
  12. #414
    OpenAI: GPT-4.1 Nano OpenAI Doc & Vision Benchmarked

    For tasks that demand low latency, GPT‑4.1 nano is the fastest and cheapest model in the GPT-4.1 series. It delivers exceptional performance at a small size with its 1 million...

    Tools Vision Docs Structured
    Intelligence 0.0
    Agentic 0.0
    Context 1.0M Output ≤ 942K
    $0.10/1M $0.40/1M out cache $0.03/1M
    Solid Tool Calling
  13. #415
    OpenAI: GPT-4.1 Nano (batch) OpenAI Doc & Vision Benchmarked

    For tasks that demand low latency, GPT‑4.1 nano is the fastest and cheapest model in the GPT-4.1 series. It delivers exceptional performance at a small size with its 1 million...

    Tools Vision Docs Structured
    Intelligence 0.0
    Agentic 0.0
    Context 1.0M Output ≤ 32K
    $0.05/1M $0.20/1M out cache $0.01/1M
    Solid Tool Calling
  14. #428
    OpenAI: o3 Mini (batch) OpenAI General LLM

    OpenAI o3-mini is a cost-efficient language model optimized for STEM reasoning tasks, particularly excelling in science, mathematics, and coding. This model supports the `reasoning_effort` parameter, which can be set to...

    Tools Docs Reasoning Structured
    Context 200K Output ≤ 100K
    $0.55/1M $2.20/1M out cache $0.28/1M
    Solid Tool Calling
  15. #438
    OpenAI: GPT-4o (2024-11-20) OpenAI Doc & Vision

    The 2024-11-20 version of GPT-4o offers a leveled-up creative writing ability with more natural, engaging, and tailored writing to improve relevance & readability. It’s also better at working with uploaded...

    Tools Vision Docs Structured Web search
    Context 128K Output ≤ 16K
    $2.50/1M $10.00/1M out cache $1.25/1M
    Solid Tool Calling
  16. #450
    OpenAI: GPT-4o (2024-08-06) OpenAI Doc & Vision

    The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.com/index/introducing-structured-outputs-in-the-api/). GPT-4o ("o" for "omni") is...

    Tools Vision Docs Structured Web search
    Context 128K Output ≤ 16K
    $2.50/1M $10.00/1M out cache $1.25/1M
    Solid Tool Calling
  17. #454
    OpenAI: GPT-4o-mini OpenAI Doc & Vision Benchmarked

    GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable...

    Tools Vision Docs Structured Web search
    Intelligence 0.0
    Agentic 0.0
    Context 128K Output ≤ 16K
    $0.15/1M $0.60/1M out cache $0.07/1M
    Solid Tool Calling
  18. #455
    OpenAI: GPT-4o-mini (2024-07-18) OpenAI Doc & Vision

    GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable...

    Tools Vision Docs Structured Web search
    Context 128K Output ≤ 16K
    $0.15/1M $0.60/1M out cache $0.07/1M
    Solid Tool Calling
  19. #456
    OpenAI: GPT-4o-mini (batch) OpenAI Doc & Vision Benchmarked

    GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable...

    Tools Vision Docs Structured Web search
    Intelligence 0.0
    Agentic 0.0
    Context 128K Output ≤ 16K
    $0.07/1M $0.30/1M out cache $0.04/1M
    Solid Tool Calling
  20. #458
    OpenAI: GPT-4o OpenAI Doc & Vision

    GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/openai/gpt-4-turbo) while being twice as...

    Tools Vision Docs Structured Web search
    Context 128K Output ≤ 16K
    $2.50/1M $10.00/1M out cache $1.25/1M
    Solid Tool Calling