Skip to content

Model Comparison

🤖 AI Drafted (Not reviewed)

Compare responses from multiple LLM models

Tool id model_comparison
Category llm
Uses a language model yes
Needs a generative model no
Runs over many items no
Item handling batch
Structured output no
Human-verified not yet

What it reads

Port Type Required What it is
Prompt (prompt) text yes Prompt to send to all models
System Prompt (system_prompt) text no Optional system prompt

What it emits

Port Type Required What it is
Results (results) json — Comparison results from all models
Fastest Response (fastest) text — Response from fastest model
Cheapest Response (cheapest) text — Response from cheapest model
Summary (summary) json — Summary statistics

Options

Option Type Default What it does
models array [] Models to compare. Empty = the workflow’s own default provider/model (tier aliases like $medium resolve through AI Defaults, #4325).
timeout_seconds integer 60 Timeout per model in seconds.

The prompt it sends

This tool does not send a prompt — it does its work in code.