Codestral vs Claude Haiku 4.5, best Model for IDE Autocomplete

CodestralClaude Haiku 4.5
arenaElo12541274
humanEval89.778.2
sweBench3540.6
mmlu73.281.5
gpqa4148
aime3060
Price in/out ($/M)$0.3 / $0.9$1 / $5

Our verdict

Codestral is purpose-built for coding and edges Haiku 4.5 on HumanEval (89.7 vs 78.2) at similar cost. Haiku 4.5 is the better all-rounder when you also need chat, summarization or agent steps. For pure IDE autocomplete, pick Codestral; for a versatile assistant, Haiku.

Codestral · Claude Haiku 4.5 · All AI model comparisons