Comparing Arabic LLMs: How to Evaluate Falcon, ALLaM, Jais and Fanar Fairly
No leaderboard can pick your Arabic language model. Compare exact checkpoints from Falcon, ALLaM, Jais and Fanar on your own tasks and dialects, under comparable conditions, and weigh license and hosting separately.