LLM Router

Route requests between multiple models.

Loïc / azerothl
Category
AI and agents
Created by
Loïcazerothl
Platform
APIServeur personnel
Availability
Self-hosted
Project
Public source

About this app

LLM Router exposes an OpenAI-compatible endpoint and selects a model for each task. It can combine OpenRouter, OpenAI, Anthropic, Google and Ollama in fallback chains.

The code documents cost and latency tracking as well as temporary disabling of failing models. The project is published under the AkashaBot account, run by Loïc.

What you can do

  • Répartir les requêtes selon la tâche.
  • Configurer plusieurs fournisseurs et des replis.
  • Suivre les coûts et la latence.
  • Écarter temporairement un modèle en échec.