Rbitnet

A local inference engine written in Rust.

Loïc / azerothl
Category
AI and agents
Created by
Loïcazerothl
Platform
OrdinateurServeur local
Availability
Self-hosted
Project
Public source

About this app

Rbitnet provides a local inference engine written in Rust and an HTTP server compatible with the OpenAI API. It loads GGUF models according to the architectures supported in its documentation.

It notably serves as Akasha's local engine. The repository publishes releases and instructions for running it or integrating it with other tools.

What you can do

  • Exécuter les modèles GGUF pris en charge.
  • Exposer une API HTTP compatible avec OpenAI.
  • Utiliser un moteur local depuis Akasha.