Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference

Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.

Efficient Agent Router (EAR) is a Python-first orchestration service that selects and executes the best LLM for a request based on quality, cost, latency, context window, and safety constraints.