BaseRT
6.4x faster than llama.cpp, 3.9x faster than MLX
Gallery
About
BaseRT is the fastest LLM runtime on Apple Silicon. Install it with one command and run local models on your own device.
Discussion (0)
Log in to join the discussion
No comments yet. Be the first to share your thoughts!
