Glide
Docs
What's Glide?
Welcome to Glide

🐦 What is Glide?

Glide is a cloud-native open-source (opens in a new tab) LLM gateway, delivering high-performance LLMOps in one single binary.

The idea of Glide is to take away common functionality needed during communication with LLMs and building GenAI applications on a level of a separate service. That way you don't have to put that pile of logic into your applications and just seamlessly utilize it via Glide. So you can focus on building your core business logic and solve common concerns via configuring Glide.

The Glide's Architecture

Glide is currently under active development. Feel free to give us a star and watch in Github (opens in a new tab) not to miss any updates.

Why Glide?

The True Gateway

Focus on your business logic and application while letting Glide handle common LLMOps problems (like fallbacks, cost control, routing, caching, etc.)

Blazing-Fast & Cloud-Native

High performance and scalability are our priority, so Glide won't slow you down and scale out as you grow.

Resilient

Glide is designed around resiliency and failures, so your application can achieve high availability working with external models and survive the toughest real-world situations.

Configurable

A Glide cluster can serve multiple applications with totally different needs.

Unified LLM API

Switch your model providers seamlessly without a need to modify your applications.

Open Source

We welcome all kinds of feedback and contributions in Glide. Let's make it work in the best possible way for you!

Features

Installation

License

Glide is provided under Apache 2.0 (opens in a new tab) open source license.

Developed with ❀️ by Roma (opens in a new tab), Max (opens in a new tab), and the rest of the EinStack Community (opens in a new tab).