Elixir

<div align="center" style="display: flex; flex-wrap: wrap; gap: 8px; justify-content: center; margin: 20px 0"

<a href="https://github.com/kreuzberg-dev/alef">

<img src="https://img.shields.io/badge/Bindings-alef%20%D7%90-007ec6" alt="Bindings" />

<a href="https://crates.io/crates/liter-llm">

<img src="https://img.shields.io/crates/v/liter-llm?label=Rust&color=007ec6" alt="Rust" />

<a href="https://pypi.org/project/liter-llm/">

<img src="https://img.shields.io/pypi/v/liter-llm?label=Python&color=007ec6" alt="Python" />

<a href="https://www.npmjs.com/package/@kreuzberg/liter-llm">

<img
  src="https://img.shields.io/npm/v/@kreuzberg/liter-llm?label=Node.js&color=007ec6"
  alt="Node.js"
/>

<a href="https://www.npmjs.com/package/@kreuzberg/liter-llm-wasm">

<img
  src="https://img.shields.io/npm/v/@kreuzberg/liter-llm-wasm?label=WASM&color=007ec6"
  alt="WASM"
/>

<a href="https://central.sonatype.com/artifact/dev.kreuzberg/liter-llm">

<img
  src="https://img.shields.io/maven-central/v/dev.kreuzberg/liter-llm?label=Java&color=007ec6"
  alt="Java"
/>

<a href="https://github.com/kreuzberg-dev/liter-llm/tree/main/packages/go">

<img
  src="https://img.shields.io/github/v/tag/kreuzberg-dev/liter-llm?label=Go&color=007ec6"
  alt="Go"
/>

<a href="https://www.nuget.org/packages/LiterLlm">

<img src="https://img.shields.io/nuget/v/LiterLlm?label=C%23&color=007ec6" alt="C#" />

<a href="https://packagist.org/packages/kreuzberg/liter-llm">

<img
  src="https://img.shields.io/packagist/v/kreuzberg/liter-llm?label=PHP&color=007ec6"
  alt="PHP"
/>

<a href="https://rubygems.org/gems/liter_llm">

<img src="https://img.shields.io/gem/v/liter_llm?label=Ruby&color=007ec6" alt="Ruby" />

<a href="https://hex.pm/packages/liter_llm">

<img src="https://img.shields.io/hexpm/v/liter_llm?label=Elixir&color=007ec6" alt="Elixir" />

<a href="https://github.com/kreuzberg-dev/liter-llm/pkgs/container/liter-llm">

<img
  src="https://img.shields.io/badge/Docker-007ec6?logo=docker&logoColor=white"
  alt="Docker"
/>

<a href="https://github.com/kreuzberg-dev/homebrew-tap/blob/main/Formula/liter-llm.rb">

<img
  src="https://img.shields.io/badge/Homebrew-007ec6?logo=homebrew&logoColor=white"
  alt="Homebrew"
/>

<a href="https://github.com/kreuzberg-dev/liter-llm/tree/main/crates/liter-llm-ffi">

<img src="https://img.shields.io/badge/C-FFI-007ec6" alt="C FFI" />

<a href="https://github.com/kreuzberg-dev/liter-llm/blob/main/LICENSE">

<img src="https://img.shields.io/badge/License-MIT-007ec6" alt="License" />

<a href="https://docs.liter-llm.kreuzberg.dev">

<img src="https://img.shields.io/badge/Docs-liter--llm-007ec6" alt="Docs" />

kreuzberg.dev

<div align="center" style="display: flex; flex-wrap: wrap; gap: 12px; justify-content: center; margin: 28px 0 24px"

<a href="https://discord.gg/xt9WY3GnKR"> 

<img
  height="22"
  src="https://img.shields.io/badge/Discord-Chat-007ec6?logo=discord&logoColor=white"
  alt="Join Discord"
/>

Universal LLM API client for Elixir. Access 143+ LLM providers through a single interface with native BEAM concurrency, OTP integration, and idiomatic Elixir API.

What This Package Provides

Installation

Package Installation

Add to your mix.exs dependencies:

def deps do
  [
    {:liter_llm, "~> 1.4.0-rc.34"}
  ]
end

Then run:

mix deps.get

System Requirements

Quick Start

Basic Chat

Send a message to any provider using the provider/model prefix:

{:ok, client} = LiterLlm.create_client(System.get_env("OPENAI_API_KEY"))

request =
  Jason.encode!(%{
    model: "openai/gpt-4o-mini",
    messages: [%{role: "user", content: "Hello!"}]
  })

{:ok, result} = LiterLlm.defaultclient_chat_async(client, request)
IO.puts(Enum.at(result.choices, 0).message.content)

Common Use Cases

Streaming Responses

Stream tokens in real time:

{:ok, client} = LiterLlm.create_client(System.get_env("OPENAI_API_KEY"))

request =
  Jason.encode!(%{
    model: "openai/gpt-4o-mini",
    messages: [%{role: "user", content: "Count from 1 to 5."}],
    stream: true
  })

{:ok, stream} = LiterLlm.defaultclient_chat_stream(client, request)

Enum.each(stream, fn chunk ->
  content = get_in(chunk, [:choices, Access.at(0), :delta, :content])
  if content, do: IO.write(content)
end)

IO.puts("")

Next Steps

Features

Supported Providers (143+)

Route to any provider using the provider/model prefix convention:

Provider Example Model
OpenAIopenai/gpt-4o, openai/gpt-4o-mini
Anthropicanthropic/claude-3-5-sonnet-20241022
Groqgroq/llama-3.1-70b-versatile
Mistralmistral/mistral-large-latest
Coherecohere/command-r-plus
Together AItogether/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo
Fireworksfireworks/accounts/fireworks/models/llama-v3p1-70b-instruct
Google Vertexvertexai/gemini-1.5-pro
Amazon Bedrockbedrock/anthropic.claude-3-5-sonnet-20241022-v2:0

Complete Provider List

Key Capabilities

Performance

Built on a compiled Rust core for speed and safety:

Provider Routing

Route to 143+ providers using the provider/model prefix convention:

openai/gpt-4o
anthropic/claude-3-5-sonnet-20241022
groq/llama-3.1-70b-versatile
mistral/mistral-large-latest

See the provider registry for the full list.

Proxy Server

liter-llm also ships as an OpenAI-compatible proxy server with Docker support:

docker run -p 4000:4000 -e LITER_LLM_MASTER_KEY=sk-your-key ghcr.io/kreuzberg-dev/liter-llm

See the proxy server documentation for configuration, CLI usage, and MCP integration.

Documentation

Part of Kreuzberg.dev

Contributing

Contributions are welcome! See CONTRIBUTING.md for guidelines.

Join our Discord community for questions and discussion.

License

MIT -- see LICENSE for details.