All-in-one AI CLI tool that integrates 20+ AI platforms, including OpenAI, Azure-OpenAI, Gemini, Claude, Mistral, Cohere, VertexAI, Bedrock, Ollama, Ernie, Qianwen, Deepseek...

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

🤘 TT-NN operator library, and TT-Metalium low level kernel programming model.

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

Unify Efficient Fine-Tuning of 100+ LLMs

Chat locally using leading open models built by the community, optimized and accelerated by NVIDIA's enterprise-ready inference runtime

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

On-device LLM Inference Powered by X-Bit Quantization

Generative AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. It features AI personas, AGI functions, multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen

A NodeJS RAG framework to easily work with LLMs and embeddings

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

Using Langchain, HuggingFace et Mistral to create a RAG that is able to analyse PDF from the Enedis documentation website, and answer question about it. Ongoing project

Telegram Bot library for CloudFlare Workers

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

🤯 Lobe Chat - an open-source, modern-design ChatGPT/LLMs UI/Chat Framework. Supports speech-synthesis, multi-modal, and extensible plugin system. One-click FREE deployment of your private ChatGPT/Gemini/Ollama chat application.

Raycast extension to use GPT-4, Llama-3, and more... all for FREE. No API Key required!

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.