LiteLLM - An open-source library to simplify LLM completion + embedding calls.
Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.]
Posted in Recipe on March 21, 2024 by Venkatesh S ‐ 4 min read
LLM
FlowiseAI - Build LLM Apps Easily
Are you a developer looking for an open-source low-code tool to build customized LLM orchestration flow and AI agents effortlessly? Open source low-code tool for developers to build customized LLM orchestration flow & AI agents.
Posted in Recipe on February 26, 2024 by Venkatesh S ‐ 4 min read
LMStudio - Discover, Download, and Run Local LLMs
In today's fast-paced world, technology is constantly evolving and pushing the boundaries of what is possible. One such technological advancement is the ability to run LLMs (Large Language Models) on your laptop, entirely offline. With the rise of AI and machine learning, the need for powerful language models has never been greater. LMStudio is a cutting-edge platform that allows users to discover, download, and run local LLMs with ease.
Posted in Recipe on January 22, 2024 by Venkatesh S ‐ 3 min read
ChatGPT like Interface with Open WebUI and Ollama
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs..
Posted in Recipe on December 25, 2023 by Venkatesh S ‐ 4 min read
Ollama : Get up and running with Large Language Models locally
Are you looking to deploy local LLMs? In this article, we will guide you through the process of setting up Ollama and bringing up Mistral and LLama2 models. By following these steps, you will be able to harness the power of large language models right on your local machine.
Posted in Recipe on December 24, 2023 by Venkatesh S ‐ 2 min read