LiteLLM - An open-source library to simplify LLM completion + embedding calls.
Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.]
Posted in Recipe on March 21, 2024 by Venkatesh S ‐ 4 min read
Call all LLM APIs using the OpenAI format [Bedrock, Huggingface, VertexAI, TogetherAI, Azure, OpenAI, etc.]
Posted in Recipe on March 21, 2024 by Venkatesh S ‐ 4 min read
Are you a developer looking for an open-source low-code tool to build customized LLM orchestration flow and AI agents effortlessly? Open source low-code tool for developers to build customized LLM orchestration flow & AI agents.
Posted in Recipe on February 26, 2024 by Venkatesh S ‐ 4 min read
In today's fast-paced world, technology is constantly evolving and pushing the boundaries of what is possible. One such technological advancement is the ability to run LLMs (Large Language Models) on your laptop, entirely offline. With the rise of AI and machine learning, the need for powerful language models has never been greater. LMStudio is a cutting-edge platform that allows users to discover, download, and run local LLMs with ease.
Posted in Recipe on January 22, 2024 by Venkatesh S ‐ 3 min read
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs..
Posted in Recipe on December 25, 2023 by Venkatesh S ‐ 4 min read
Are you looking to deploy local LLMs? In this article, we will guide you through the process of setting up Ollama and bringing up Mistral and LLama2 models. By following these steps, you will be able to harness the power of large language models right on your local machine.
Posted in Recipe on December 24, 2023 by Venkatesh S ‐ 2 min read
Using a pre trained text summarization model (bart-large-cnn) and hugging face pipelines, the fine-tuned model can be used to summarize the text sequences.
Posted in Recipe on May 24, 2023 by Venkatesh S ‐ 4 min read
Using a pre trained language model (M2M100 1.2B) with hugging face for machine translation(MT), the fine-tuned model can be used to translate the text sequences.
Posted in Recipe on May 23, 2023 by Venkatesh S ‐ 2 min read
StarCoder and StarCoderBase are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub.
Posted in Recipe on May 5, 2023 by Venkatesh S ‐ 2 min read
Teller is a productivity secret manager for developers. It supports managing secrets in cloud-native apps by pulling secrets that you have saved on multiple cloud providers and setting them in command line. It's quick, easy, and safe.
Posted in Recipe on April 18, 2023 by Venkatesh S ‐ 3 min read
Generate written & visual content in seconds through cutting-edge artificial intelligence. Make magical content.
Posted in Recipe on April 8, 2023 by Venkatesh S ‐ 8 min read