Open-source Generative AI
A comprehensive list of >60 repositories every AI builder should know.
Welcome to Deep Dives - a new section of AI Tidbits providing editorial takes and insights to make sense of the latest in AI. Let’s go!
“What do you mean there is an open-source library for that? We built the entire thing ourselves” is a quote I often hear from builders in the LLM space. I’ve been building with LLMs for the last year and turned my personal list of >60 useful packages into a public table so others won’t experience the same frustration.
Each one of these packages will save you hours and enable use cases you were interested in building yet didn't have the technical chops to do so.
Highlighted packages (link to full list below)
LlamaIndex - a framework to augment LLM applications with private data
GPT Engineer - let AI code full apps for you
ResearchGPT - an LLM-based research assistant that allows you to have a conversation with a research paper
Autodoc - a toolkit for auto-generating codebase documentation using LLMs
web-llm - run LLMs in web browsers without the need for a backend server
Text generation web UI - web UI for running LLMs like Llama 2, llama.cpp, and Vicuna
AnythingLLM - turn any document into an intelligent chatbot
Vocode - build voice-based LLM agents
EasyLM - a one-stop solution for pre-training, finetuning, evaluating, and serving LLMs in JAX/Flax.
Motorhead - a memory and information retrieval server for LLMs
Full table with >60 packages (I keep it up to date):
Keep reading with a 7-day free trial
Subscribe to AI Tidbits to keep reading this post and get 7 days of free access to the full post archives.