Open-source Generative AI

A comprehensive list of >60 repositories every AI builder should know.

Welcome to Deep Dives - a new section of AI Tidbits providing editorial takes and insights to make sense of the latest in AI. Let’s go!

---

“What do you mean there is an open-source library for that? We built the entire thing ourselves” is a quote I often hear from builders in the LLM space. I’ve been building with LLMs for the last year and turned my personal list of >60 useful packages into a public table so others won’t experience the same frustration.

Each one of these packages will save you hours and enable use cases you were interested in building yet didn't have the technical chops to do so.

Highlighted packages (link to full list below)

1. LlamaIndex - a framework to augment LLM applications with private data

2. GPT Engineer - let AI code full apps for you

3. ResearchGPT - an LLM-based research assistant that allows you to have a conversation with a research paper

4. Autodoc - a toolkit for auto-generating codebase documentation using LLMs

5. web-llm - run LLMs in web browsers without the need for a backend server

6. Text generation web UI - web UI for running LLMs like Llama 2, llama.cpp, and Vicuna

7. AnythingLLM - turn any document into an intelligent chatbot

8. Vocode - build voice-based LLM agents

9. EasyLM - a one-stop solution for pre-training, finetuning, evaluating, and serving LLMs in JAX/Flax.

10. Motorhead - a memory and information retrieval server for LLMs

Full table with >60 packages (I keep it up to date):