Most popular and upcoming Generative AI tools and APIs

Hundreds of AI Tidbits researchers and builders share their tech stack so you can hit the ground running on your next AI project

Welcome to Deep Dives - a dedicated AI Tidbits section providing editorial takes and insights to make sense of the latest in AI.

---

This list will be periodically updated through our semi-annual AI Tidbits researchers and builders survey.

Last update: Dec 2023

AI powers every part of my personal and professional tasks.
~40% of my code is generated with the help of LLMs, and content writing takes 30% less time, thanks to GPT bulletproofing my text.

Nonetheless, the recent breakthroughs and progress created a Cambrian explosion of AI tools and APIs, which makes it impossible to keep up and, more importantly, distill temporary hype from actual use.

We therefore surveyed hundreds of AI Tidbits subscribers about the tools they use daily. Most responses came from AI researchers and builders (76%), followed by designers, PMs, and marketing managers. Here's what we found:

Introducing a new and exclusive program for AI Tidbits Premium members - receive credits for leading tools like Hugging Face, Perplexity, and Replicate

✨ AI Tidbits Community Discounts and Credits

Language models APIs and chatbots

• Perplexity - explore any topic with direct answers and citations and access language models without a knowledge cutoff point through an API

• OpenAI GPT - a suite of powerful language models offering a range of capabilities from natural language and visual understanding to content generation

• Anthropic Claude - a powerful language model with an extended context window of 200k tokens

Launch faster

• Replicate - a platform for deploying and serving machine learning models as scalable APIs

• Together AI - a cloud platform for building and running over 100 models, from Llama 2 to Mixstral and Stable Diffusion 2.1

• Modal - a serverless platform for inference, fine-tuning, async job queues, and more. Iterate and deploy Python code in seconds without configuring any infrastructure.

• Hugging Face Inference Endpoints and Spaces - cloud-hosted model inference APIs and interactive web spaces, enabling easy sharing and deployment of AI models

• Vercel AI - develop and deploy web apps in minutes through a conversational chatbot

• Supabase - an open-source Firebase alternative providing database, authentication, and storage functionalities, simplifying backend development for web and mobile apps

Speech

• Eleven Labs - convert text to speech and create natural AI voices in any language

• PlayHT - turn text into speech, including voice cloning.

• Resemble AI - create realistic human-like voices in seconds

• Whisper - OpenAI’s speech-to-text API

• AssemblyAI - speech-to-text for voice data (calls, virtual meetings, podcasts), speaker detection, sentiment analysis, and more

• Deepgram - fast, accurate, and cost-effective speech API

Generate images, videos, and music

• Runway - equipping artists and creators with generative AI capabilities in image, video, and art

• Pika Labs - turn text into videos, including video outpainting and inpainting capabilities

• Suno AI - turn text into music clips

• Midjourney - create realistic images using text

• DALL-E 3 - create realistic images using text

AI-powered tools

• Replit - an online development environment supporting multiple programming languages, enabling collaborative coding and rapid prototyping with integrated AI tools and a specialized AI language model

• Cursor - build software faster in an editor designed for pair programming with AI

• Adobe Firefly - an AI-driven creative suite offering a range of tools for designers and content creators, including image editing, graphic design, and more

Embeddings and Retrieval Augmented Generation

• Pinecone - a scalable vector database service optimized for ML models, enabling efficient similarity search and data retrieval

• Weaviate - an open-source vector search engine with graph database features, facilitating semantic search and automatic classification

• Qdrant - an open-source vector search engine designed for high performance and scalability in similarity search tasks

LLM frameworks

• LangChain - an open-source library designed for building LLM-powered applications, focusing on composability and extensibility

• Llama Index - an open-source framework for efficient indexing and retrieval in LLMs

Open-source tools and repositories

I’ve also turned my personal list of 60+ useful packages for generative AI builders into a Notion table:

Open-source Generative AI

If you find AI Tidbits valuable, share it with a friend and consider showing your support.