Creative, Voice & Media

Robust Speech Recognition via Large-Scale Weak Supervision

A latent text-to-image diffusion model

produces high quality object masks from input prompts such as points or boxes, and it can be used to generate masks for all objects in an image

Bark is a transformer-based text-to-audio model created by Suno. Bark can generate highly realistic, multilingual speech as well as other audio - including music, background noise and simple sound effects

Open-source framework for building custom AI copilots, chatbots, and text areas into React apps

OSS. MusicGen + AudioGen

Interactive Simulacra of Human Behavior

OSS conversational AI. Self-hosted. NLU training

Speech recognition toolkit with pretrained models and tools for voice activity detection, punctuation restoration, and speaker diarization

Best free OSS video gen. Self-hostable. No limits

An open-source framework for building real-time, programmable participants that run on servers, enabling easy integration with LiveKit WebRTC sessions for processing or generating audio, video, and data streams GitHub | docs | demo

Tencent OSS. Consumer GPU. Multi-style

OSS. Licensed data. Clear commercial terms

deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize

A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations

OSS voice-based LLM agents

A robust, all-in-one GPT interface for Discord. ChatGPT-style conversations, image generation, AI-moderation, custom indexes/knowledgebase, youtube summarizer, and more!

GPTeam is a collaborative AI project utilizing GPT-4 to create multi-agent systems aimed at enhancing productivity and communication, with features including agent memory and interaction, alongside instructions for setup and integration with third-party services github | github profile

ChatArena is a library that provides multi-agent language game environments and facilitates research about autonomous LLM agents and their social interactions

Universal swarm-intelligence engine — drop in a scenario and hundreds of grounded LLM agents simulate Twitter, Reddit, and a prediction market hour-by-hour, with counterfactual branching, per-agent MCP tools, and a public gallery of finished runs

by iart.ai - An open-source collection of ~50 motion-graphics, animation, and video skills across 14 installable packs — kinetic typography, data-driven charts, explainers, TikTok/Reels, web/WebGL animation, and Manim math animation — that teach an agent how a professional would build each piece. Every visual skill ships a deliver-and-verify loop (render a frame → screenshot → check) plus a small

Emerging human-behavior simulation capability in LLM agents. github

external - Open-source dictation that types where you talk

Self-hosted single-owner AI social world; each instance is populated by autonomous AI residents with personalities, schedules and relationships who chat, form group conversations, post to a social feed and proactively message the owner

by Andrew Roxby - A CLAUDE.md section that constrains Claude's prose style. It bans specific habits, including announcing a point before making it, colon-hinged sentences where the left side labels the right, verbless fragment openers, and stacked compression. Each rule names the habit, shows an example, and gives the rewrite

AI-powered video, audio & podcast summarization

by Robert Guss - A comprehensive pipeline of Skills that replicates traditional publishing infrastructure for nonfiction book creation using specialized Claude skills

by illusionaireal - A plugin for turning technical ideas into patent disclosures

by David Sosa-Trejo - Six Agent Skills for scientific writing based on Stanford's Writing in the Sciences course: sentence-level prose editing, IMRaD manuscript structure, the writing process, peer review and publication, grants and recommendation letters, and lay summaries and press. Ships as the sciwrite Claude Code plugin with four stdlib-only Python audit scripts

by Yangyi Liu - A new-film skill, agent guide (AGENTS.md) and Python framework with which Claude Code drives Blender over MCP to turn a scientific brief and PDB or AlphaFold structures into a molecular animation film. The agent checks the brief's structural claims, builds the scene from a script, and writes a production record that tags every beat as experimental, simulation-derived or illustrativ

Speech AI plugin with pronunciation assessment, text-to-speech, and speech-to-text. 8 MCP tools for language learning, accessibility, and voice applications

Open-source AI-agent civilization simulation with OpenClaw gateway integration, persistent AI citizens, governance, economy, memory layers, and digital-genome child-agent specialization