A curated list of awesome AI agents, frameworks, tools, and resources.
English | 中文
- Agents
- Applications
- Evals
- Frameworks
- LLM Leaderboard
- News
- Platforms
- Pricing
- Research
- Skills
- Tools
- Tutorials
- A List of Claude Code Agents by Really Him - Community-submitted collection of Claude Code sub-agents and agent frameworks.
- Agentics by GitHub Next - Sample pack of reusable GitHub Agentic Workflows for repository maintenance, code review, CI analysis, security scanning, documentation updates, and more.
- evals - OpenAI Cookbook topic page for evaluation examples, patterns, and guidance.
- Evaluating the Effectiveness of LLM-Evaluators (aka LLM-as-a-Judge) by Eugene Yan - Detailed analysis of LLM-as-a-judge strengths, failure modes, and evaluation tradeoffs.
- AI Agent Observability & Evaluation by Hugging Face - Course unit on observability and evaluation for AI agents.
- Frequently Asked Questions (And Answers) About AI Evals by Hamel Husain - Practical answers to common evaluation design, process, and measurement questions.
- Your AI Product Needs Evals by Hamel Husain - Practical case for making evals a first-class part of AI product development.
- Creating an LLM-as-a-Judge That Drives Business Results by Hamel Husain - Guide to designing judge-based evals that align with business outcomes.
- Voice AI Evals by Kwindla Hultman Kramer - Open evaluation repo for testing voice AI agents and workflows.
- Get Shit Done by GSD - A lightweight meta-prompting, context engineering, and spec-driven development system that solves context rot with fresh subagent sessions, parallel wave execution, and atomic git commits. Supports 15+ AI coding runtimes.
- gstack by Garry Tan - Garry Tan's virtual engineering team for Claude Code — 23 opinionated slash-command skills covering CEO review, design, engineering, QA, security audit, and release, with real browser automation and multi-agent coordination.
- Superpowers by Jesse Vincent - An agentic skills framework and software development methodology for coding agents, featuring TDD, subagent-driven development, brainstorming, and systematic debugging skills. Supports Claude Code, Codex, Cursor, Gemini CLI, and more.
- Claw-Eval by Bowen Ye & Lei Li (PKU/HKU) - Trustworthy evaluation benchmark for autonomous agents, covering general, multi-turn, and multimodal tasks with safety-aware scoring.
- ProjDevBench by Pengrui Lu - Benchmark for evaluating AI coding agents on end-to-end project development, with dual evaluation (Online Judge + LLM code review), Docker isolation, and support for Claude Code, Cursor, Gemini CLI, Codex, Augment, and Copilot.
- Vellum LLM Leaderboard by Vellum - Latest public benchmark performance for SOTA models, featuring results from GPQA Diamond, AIME 2025, SWE-Bench, Humanity's Last Exam, ARC-AGI 2, MMMLU, and more.
- AI HOT by Virxact - Curated AI news aggregator with daily digests and trend tracking, offering REST API, RSS, and SKILL.md integration for coding agents.
- AI News - Daily roundup of notable AI discussions from Discord, Reddit, and X.
- Last Week in AI - Weekly podcast and newsletter covering AI news and research.
- Latent Space - Podcast with deep dives and interviews on frontier AI topics.
- Stratechery - Newsletter and podcast focused on tech strategy, industry analysis, and AI trends.
- OpenAI API Pricing by OpenAI - Official API pricing reference covering flagship, multimodal, specialized, and fine-tuning models, plus tool costs for web search, file search, containers, and agent kit.
- The Prompt Report: A Systematic Survey of Prompting Techniques - Survey paper covering prompting techniques, patterns, and evaluation considerations for LLM systems.
- Agent Skills by Addy Osmani - Production-grade engineering skills for AI coding agents, covering 23 lifecycle skills, slash commands, personas, and verification-driven workflows.
- Andrej Karpathy Skills by Jiayuan Zhang - Karpathy-inspired CLAUDE.md guidelines addressing LLM coding pitfalls with four principles: think before coding, simplicity first, surgical changes, and goal-driven execution.
- Andrej Karpathy Skills by Multica AI - Karpathy-inspired Claude Code guidelines for avoiding LLM coding pitfalls with think-before-coding, simplicity-first, surgical changes, and goal-driven execution 🤖.
- Anthropic Skills by Anthropic - Anthropic's official skill collection for Claude Code, including skill-creator (create, evaluate, and optimize skills with benchmarking), and more.
- Awesome Agent Skills by VoltAgent - Curated collection of 1100+ agent skills from official dev teams and the community, compatible with Claude Code, Codex, Gemini CLI, Cursor, and more.
- Matt Pocock Skills by Matt Pocock - Small, composable agent skills for real engineering — covers grilling sessions, TDD, diagnosis loops, codebase architecture improvement, triage, and domain-driven documentation. Compatible with Claude Code, Codex, and other coding agents.
- Obsidian Skills by Steph Ango - Agent skills for Obsidian, teaching your coding agent to use Obsidian Markdown, Bases, JSON Canvas, CLI, and Defuddle. Follows the Agent Skills specification, compatible with Claude Code, Codex CLI, OpenCode, and more.
- Startup Claude Skills by Eric Tech - Reusable Claude Code skills for startups, covering bug fixing, feature development, PR review, automated review-fix loops, and headless browser QA testing.
- UI UX Pro Max Skill by NextLevelBuilder - AI skill for professional UI/UX development with intelligent design-system generation, multi-platform stack guidance, and practical workflow support for coding agents.
- Vercel React Best Practices by Vercel - React and Next.js performance optimization guidelines with 70 rules across 8 categories for writing, reviewing, and refactoring frontend code.
- The OSS LLMOps Stack by LiteLLM and Langfuse - Reference page for an open-source LLMOps stack spanning model routing, observability, and production workflows.
- Agentic Design Patterns by xindoo - Systematic introduction to AI agent design patterns, covering prompt chaining, routing, parallelization, reflection, tool use, planning, multi-agent collaboration, memory management, learning and adaptation, MCP, and more.
- Harness Engineering: from Claude Code to AI Coding by Handong Zhang - Practical guide to harness engineering for AI coding workflows, covering setup patterns, agent collaboration, and implementation practices.
- Building Effective Agents by Anthropic - Anthropic's guide on building LLM agents with simple, composable patterns — covers augmented LLM, prompt chaining, routing, parallelization, orchestrator-workers, evaluator-optimizer, and autonomous agents, with practical advice on tool engineering.
- Learn Claude Code by CrazyBoyM / shareAI-lab - 19 chapters across 4 stages, from the minimal agent loop to a multi-agent platform, covering tool use, subagents, skills, context compaction, permissions, hooks, memory, error recovery, task scheduling, team protocols, worktree isolation, and MCP.
- Prompt Engineering Guide by DAIR.AI - Comprehensive guide to prompt engineering techniques, examples, and best practices for modern LLM applications.
- Beginners Guide to Machine Learning in JavaScript by The Coding Train - Beginner-friendly playlist introducing machine learning concepts and practical implementations in JavaScript.
- YouTube Tutorials by Owain Lewis - Self-contained companion repos for YouTube tutorials on practical AI automation patterns, covering RAG, agent teams, background agents, multi-agent systems, spec-driven development, and more.
- Learn Prompting - Structured documentation and guides for prompting techniques and LLM usage patterns.
- How to prompt o1 by Ben Hylak - Deep dive on prompting reasoning models that are not optimized for chat-style interaction.
- Effective Context Engineering for AI Agents by Anthropic - Practical guidance for structuring and managing context in agentic systems.
- Hugging Face Agents Course by Hugging Face - Free course on building, using, and evaluating AI agents.
- How We Built Ellipsis by Nick Bradford - Engineering retrospective on building LLM coding agents over 27 months.
- Don’t Build Multi-Agents by Walden Yan - Argument for simpler agent systems with context engineering over unnecessary multi-agent complexity.
- We Built a Multi-Agent Research System by Anthropic - Case study on designing and operating a multi-agent research workflow.
- What We Learned from a Year of Building with LLMs by Eugene Yan, Bryan Bischof, Charles Frye, Hamel Husain, Jason Liu, and Shreya Shankar - Three-part series on production lessons for building, evaluating, and operating LLM systems.
- Traceability and Observability in Multi-Step LLM Systems by Marc Klingen - Webinar on tracing and observability for multi-step LLM applications.
- Data Flywheels for LLM Applications by Shreya Shankar - Practical article on using data flywheels to improve LLM products.
- Latency optimization by OpenAI - Cookbook guide for reducing end-to-end latency in LLM applications.
- Voice AI & Voice Agents - An Illustrated Primer by Kwindla Hultman Kramer - Illustrated primer on voice AI systems and voice agents.
- Evaluating Voice AI Agents by Marc Klingen and Brooke Hopkins - Guide to evaluating voice AI agents in real-world workflows.
- Intro to Large Language Models by Andrej Karpathy - Beginner-friendly talk introducing core LLM concepts and mental models.
- How I use LLMs by Andrej Karpathy - Practical talk on effective day-to-day use of LLMs.
Contributions welcome! Read the contribution guidelines first.
