AI Launchpad Projects

• ⚙️ MLOps Projects
• ✍️ Prompt Engineering
• 🛡️ Responsible LLM
• 📊 Vector Databases
• 🤖 Coding Agents
• 📝 Blogs
• 🖼️ UI
• 🔒 Security
• 📚 Courses
• 🧑‍🏫 Tutorials
• 🏋️ Training and Fine-Tuning
• 🎥 Learn by Videos
• 🌐 Platforms
• 🗂️ GitHub Organizations
• 🧠 Agent Frameworks
• 🔬 Deep Research
• 🕷️ LLM-Based Scrapers
• 🛠️ Autonomous Software Engineering
• 📈 Evaluation, Observability, and Monitoring
• 🌟 Awesomeness
• 📉 LangGraph Examples and Tutorials
• 🔧 MCP
• 📎 Aggregation Sites
• 💰 LLM API Pricing
• 📋 Datasets
• 🧩 Manus Related

MLOps Projects

• 📂 aibrix
  Cost-efficient and pluggable infrastructure components for GenAI inference.

• 📂 R2R
  The most advanced AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.

• 📂 LitServe
  Lightning-fast serving engine for any AI model of any size. Flexible, easy, and enterprise-scale.

• 📂 docling
  A document processing framework for AI-driven extraction and analysis.

• 📂 Metaflow
  Build, deploy, and manage AI/ML systems - from Netflix.

• 📂 APIPark
  An open-source platform for creating, managing, and deploying APIs for AI applications.

• 📂 Beta9
  Run serverless GPU workloads with fast cold starts on bare-metal servers, anywhere in the world.

• 📂 dstack
  A lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud and on-prem support. Natively supports NVIDIA, AMD, TPU, and Intel accelerators.

• 📂 n8n
  Fair-code workflow automation platform with native AI capabilities. Combines visual building with custom code, self-host or cloud, 400+ integrations.

• 🌐 k0rdent
  A platform for building and deploying AI-driven solutions (details limited).

• 📂 Haystack
  An open-source framework for building search systems with NLP and LLMs.

  • 📂 Haystack Cookbook

• 📂 Jina Serve
  Build multimodal AI applications with a cloud-native stack.

• 📂 exo
  Run your own AI cluster at home with everyday devices.

• 📂 Oumi
  Everything you need to build state-of-the-art foundation models, end-to-end.

• 📂 Seldon Core
  An open-source platform for deploying machine learning models at scale.

  • 🎥 Video Demo

• 📖 vLLM
  A high-performance LLM serving framework; hard to configure and deploy.

  • 📝 vLLM Blog

• 🌐 BentoML
  A framework for building, shipping, and scaling AI applications with ease.

  • 🌐 Yatai Model Deployment at Scale on Kubernetes 🦄️

• 📂 OpenLLM
  Run any open-source LLMs (e.g., Llama, Mistral) as OpenAI-compatible API endpoints in the cloud.

• 📂 LMDeploy
  A toolkit for deploying large language models efficiently.

• 📂 KubeAI
  Private Open AI on Kubernetes – very easy to test locally.

• 🌐 Ray
  A distributed computing framework for scaling AI and Python workloads.

  • 📂 LLM Applications Guide: A comprehensive guide to building RAG-based LLM applications for production.

• 📂 Flyte
  A workflow automation platform for data and ML; similar to Ray.

• 📖 SkyPilot
  A framework for running AI workloads across clouds with cost optimization.

• 🌐 KubeFlow
  An open-source platform for deploying and managing ML workflows on Kubernetes.

• 🌐 MLFlow
  An open-source platform for managing the end-to-end machine learning lifecycle.

• 🌐 ZenML
  An extensible, open-source MLOps framework for reproducible ML pipelines.

• 📂 KAN
  Kolmogorov-Arnold Networks for AI modeling on Azure.

• 📂 LangChain
  A framework for developing applications powered by language models.

• 📂 LangGraph
  A library for building stateful, multi-agent LLM applications.

• 📂 LangGraph GUI
  A graphical interface for LangGraph workflows.

• 📂 LangServe
  A tool for deploying LangChain apps as APIs; deprecated by:

  • 📝 LangGraph Platform

• 📂 Mage AI
  An open-source tool for building, running, and managing data pipelines.

• 🌐 Argilla
  A collaboration platform for building high-quality datasets for NLP.

  • 📜 LangChain Integration

• 📜 Great LangChain Projects
  A curated list of notable LangChain-dependent projects.

• 📂 ClearML
  An open-source MLOps platform for experiment tracking and automation.

• 📂 MindsDB
  An open-source platform for applying ML to databases.

• 📂 H2O AI
  A suite of tools for building and deploying ML models.

• 📂 KServe
  A Kubernetes-based serverless ML inference platform from Red Hat.

• 📂 TrustyAI Explainability
  Tools for explainable AI, from Red Hat.

• 🌐 LLaMA Index
  Turn your data into production-ready LLM applications.

• 📂 OPEA Project
  Open Platform for Enterprise AI, from Intel – runs on Xeon and Gaudi (as of 2024-10-20).

• 📜 AWS MLOps Samples
  A collection of MLOps examples for AWS SageMaker.

• 📂 Data on EKS
  Deploy data and ML workloads on Amazon EKS.

  • 📜 Trainium/Inferentia Install
  • 🎥 Video Tutorial
  • Uses vLLM project.

• 📂 Kubernetes LWS Project
  Lightweight Workload Specification for Kubernetes.

  • 📖 GKE Tutorial
  • 📂 Deploy Distributed Inference with vLLM and LWS

• 📂 Danswer
  An AI-powered question-answering system for enterprise knowledge bases.

  • Similar projects:
    • 📂 Continue: An open-source autopilot for software development.
    • 📂 Dataline: A data processing and visualization tool.

• 📂 Plandex
  An AI-driven terminal for planning and executing coding tasks.

• 📂 Alluxio
  Data orchestration for analytics and machine learning in the cloud.

• 📜 FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

• 📂 LiteLLM
  A lightweight library for calling LLM APIs with a unified interface.

• 📂 Vespa
  Search, make inferences in, and organize vectors, tensors, text, and structured data, at serving time and any scale.

• 📂 Pezzo
  An open-source platform for managing and optimizing LLM operations.

• 📂 Bolt.new
  A platform for building AI-powered apps with any LLM.

• 📂 TensorZero
  A framework for scalable tensor operations in AI workflows.

• 📖 LiteLLM Proxy Server
  A proxy server for routing requests to multiple LLM providers.

Prompt Engineering

• 📂 Prompt Engineering Guide
  A comprehensive resource for crafting effective LLM prompts.

• 📂 Awesome Prompt Engineering
  A curated list of prompt engineering tools and resources.

• 📂 Promptsite
  A platform for sharing and testing LLM prompts.

• 📂 Promptimizer
  A tool for optimizing prompts for better LLM performance.

Responsible LLM

• 📂 Awesome Production ML
  A collection of resources for ethical and production-ready ML.

• 🌐 Guardrails AI
  A framework for adding safety and compliance to LLM applications.

• 🌐 E2B
  A sandbox environment for running AI agents securely.

Vector Databases

• 📖 Chroma
  An open-source vector database for AI applications.

• 📂 FAISS
  A library for efficient similarity search and clustering of dense vectors.

• 🌐 Pinecone
  A managed vector database for building AI-powered search.

• 🌐 Qdrant
  A high-performance vector database for similarity search.

  • 📂 Demo Code Search

Coding Agents

Projects that can finish apps autonomously or assist with troubleshooting:

• 📂 Fragments
  A tool for generating code snippets using AI agents.

• 🌐 Bolt.new
  A web-based platform for rapid AI-driven app development.

• 🌐 V0
  A generative UI tool powered by AI.

• 🌐 Lovable
  An AI-assisted platform for building software.

• 📝 Claude Artifacts
  Interactive code and content generation from Anthropic’s Claude.

• 📂 Vercel AI Chatbot
  A full-featured, hackable Next.js AI chatbot built by Vercel.

• 📂 CodeAct
  An agent framework for autonomous code execution.

  • 📜 OpenHands Issue

• 📂 OpenHands
  An open-source AI coding assistant for software development.

• 📂 SWE-Agent
  An agent for solving software engineering tasks, from Princeton NLP.

  • From 📂 Awesome AI Agents.

• 📂 Goose
  An AI agent for code execution and testing.

• 📂 MetaGPT
  A multi-agent framework for simulating a software company with LLMs.

• 📂 Multi-Agent Orchestrator
  A framework for coordinating multiple AI agents, from AWS Labs.

Blogs

• 📝 LangChain Blog
  Official blog for LangChain updates and tutorials.

• 📝 Phil Schmid's Blog
  Technical insights on AI deployment and infrastructure.

• 📝 Kaggle Announcements
  Updates and announcements from the Kaggle community.

UI

• 🌐 Streamlit
  A framework for building interactive data apps in Python.

• 🌐 Gradio
  A tool for creating web-based interfaces for ML models.

• 📖 Chainlit
  A library for building conversational AI interfaces.

Security

• 📂 Garak
  A tool for testing LLM vulnerabilities, from NVIDIA.

• 📂 LLM Backdoor
  Research on backdoor attacks in large language models.

Courses

• 📂 LLM Course
  A comprehensive course on building LLM applications.

• 📚 LLM Apps: Evaluation
  A course on evaluating LLM applications with Weights & Biases.

Tutorials

• 📝 Zep AI Agents with LangGraph
  A tutorial on building AI agents with Zep and LangGraph.

• 📝 Azumo: Exploring LangGraph
  An in-depth guide to LangGraph for state management.

• 📂 GenAI Agents
  Examples and resources for generative AI agents.

Training and Fine-Tuning

• 📂 Axolotl
  A tool for fine-tuning LLMs with ease.

• 📂 TRL
  Transformer Reinforcement Learning for fine-tuning LLMs.

• 📖 AutoTrain LLM Fine-Tuning
  Automated fine-tuning of LLMs with Hugging Face.

• 📂 LLaMA Factory
  A framework for training and fine-tuning LLaMA models.

• 🎥 Video: Training Overview
  A guide to LLM training basics.

• 🎥 Video: ORPO/DPO/SFT Explained
  Explains ORPO, DPO, and SFT techniques.

• 🎥 Video Series: Advanced Training
  Advanced training techniques; could n8n replicate this?

Learn by Videos

• 🎥 Local AI by NetworkChuck
  Running AI locally with NetworkChuck.

• 🎥 Additional Video 1
  Miscellaneous AI-related content.

• 🎥 Additional Video 2
  Another AI tutorial or demo.

• 🎥 Additional Video 3
  Further AI exploration video.

Platforms

• 📂 Dify
  An open-source platform for building AI-native applications.

GitHub Organizations

• 📂 Meta LLaMA
  Official GitHub for Meta’s LLaMA projects.

• 📂 AWS Samples
  Sample projects and code from AWS.

• 📂 Google Cloud Generative AI
  Generative AI resources from Google Cloud.

• 📂 Oumi AI
  Oumi’s open-source AI projects.

Agent Frameworks

• 📂 Surf
  A computer-use AI agent powered by OpenAI, interacting with E2B's virtual desktop environment via natural language.

• 📂 Letta
  Formerly MemGPT – a stateful agents framework with memory, reasoning, and context management.

• 📂 OctoTools
  An agentic framework with extensible tools for complex reasoning.

  • 🌐 Docs
  • 📝 Blog: Stanford's LLM Tool-Use Framework

• 📂 AI Companion
  Meet Ava, the WhatsApp Agent.

• 📂 MAGMA
  A Foundation Model for Multimodal AI Agents from Microsoft.

• 📂 Autogen
  A multi-agent conversation framework from Microsoft.

• 📂 AG2
  AG2 (Community fork of Autogen): The Open-Source AgentOS

• 📂 CrewAI
  A framework for orchestrating role-playing AI agents.

• 📂 LangFlow
  A visual framework for building LLM-powered applications.

• 📂 FlowWise
  A drag-and-drop tool for creating LLM workflows.

• 📂 Julep
  Not fully open-sourced – a new DSL and server for AI agents and multi-step tasks.

• 📂 Vision Agent
  An AI agent for vision-based tasks.

• 📂 Parlant
  A customer-facing LLM-agent framework to increase accuracy and reliability.

• 📂 Tribe
  Low-code tool to rapidly build and coordinate multi-agent teams.

• 📂 Goose
  An extensible AI agent that installs, executes, edits, and tests with any LLM.

  • 📝 Blog

• 📂 SlackAgent An AI agent integrated with Slack for workflow automation.

• 📂 LightAgent
  A highly lightweight, active Agentic Framework designed for multi-agent collaboration, resembling a swarm

• 📂 Refact
  AI Agent that handles engineering tasks end-to-end

Deep Research

• 📂 Open Deep Research
  Tools and resources for deep AI research.

• 📂 R1-V
  Distillation training research for AI agents.

• 📂 Deep Research
  A repository for advanced AI research projects.

• 📂 OpenDeepResearcher
  An open-source deep research assistant.

• 📂 DeepClaude
  Research into Claude-like deep learning models.

• 📂 DeepClaude by ErlichLiu
  Another take on DeepClaude research.

LLM-Based Scrapers

• 📂 ScrapeGraphAI
  Python scraper based on AI for web data extraction.

• 📂 FireCrawl
  A web crawler optimized for LLM data collection.

• 📂 Crawl4AI
  An AI-powered web crawling framework.

• 📂 Tourist
  A lightweight scraper for LLM training data.

• 📂 GPT-Crawler
  A crawler designed for GPT-based data gathering.

Autonomous Software Engineering

• 📂 OpenHands
  An open-source AI coding assistant for autonomous software development.

• 📂 AutoCodeRover
  An autonomous code generation and debugging tool.

• 📂 SWE-bench
  Multimodal: Can Language Models Resolve Real-World GitHub Issues?

• 📂 Web UI
  A web-based UI for autonomous software engineering.

• 📂 OpenManus
  An open platform for autonomous AI development.

Evaluation, Observability, and Monitoring

• 📂 Helicone
  An observability platform for LLM applications.

• 📂 DeepEval
  The LLM Evaluation Framework.

• 📂 LangFuse
  Open-source LLM engineering platform: observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, LangChain, OpenAI SDK, LiteLLM, and more. YC W23.

• 📂 Opik
  Debug, evaluate, and monitor LLM applications, RAG systems, and agentic workflows with tracing, automated evaluations, and production-ready dashboards.

• 📂 OptiLLM
  Optimizing inference proxy for LLMs.

• 📂 Phoenix
  AI Observability & Evaluation platform.

Awesomeness

• 📂 Awesome LLM
  A curated list of awesome LLM resources.

LangGraph Examples and Tutorials

• 📂 Multi-Agent System
  A multi-agent system built with LangGraph.

• 📝 BigQuery Agentic Workflow
  Tutorial on agentic workflows with BigQuery and LangGraph.

• 📂 LangChain Open Tutorial
  Open-source tutorials for LangChain and LangGraph.

MCP

• 📂 Awesome MCP Servers
  A list of MCP (Model Context Protocol) servers.

• 📂 Agent Toolkit
  Tools for implementing MCP in AI agents.

• 📂 MCP Server Axiom
  An Axiom-based MCP server implementation.

• 📂 TFMCP
  A TensorFlow-based MCP project.

• 📂 FastAPI MCP A zero-configuration tool for automatically exposing FastAPI endpoints as Model Context Protocol (MCP) tools.

• 📂 DeepChat)
  A smart assistant that connects powerful AI to your personal world.

Aggregation Sites

• 🌐 Smithery AI
  An aggregation site for AI tools and resources.

• 🌐 MCP.so
  A hub for Model Context Protocol resources.

LLM API Pricing

• 🌐 AI Pricing Hub
  A comparison tool for LLM API pricing.

Datasets

• 📂 LLM Datasets
  A collection of datasets for LLM training and evaluation.

Manus Related

• 📂 CortexON
  An agentic AI framework for cognitive tasks.

• 📂 UI-TARS Desktop
  A GUI Agent application based on UI-TARS (Vision-Language Model) to control your computer using natural language.

• 📂 OpenManus
  No fortress, purely open ground. OpenManus is coming.

• 📂 LangManus
  A language-driven Manus framework.