A high performance C++ SDK for AI Agents

[TOC]

Agents-SDK - A High Performance C++ Framework for AI Agents

Agents-SDK is a portable, high-performance C++ framework for building on-device, agentic AI systems — think LangChain for the edge. This SDK is purpose-built for developers who want to create local-first AI agents that can reason, plan, and act without relying on the cloud.

Features

• Modular Architecture — Compose agents from interchangeable components.
• Multi-Provider Support — Connect to multiple LLM providers seamlessly:
  • OpenAI (GPT-5, GPT-4o, GPT-4)
  • Anthropic (Gemini 3 family models: Opus, Sonnet, Haiku)
  • Google (Gemini family models: Pro, Flash)
  • Ollama/llama-cpp (local models like Llama, Mistral, etc.)
• Optimized for Speed and Memory — Built in C++ with focus on performance.
• Built-In Workflow Patterns
  • Prompt Chaining
  • Routing
  • Parallelization
  • Orchestrator-Workers
  • Evaluator-Optimizer
• Autonomous Agents — Supports modern reasoning strategies:
  • ReAct (Reason + Act)
  • CoT (Chain-of-Thought) [In Development]
  • Plan and Execute
  • Zero-Shot [In Development]
  • Reflexion [In Development]
• Extensible Tooling System — Plug in your own tools or use built-in ones (Web Search, Wikipedia, Python Executor, etc).

Pre-requisites

• C++20 compatible compiler (GCC 14+, Clang 17+, MSVC 2022+)

• Bazel 8.3.1+ (https://bazel.build/install)

• Dependencies (already provided for convenience)

  • python3 (3.11+)
  • nlohmann/json
  • spdlog

Quick Start

Installation

1. Clone the repository:

   git clone https://github.com/RunEdgeAI/agents-sdk.git
   

2. Navigate to SDK:

   cd agents-sdk
   

3. Obtain A