nexa-sdk logo

nexa-sdk

Free

Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Suppo

Image GeneratorsFreeFree tier
Inputs: text, imageOutputs: text
Type
Open Source

About nexa-sdk

Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.

Key Features

Day-0 support for latest LLM and VLM models
Runs on GPU, NPU, and CPU hardware
Coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker)
Supports multiple open-source models including OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3

Pros & Cons

Pros
  • Free and open-source software
  • Cross-platform support (desktop, mobile, IoT)
  • Early access to latest model architectures
  • Multiple hardware acceleration options (GPU, NPU, CPU)

Best For

Run frontier LLMs locally on personal devicesDeploy VLMs on edge and mobile devicesIntegrate AI inference into cross-platform applications

Alternatives to nexa-sdk