# Cloud AI SDK
The Cloud AI SDK enables you to optimize trained deep learning models for high-performance inference on [Qualcomm AI platforms](https://docs.qualcomm.com/doc/80-99100-3/topic/index_Getting-Started.html#cloud-ai-platforms) with Qualcomm® Cloud AI 100 accelerators.
## Get started
>
>
> Cloud AI SDK overview
>
>
> Get the essential details about the purpose of the Cloud AI SDK, its components, and platform support
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Getting-Started.html
>
>
> Verify setup
>
>
> Verify the setup of the Qualcomm AI On-Prem Appliance plus installation instructions for your reference.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/verify-setup.html
>
>
> Quick start guide
>
>
> Steps to run a sample model on Qualcomm Cloud AI Platforms.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Quick-Start-Guide.html
## User guide
>
>
> Inference and deployment workflow
>
>
> Explore the steps to prepare, export, compile, and deploy pre-trained models in production.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Inference-Workflow.html
>
>
> Model architecture
>
>
> Cloud AI 100 inference cards support a wide range of model architectures.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Model-Architecture-Support.html
>
>
> Advanced SDK capabilities
>
>
> Specialized Cloud AI SDK functionality is available using [custom operations (C++)](https://docs.qualcomm.com/doc/80-99100-3/topic/index_custom_ops.html#custom-ops), [model sharding](https://docs.qualcomm.com/doc/80-99100-3/topic/index_model_sharding.html#reference-to-model-sharding), and [object detection processing](https://docs.qualcomm.com/doc/80-99100-3/topic/Object-Detection-Post-processing.html#reference-to-object-detection-postprocessing).
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Advanced-model-techniques.html
>
>
> System management
>
>
> Query card and SoC health using `qaic-util` and use AIC-manager to collect metrics.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_System-Management.html
>
>
> Hardware architecture
>
>
> Architecture details about the Cloud AI 100 inference cards.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Architecture.html
## Serving and deployment
>
>
> vLLM
>
>
> Deploy and serve models using vLLM.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_vLLM-Serving.html
>
>
> TGI
>
>
> Deploy and serve models using TGI.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_TGI-Serving.html
>
>
> Docker
>
>
> Run model-serving workloads in Docker containers.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Docker.html
>
>
> Kubernetes
>
>
> Deploy and manage model-serving workloads with Kubernetes.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Kubernetes.html
## Programming interfaces
>
>
> Python
>
>
> Python API reference for Qualcomm Cloud AI.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Python-API.html
>
>
> C++ API
>
>
> C++ API reference for Qualcomm Cloud AI.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_Cpp-API.html
>
>
> ONNX Runtime
>
>
> ONNX Runtime reference for Qualcomm Cloud AI.
>
> https://docs.qualcomm.com/doc/80-99100-3/topic/index_onnxruntime.html
Last Published: Aug 25, 2026
[Next Topic
Cloud AI SDK overview](https://docs.qualcomm.com/bundle/publicresource/80-99100-3/topics/index_Getting-Started.md)