# Run a Generative AI (GenAI) model

Once a GenAI model is prepared and optimized for deployment, you can run the model
on the target device. Qualcomm platforms offer multiple execution paths to meet
different needs, ranging from high-level abstractions to low-level control.

The following table summarizes the GenAI model execution approaches.

| Execution method | Details | Key considerations |
| --- | --- | --- |
| Generative AI Inference Extensions (Genie) | <ul class="simple"><br><li><p>Qualcomm-provided framework designed for simplified execution of complex GenAI models such as LLMs and multimodal models.</p></li><br><li><p>Handles orchestration of multiple binaries, memory management, and hardware acceleration across CPU, GPU, and NPU.</p></li><br><li><p>Ideal for developers who want plug-and-play deployment with minimal integration effort.</p></li><br></ul> | <ul class="simple"><br><li><p>Optimized for Qualcomm hardware, delivering low latency and power efficiency.</p></li><br><li><p>Best for quick deployment and production ready applications</p></li><br></ul> |
| Qualcomm AI Runtime SDK (QAIRT) | <ul class="simple"><br><li><p>Provides low-level APIs for executing QAIRT binaries directly.</p></li><br><li><p>Offers fine-grained control for developers who need custom execution flows or profiling.</p></li><br><li><p>Suitable for advanced use cases where performance tuning is critical.</p></li><br></ul> | <ul class="simple"><br><li><p>Optimized for Qualcomm hardware, delivering low latency and power efficiency.</p></li><br><li><p>Best for custom workflows, and profiling</p></li><br></ul> |
| Open source runtimes | <ul class="simple"><br><li><p>Models can also be executed using open-Source runtimes.</p></li><br><li><p>This approach is useful for developers who want to maintain compatibility with<br>existing open-source ecosystems while leveraging Qualcomm optimizations.</p></li><br></ul> | <ul class="simple"><br><li><p>Open-source runtimes provide portability, but may require additional tuning for Qualcomm platforms.</p></li><br><li><p>Best for research or hybrid environments.</p></li><br></ul> |

Last Published: Jul 13, 2026

[Previous Topic
Prepare a GenAI model using a Jupyter notebook](https://docs.qualcomm.com/bundle/publicresource/80-70030-15B/topics/genai-prepare-jupyter.md) [Next Topic
Use GenAI models with Qualcomm Generative AI (GenAI) Inference Extensions (Genie)](https://docs.qualcomm.com/bundle/publicresource/80-70030-15B/topics/use-genai-model-with-genie.md)