# Run on-device generative AI (GenAI)
Note
Running on-device generative AI isn’t supported on the current QLI release.
Qualcomm® Dragonwing™ products bring generative AI (GenAI)
to edge devices without relying solely on cloud infrastructure to
lower latency, enhance privacy, and improve costs for diverse IoT
applications.
The following image illustrates the GenAI architecture, including
possible GenAI use cases and applications, the supported GenAI
frameworks, and the lower-level backends and libraries.
Dragonwing IQ products integrate a CPU, GPU, and Hexagon NPU for
heterogeneous computing, optimized for large language models (LLMs),
vision, and multimodal AI tasks. Leading GenAI models, like Llama,
Whisper, Stable Diffusion, and LLAVA (tailored for IoT scenarios
like robotics, retail, and industrial automation) are supported.
For responsive LLM performance, Dragonwing IQ supports multi-billion
parameter models with techniques like prefill acceleration and
self-speculative decoding. To enable bring your own model (BYOM),
support flexibility, and streamline deployment, use Qualcomm AI Hub,
Qualcomm AI Runtime SDK execution providers, and
Qualcomm Generative AI Inference Extensions (Genie).
Why On-Device GenAI matters
Generative AI on Dragonwing delivers context-aware, adaptive, and privacy-preserving
solutions at the edge, enabling automation, personalization, and operational efficiency
for use cases like autonomous drones, predictive maintenance, multimodal agents,
and on-device retrieval-augmented generation (RAG).
Prepare a GenAI model
Prepare a GenAI model for execution on Qualcomm® Dragonwing™ IoT devices.
https://docs.qualcomm.com/doc/80-80022-15B/topic/prepare-genai-model.html
Run a GenAI model
Run a prepared GenAI model on a Qualcomm Dragonwing IoT device.
https://docs.qualcomm.com/doc/80-80022-15B/topic/run-genai-model.html
Use GenAI models with Qualcomm Generative AI Inference Extensions (Genie)
Prepare, manage, and execute GenAI models with Genie.
https://docs.qualcomm.com/doc/80-80022-15B/topic/use-genai-model-with-genie.html
Develop a GenAI application
Build your own GenAI application based on a Qualcomm sample application.
https://docs.qualcomm.com/doc/80-80022-15B/topic/develop-genai-app.html
Last Published: May 14, 2026
[Previous Topic
Upscale images with super resolution](https://docs.qualcomm.com/bundle/publicresource/80-80022-15B/topics/super-resolution.md) [Next Topic
Prepare a GenAI model](https://docs.qualcomm.com/bundle/publicresource/80-80022-15B/topics/prepare-genai-model.md)