# Qualcomm AI Runtime SDK

Qualcomm Neural Processing Engine (also known as Snapdragon Neural
Processing Engine or SNPE) is an all-in-one SDK to port ML models to
run on Qualcomm hardware accelerators. SNPE offers tools to convert
and quantize models trained in PyTorch and TensorFlow and offers a
runtime to execute these models on CPU, GPU, and HTP. Learn more
about SNPE SDK
[here](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-2/overview.html).

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
<!-- Generated by Microsoft Visio, SVG Export optimize-compile-snpe.svg snpe -->
<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:ev="http://www.w3.org/2001/xml-events" xmlns:v="http://schemas.microsoft.com/visio/2003/SVGExtensions/" width="7.26562in" height="8.14063in" viewbox="0 0 523.125 586.125" xml:space="preserve" color-interpolation-filters="sRGB" class="st19 svg-1" aria-label="../_images/optimize-compile-snpe.svg"><v:documentproperties v:langid="1033" v:viewmarkup="false">	<v:userdefs>		<v:ud v:nameu="msvNoAutoConnect" v:val="VT0(1):26"></v:ud>	</v:userdefs></v:documentproperties>
<style>.svg-1 .st1 { fill: none; stroke: none; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st2 { fill: #ffffff; stroke: #d8d8d8; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st3 { fill: #000000; font-family: Roboto; font-size: 1.00001em }
.svg-1 .st4 { font-size: 1em }
.svg-1 .st5 { fill: #f5f6f7; stroke: #d8d8d8; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st6 { fill: #3253dc; stroke: none; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st7 { fill: #ffffff; font-family: Roboto; font-size: 1.00001em }
.svg-1 .st8 { baseline-shift: 32.4941%; font-size: 0.649882em }
.svg-1 .st9 { fill: #dee3ec; stroke: none; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st10 { font-size: 0.83333em }
.svg-1 .st11 { fill: #acbacf; stroke: none; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st12 { marker-end: url("#1-mrkr4-100"); stroke: #7030a0; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1 }
.svg-1 .st13 { fill: #7030a0; fill-opacity: 1; stroke: #7030a0; stroke-opacity: 1; stroke-width: 0.28409090909091 }
.svg-1 .st14 { fill: #3253dc; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st15 { fill: #ffffff; font-family: Roboto; font-size: 0.833336em }
.svg-1 .st16 { fill: #dee3ec; stroke: #dee3ec; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st17 { fill: #000000; font-family: Roboto; font-size: 0.833336em }
.svg-1 .st18 { fill: #acbacf; stroke: #acbacf; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st19 { fill: none; fill-rule: evenodd; font-size: 12px; overflow: visible; stroke-linecap: square; stroke-miterlimit: 3 }</style>
<defs id="Markers">	<g id="lend4">		<path d="M 2 1 L 0 0 L 2 -1 L 2 1 " style="stroke:none"></path>	</g>	<marker id="1-mrkr4-100" class="st13" v:arrowtype="4" v:arrowsize="2" v:setback="7.04" refx="-7.04" orient="auto" markerunits="strokeWidth" overflow="visible">		<use xlink:href="#lend4" transform="scale(-3.52,-3.52) "></use>	</marker></defs><g v:mid="12" v:index="4" v:groupcontext="foregroundPage">	<title>snpe</title>	<v:pageproperties v:drawingscale="1" v:pagescale="1" v:drawingunits="19" v:shadowoffsetx="9" v:shadowoffsety="-9"></v:pageproperties>	<v:layer v:name="interfaces" v:index="0"></v:layer>	<g id="shape51-1" v:mid="51" v:groupcontext="shape" transform="translate(18.375,-18.375)">		<title>Sheet.51</title>		<rect x="0" y="55.125" width="486" height="531" class="st1"></rect>	</g>	<g id="shape1-3" v:mid="1" v:groupcontext="shape" transform="translate(38.8636,-162.911)">		<title>Sheet.1</title>		<desc>Backend libraries</desc>		<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>		<v:textrect cx="222.75" cy="496.513" width="445.5" height="179.224"></v:textrect>		<rect x="0" y="406.901" width="445.5" height="179.224" rx="4.5" ry="4.5" class="st2"></rect>		<text x="4" y="421.7" class="st3" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>B<tspan class="st4" v:langid="1041">ackend libraries</tspan></text>		</g>	<g id="group3-7" transform="translate(191.864,-174.161)" v:mid="3" v:groupcontext="group">		<title>Sheet.3</title>		<g id="shape4-8" v:mid="4" v:groupcontext="shape">			<title>Sheet.4</title>			<rect x="0" y="442.125" width="139.5" height="144" rx="4.5" ry="4.5" class="st5"></rect>		</g>		<g id="shape5-10" v:mid="5" v:groupcontext="shape" transform="translate(4.5,-99.6776)">			<title>Sheet.5</title>			<desc>Qualcomm® AI Engine Direct API</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="4.93" y="563.91" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Qualcomm<tspan dy="-0.235em" class="st8" v:basefontsize="12">®</tspan><tspan dy="0.153em" class="st4"> </tspan>AI Engine <tspan x="37.26" dy="1.2em" class="st4">Direct API</tspan></text>			</g>		<g id="shape6-16" v:mid="6" v:groupcontext="shape" transform="translate(6.31726,-54.6776)">			<title>Sheet.6</title>			<desc>Kernels</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="43.77" y="571.11" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Kernels</text>			</g>		<g id="shape7-19" v:mid="7" v:groupcontext="shape" transform="translate(6.31726,-8.45044)">			<title>Sheet.7</title>			<desc>OpenCL</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="42.66" y="571.11" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>OpenCL</text>			</g>	</g>	<g id="group8-22" transform="translate(335.864,-174.161)" v:mid="8" v:groupcontext="group">		<title>Sheet.8</title>		<g id="shape9-23" v:mid="9" v:groupcontext="shape">			<title>Sheet.9</title>			<rect x="0" y="442.125" width="139.5" height="144" rx="4.5" ry="4.5" class="st5"></rect>		</g>		<g id="shape10-25" v:mid="10" v:groupcontext="shape" transform="translate(4.5,-99.6776)">			<title>Sheet.10</title>			<desc>Qualcomm AI Engine Direct API</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="4.93" y="563.91" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Qualcomm<tspan dy="-0.235em" class="st8" v:basefontsize="12">®</tspan><tspan dy="0.153em" class="st4"> </tspan>AI Engine <tspan x="37.26" dy="1.2em" class="st4">Direct API</tspan></text>			</g>		<g id="shape11-31" v:mid="11" v:groupcontext="shape" transform="translate(6.31726,-54.6776)">			<title>Sheet.11</title>			<desc>QML</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="51.19" y="571.11" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>QML</text>			</g>		<g id="shape12-34" v:mid="12" v:groupcontext="shape" transform="translate(6.31726,-8.45044)">			<title>Sheet.12</title>			<desc>Neon</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="49.59" y="571.11" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Neon</text>			</g>	</g>	<g id="group13-37" transform="translate(47.8636,-174.161)" v:mid="13" v:groupcontext="group">		<title>Sheet.13</title>		<g id="shape14-38" v:mid="14" v:groupcontext="shape">			<title>Sheet.14</title>			<rect x="0" y="442.125" width="139.5" height="144" rx="4.5" ry="4.5" class="st5"></rect>		</g>		<g id="shape15-40" v:mid="15" v:groupcontext="shape" transform="translate(4.5,-99.6776)">			<title>Sheet.15</title>			<desc>Qualcomm AI Engine Direct API</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="4.93" y="563.91" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Qualcomm<tspan dy="-0.235em" class="st8" v:basefontsize="12">®</tspan><tspan dy="0.153em" class="st4"> </tspan>AI Engine <tspan x="37.26" dy="1.2em" class="st4">Direct API</tspan></text>			</g>		<g id="shape16-46" v:mid="16" v:groupcontext="shape" transform="translate(6.31726,-54.6776)">			<title>Sheet.16</title>			<desc>HTP core</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="38.88" y="571.11" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>HTP core</text>			</g>		<g id="shape17-49" v:mid="17" v:groupcontext="shape" transform="translate(6.31726,-8.45044)">			<title>Sheet.17</title>			<desc>HMX/HVX</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="63.7788" cy="567.511" width="127.56" height="37.2272"></v:textrect>			<rect x="0" y="548.898" width="127.558" height="37.2272" rx="4.5" ry="4.5" class="st6"></rect>			<text x="36.17" y="571.11" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>HMX/HVX</text>			</g>	</g>	<g id="shape18-52" v:mid="18" v:groupcontext="shape" transform="translate(38.8636,-67.875)">		<title>Sheet.18</title>		<desc>Hardware IP cores</desc>		<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="2"></v:textblock>		<v:textrect cx="222.75" cy="546.482" width="445.5" height="79.2857"></v:textrect>		<rect x="0" y="506.839" width="445.5" height="79.2857" rx="4.5" ry="4.5" class="st2"></rect>		<text x="4" y="578.53" class="st3" v:langid="1041"><v:paragraph></v:paragraph><v:tablist></v:tablist>Hardware IP cores</text>		</g>	<g id="shape19-55" v:mid="19" v:groupcontext="shape" transform="translate(54.1809,-93.1607)">		<title>Sheet.19</title>		<desc>NPU (DSP/HMX/HTP)</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="63.792" cy="567.297" width="127.59" height="37.656"></v:textrect>		<rect x="0" y="548.469" width="127.584" height="37.656" rx="4.5" ry="4.5" class="st9"></rect>		<text x="51.84" y="563.7" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>NPU <v:newlinechar></v:newlinechar><v:paragraph v:horizalign="1"></v:paragraph><tspan x="26.06" dy="1.44em" class="st10">(DSP/HMX/HTP)</tspan></text>		</g>	<g id="shape20-59" v:mid="20" v:groupcontext="shape" transform="translate(198.155,-93.1607)">		<title>Sheet.20</title>		<desc>GPU</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="63.792" cy="567.297" width="127.59" height="37.656"></v:textrect>		<rect x="0" y="548.469" width="127.584" height="37.656" rx="4.5" ry="4.5" class="st9"></rect>		<text x="52.03" y="570.9" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>GPU</text>		</g>	<g id="shape21-62" v:mid="21" v:groupcontext="shape" transform="translate(342.155,-93.1607)">		<title>Sheet.21</title>		<desc>CPU</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="63.792" cy="567.297" width="127.59" height="37.656"></v:textrect>		<rect x="0" y="548.469" width="127.584" height="37.656" rx="4.5" ry="4.5" class="st9"></rect>		<text x="52.21" y="570.9" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>CPU</text>		</g>	<g id="shape22-65" v:mid="22" v:groupcontext="shape" transform="translate(47.8636,-368.925)">		<title>Sheet.22</title>		<desc>Qualcomm® Neural Processing Engine SDK</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="210.256" cy="549.675" width="420.52" height="72.9"></v:textrect>		<rect x="0" y="513.225" width="420.511" height="72.9" rx="4.5" ry="4.5" class="st6"></rect>		<text x="95.34" y="553.28" class="st7" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Qualcomm<tspan dy="-0.235em" class="st8" v:basefontsize="12">®</tspan><tspan dy="0.153em" class="st4"> </tspan>Neural Processing Engine SDK  </text>		</g>	<g id="shape27-70" v:mid="27" v:groupcontext="shape" transform="translate(48.0708,-510.886)">		<title>Sheet.27</title>		<desc>TensorFlow</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="572.625" width="91.3" height="27"></v:textrect>		<rect x="0" y="559.125" width="91.3" height="27" rx="4.5" ry="4.5" class="st11"></rect>		<text x="14.33" y="576.23" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>TensorFlow</text>		</g>	<g id="shape28-73" v:mid="28" v:groupcontext="shape" transform="translate(160.354,-510.886)">		<title>Sheet.28</title>		<desc>TFLite</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="572.625" width="91.3" height="27"></v:textrect>		<rect x="0" y="559.125" width="91.3" height="27" rx="4.5" ry="4.5" class="st11"></rect>		<text x="28.93" y="576.23" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>TFLite</text>		</g>	<g id="shape29-76" v:mid="29" v:groupcontext="shape" transform="translate(272.637,-510.886)">		<title>Sheet.29</title>		<desc>ONNX</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="572.625" width="91.3" height="27"></v:textrect>		<rect x="0" y="559.125" width="91.3" height="27" rx="4.5" ry="4.5" class="st11"></rect>		<text x="29.21" y="576.23" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>ONNX</text>		</g>	<g id="shape30-79" v:mid="30" v:groupcontext="shape" transform="translate(384.921,-510.886)">		<title>Sheet.30</title>		<desc>PyTorch</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="572.625" width="91.3" height="27"></v:textrect>		<rect x="0" y="559.125" width="91.3" height="27" rx="4.5" ry="4.5" class="st11"></rect>		<text x="23.55" y="576.23" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>PyTorch</text>		</g>	<g id="shape31-82" v:mid="31" v:groupcontext="shape" transform="translate(47.2136,-465.886)">		<title>Sheet.31</title>		<desc>.pb</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="574.875" width="91.3" height="22.5"></v:textrect>		<rect x="0" y="563.625" width="91.3" height="22.5" rx="4.5" ry="4.5" class="st11"></rect>		<text x="37.34" y="578.48" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>.pb</text>		</g>	<g id="shape32-85" v:mid="32" v:groupcontext="shape" transform="translate(159.497,-465.886)">		<title>Sheet.32</title>		<desc>.tflite</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="574.875" width="91.3" height="22.5"></v:textrect>		<rect x="0" y="563.625" width="91.3" height="22.5" rx="4.5" ry="4.5" class="st11"></rect>		<text x="31.98" y="578.48" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>.tflite</text>		</g>	<g id="shape33-88" v:mid="33" v:groupcontext="shape" transform="translate(271.78,-465.886)">		<title>Sheet.33</title>		<desc>.onnx</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="574.875" width="91.3" height="22.5"></v:textrect>		<rect x="0" y="563.625" width="91.3" height="22.5" rx="4.5" ry="4.5" class="st11"></rect>		<text x="31.05" y="578.48" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>.onnx</text>		</g>	<g id="shape34-91" v:mid="34" v:groupcontext="shape" transform="translate(384.064,-465.886)">		<title>Sheet.34</title>		<desc>.ts</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="45.65" cy="574.875" width="91.3" height="22.5"></v:textrect>		<rect x="0" y="563.625" width="91.3" height="22.5" rx="4.5" ry="4.5" class="st11"></rect>		<text x="39.02" y="578.48" class="st3" v:langid="1041"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>.<tspan class="st4" v:langid="1033">ts</tspan></text>		</g>	<g id="shape35-95" v:mid="35" v:groupcontext="shape" transform="translate(679.846,75.2386) rotate(90)">		<title>Sheet.35</title>		<path d="M0 586.13 L15.46 586.13" class="st12"></path>	</g>	<g id="shape36-101" v:mid="36" v:groupcontext="shape" transform="translate(791.489,75.2386) rotate(90)">		<title>Sheet.36</title>		<path d="M0 586.13 L15.46 586.13" class="st12"></path>	</g>	<g id="shape37-106" v:mid="37" v:groupcontext="shape" transform="translate(902.06,75.2386) rotate(90)">		<title>Sheet.37</title>		<path d="M0 586.13 L15.46 586.13" class="st12"></path>	</g>	<g id="shape38-111" v:mid="38" v:groupcontext="shape" transform="translate(1016.49,75.2386) rotate(90)">		<title>Sheet.38</title>		<path d="M0 586.13 L15.46 586.13" class="st12"></path>	</g>	<g id="shape39-116" v:mid="39" v:groupcontext="shape" v:layermember="0" transform="translate(847.203,411.964) rotate(90)">		<title>Sheet.39</title>		<path d="M0 586.13 L36.3 586.13" class="st12"></path>	</g>	<g id="shape40-121" v:mid="40" v:groupcontext="shape" v:layermember="0" transform="translate(991.203,411.964) rotate(90)">		<title>Sheet.40</title>		<path d="M0 586.13 L36.3 586.13" class="st12"></path>	</g>	<g id="shape46-126" v:mid="46" v:groupcontext="shape" v:layermember="0" transform="translate(18.75,-18.375)">		<title>Sheet.46</title>		<rect x="0" y="36.75" width="486" height="549.375" rx="4.5" ry="4.5" class="st1"></rect>	</g>	<g id="shape47-128" v:mid="47" v:groupcontext="shape" transform="translate(38.9531,-32.4001)">		<title>Sheet.47</title>		<desc>QTI</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="27.3281" cy="575.138" width="54.66" height="21.9749"></v:textrect>		<rect x="0" y="564.15" width="54.6562" height="21.9749" rx="4.5" ry="4.5" class="st14"></rect>		<text x="19.55" y="578.14" class="st15" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>QTI</text>		</g>	<g id="shape48-131" v:mid="48" v:groupcontext="shape" transform="translate(102.422,-31.875)">		<title>Sheet.48</title>		<desc>Hardware</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="27.3281" cy="575.138" width="54.66" height="21.9749"></v:textrect>		<rect x="0" y="564.15" width="54.6562" height="21.9749" rx="4.5" ry="4.5" class="st16"></rect>		<text x="5.71" y="578.14" class="st17" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Hardware</text>		</g>	<g id="shape49-134" v:mid="49" v:groupcontext="shape" transform="translate(165.891,-31.875)">		<title>Sheet.49</title>		<desc>OSS</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="27.3281" cy="575.138" width="54.66" height="21.9749"></v:textrect>		<rect x="0" y="564.15" width="54.6562" height="21.9749" rx="4.5" ry="4.5" class="st18"></rect>		<text x="17.96" y="578.14" class="st17" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>OSS</text>		</g>	<g id="shape2-137" v:mid="2" v:groupcontext="shape" v:layermember="0" transform="translate(703.203,411.964) rotate(90)">		<title>Sheet.2</title>		<path d="M0 586.13 L36.3 586.13" class="st12"></path>	</g></g>
</svg>

Setup

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Download SDK](https://docs.qualcomm.com/doc/80-70017-15B/topic/qairt-install.html#qairt-install)

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Setup SDK](https://docs.qualcomm.com/doc/80-70017-15B/topic/qairt-setup.html#qairt-setup)

Customize

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Convert model (SNPE)](https://docs.qualcomm.com/doc/80-70017-15B/topic/port-models.html#snpe-convert)

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Quantize model (SNPE)](https://docs.qualcomm.com/doc/80-70017-15B/topic/port-models.html#snpe-quantize)

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Convert and quantize model (QNN)](https://docs.qualcomm.com/doc/80-70017-15B/topic/port-models.html#qnn-convert)

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Generate model (QNN)](https://docs.qualcomm.com/doc/80-70017-15B/topic/port-models.html#qnn-generate)

Run inference

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Run model (SNPE)](https://docs.qualcomm.com/doc/80-70017-15B/topic/run-models.html#snpe-run)

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Run model (QNN)](https://docs.qualcomm.com/doc/80-70017-15B/topic/run-models.html#qnn-run)

API reference

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Qualcomm Neural Processing Engine C/C++](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-2/api.html)

![arrow-right](data:image/png;base64,UklGRpwAAABXRUJQVlA4TJAAAAAvF8AFEH+goG0bxqU4/kwuDQNp22T7Hd2/tito24Zxx5/keDw1kaw6pAoFSMK/iB/qXPECxHNdR35a5LyfAAqFBeA/Hm9S6E2CUWxbbf5gABvsO2yRgABSJERZJERCJMRBb/sM1UBE/xWmbcM46e4lUEfjF2LpUYCVX6HiHS5YDP3Jhgk/hl+K1nlAASYCVQQ=) [Qualcomm AI Engine Direct C/C++](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-2/api.html)

Last Published: Jan 21, 2026

[Previous Topic
TensorFlow Lite](https://docs.qualcomm.com/bundle/publicresource/80-70017-15B/topics/tflite.md) [Next Topic
Install Qualcomm AI Runtime SDK](https://docs.qualcomm.com/bundle/publicresource/80-70017-15B/topics/qairt-install.md)