# Appliance components

This section provides an overview of the components in the Dragonwing AI On-Prem Appliance.

## AI appliance box

The AI appliance box is a host computer in a compact form factor with Cloud AI 100 accelerator PCIe cards installed. The AI appliance box is available from approved [third-party vendors](https://www.aetina.com/solution.php?t=19) ![devhw](data:image/png;base64,UklGRt4AAABXRUJQVlA4TNIAAAAvD8ADED/BoG0jSe5SXP5I7gkNRG3byLnX4Tn+2K4I2raNw5/iqPxlEwBAGlwuj8BNBPpnsblrANx3P36s+DHQIcQ0dmEfEGPc8WEcCCcO/M2hXv3rDJTcHCTB1es7l9P2UoywA2a3jSW/pp77EhxGkq1E8zjH3R3e/fxjREOI6P8EcH+lqu/oTK/6kS+YwlHVAMjkP0ErP1UNIZZmnsB32Y2lZjNPO7HUUA1HkVWz73lAIiWM6WaegFcHzNOJ3bv89WhdNu1TDx/txhT2np2bzWU=). The AI appliance box is a Linux OS with the Cloud AI SDKs and AI Inference Suite SDKs. You use the Cloud AI SDK to deploy AI applications and optimized models to the AI appliance box. You use the AI Inference Suite and AI Inference Suite SDK APIs and tools to control and customize AI inferencing.

You can deploy multiple clusters of AI appliance boxes for scaling classic and generative AI workloads on-premises. The following image shows the components of the AI appliance box.

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
<!-- Generated by Microsoft Visio, SVG Export on-prem-solution-block-diagram.svg Page-2 -->
<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:ev="http://www.w3.org/2001/xml-events" xmlns:v="http://schemas.microsoft.com/visio/2003/SVGExtensions/" width="9in" height="6.4in" viewbox="0 0 810.25 506" xml:space="preserve" color-interpolation-filters="sRGB" class="st19" aria-label="../../_images/on-prem-solution-block-diagram.svg"><v:documentproperties v:langid="1033" v:viewmarkup="false">	<v:userdefs>		<v:ud v:nameu="msvNoAutoConnect" v:val="VT0(1):26"></v:ud>	</v:userdefs></v:documentproperties>
<style>.svg-1 .st1 { fill: #fafafa; stroke: #d2d7e1; stroke-width: 1 }
.svg-1 .st2 { fill: #2a2aea; stroke: #0d4964; stroke-width: 0.25 }
.svg-1 .st3 { fill: #feffff; font-family: Roboto; font-size: 1.33333em }
.svg-1 .st4 { font-size: 1em }
.svg-1 .st5 { fill: #fafafa; stroke: #d2d7e1; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1 }
.svg-1 .st6 { fill: none; stroke: none; stroke-width: 0.25 }
.svg-1 .st7 { fill: #000000; font-family: Roboto; font-size: 1.00001em }
.svg-1 .st8 { marker-start: url("#1-mrkr10-32"); stroke: #7f7f7f; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st9 { fill: #7f7f7f; fill-opacity: 1; stroke: #7f7f7f; stroke-opacity: 1; stroke-width: 0.22935779816514 }
.svg-1 .st10 { fill: #7f7f7f; font-family: Roboto; font-size: 1.00001em }
.svg-1 .st11 { fill: #000000; font-family: Roboto; font-size: 1.33333em }
.svg-1 .st12 { fill: #007884; stroke: #000000; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st13 { fill: #ffffff; font-family: Roboto; font-size: 1.33333em }
.svg-1 .st14 { fill: #2a2aea; stroke: #000000; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st15 { marker-end: url("#1-mrkr13-101"); marker-start: url("#1-mrkr13-99"); stroke: #7f7f7f; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1 }
.svg-1 .st16 { fill: #7f7f7f; fill-opacity: 1; stroke: #7f7f7f; stroke-opacity: 1; stroke-width: 0.28409090909091 }
.svg-1 .st17 { fill: #040a40; stroke: #0d4964; stroke-width: 0.25 }
.svg-1 .st18 { fill: #007884; stroke: #0d4964; stroke-width: 0.25 }
.svg-1 .st19 { fill: none; fill-rule: evenodd; font-size: 12px; overflow: visible; stroke-linecap: square; stroke-miterlimit: 3 }</style>
<defs id="Markers">	<g id="lend10">		<path d="M 0 0.75 C -0.414214 0.75 -0.75 0.414214 -0.75 0 -0.75 -0.414214 -0.414214 -0.75 0 -0.75 0.414214 -0.75 0.75 -0.414214 0.75 0 0.75 0.414214 0.414214 0.75 0 0.75 Z " style="stroke:none"></path>	</g>	<marker id="1-mrkr10-32" class="st9" v:arrowtype="10" v:arrowsize="2" v:setback="2.79" refx="2.79" orient="auto" markerunits="strokeWidth" overflow="visible">		<use xlink:href="#lend10" transform="scale(4.36) "></use>	</marker>	<g id="lend13">		<path d="M 3 1 L 0 0 L 3 -1 L 3 1 " style="stroke:none"></path>	</g>	<marker id="1-mrkr13-99" class="st16" v:arrowtype="13" v:arrowsize="2" v:setback="10.2" refx="10.2" orient="auto" markerunits="strokeWidth" overflow="visible">		<use xlink:href="#lend13" transform="scale(3.52) "></use>	</marker>	<marker id="1-mrkr13-101" class="st16" v:arrowtype="13" v:arrowsize="2" v:setback="10.56" refx="-10.56" orient="auto" markerunits="strokeWidth" overflow="visible">		<use xlink:href="#lend13" transform="scale(-3.52,-3.52) "></use>	</marker></defs><g v:mid="4" v:index="2" v:groupcontext="foregroundPage">	<title>Page-2</title>	<v:pageproperties v:drawingscale="0.0138889" v:pagescale="0.0138889" v:drawingunits="29" v:shadowoffsetx="9" v:shadowoffsety="-9"></v:pageproperties>	<v:layer v:name="Measure" v:index="0" v:print="false"></v:layer>	<g id="shape83-1" v:mid="83" v:groupcontext="shape" transform="translate(19,-19)">		<title>Sheet.83</title>		<rect x="0" y="38" width="772.25" height="468" rx="8" ry="8" class="st1"></rect>	</g>	<g id="shape81-3" v:mid="81" v:groupcontext="shape" transform="translate(77.2499,-109)">		<title>Sheet.81</title>		<rect x="0" y="178" width="248" height="328" rx="8" ry="8" class="st1"></rect>	</g>	<g id="shape82-5" v:mid="82" v:groupcontext="shape" transform="translate(87.2499,-117)">		<title>Sheet.82</title>		<rect x="0" y="172.709" width="248" height="333.291" rx="8" ry="8" class="st1"></rect>	</g>	<g id="shape5-7" v:mid="5" v:groupcontext="shape" transform="translate(96.8749,-127.209)">		<title>Sheet.5</title>		<rect x="0" y="172.709" width="248" height="333.291" rx="8" ry="8" class="st1"></rect>	</g>	<g id="shape35-9" v:mid="35" v:groupcontext="shape" transform="translate(116.875,-158)">		<title>Sheet.35</title>		<desc>Cloud AI accelerator card</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="49.51" cy="469" width="99.02" height="74"></v:textrect>		<rect x="0" y="432" width="99.02" height="74" rx="8" ry="8" class="st2"></rect>		<text x="19.5" y="454.6" class="st3" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Cloud AI <tspan x="9.42" dy="1.2em" class="st4">accelerator </tspan><tspan x="33.75" dy="1.2em" class="st4">card</tspan></text>		</g>	<g id="shape36-14" v:mid="36" v:groupcontext="shape" transform="translate(227.365,-158)">		<title>Sheet.36</title>		<desc>Cloud AI accelerator card</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="49.51" cy="469" width="99.02" height="74"></v:textrect>		<rect x="0" y="432" width="99.02" height="74" rx="8" ry="8" class="st2"></rect>		<text x="19.5" y="454.6" class="st3" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Cloud AI <tspan x="9.42" dy="1.2em" class="st4">accelerator </tspan><tspan x="33.75" dy="1.2em" class="st4">card</tspan></text>		</g>	<g id="group40-19" transform="translate(116.875,-242)" v:mid="40" v:groupcontext="group">		<title>Sheet.40</title>		<g id="shape6-20" v:mid="6" v:groupcontext="shape">			<title>Sheet.6</title>			<rect x="0" y="302.5" width="208" height="203.5" rx="8" ry="8" class="st5"></rect>		</g>		<g id="shape20-22" v:mid="20" v:groupcontext="shape" transform="translate(44.2446,-1.97573)">			<title>Sheet.20</title>			<desc>Host computer</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="59.7554" cy="498.097" width="119.52" height="15.8058"></v:textrect>			<rect x="0" y="490.194" width="119.511" height="15.8058" class="st6"></rect>			<text x="19.85" y="501.7" class="st7" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Host computer</text>			</g>	</g>	<g id="group47-25" transform="translate(344.625,-161.5)" v:mid="47" v:groupcontext="group">		<title>Sheet.47</title>		<g id="group41-26" transform="translate(0.499976,-81.7187)" v:mid="41" v:groupcontext="group">			<title>Sheet.41</title>			<g id="shape22-27" v:mid="22" v:groupcontext="shape" transform="translate(-3.59712E-14,1002) scale(1,-1)">				<title>Sheet.22</title>				<path d="M2.09 506 L2.45 506 L34 506" class="st8"></path>			</g>			<g id="shape29-33" v:mid="29" v:groupcontext="shape" transform="translate(37.98,0)">				<title>Sheet.29</title>				<desc>USB</desc>				<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>				<v:textrect cx="20" cy="496" width="40.01" height="20"></v:textrect>				<rect x="0" y="486" width="40" height="20" class="st6"></rect>				<text x="4" y="500.8" class="st10" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>USB</text>				</g>		</g>		<g id="group42-36" transform="translate(0.499976,-65.2187)" v:mid="42" v:groupcontext="group">			<title>Sheet.42</title>			<g id="shape23-37" v:mid="23" v:groupcontext="shape" transform="translate(0,1002) scale(1,-1)">				<title>Sheet.23</title>				<path d="M2.09 506 L2.45 506 L34 506" class="st8"></path>			</g>			<g id="shape30-42" v:mid="30" v:groupcontext="shape" transform="translate(37.98,0)">				<title>Sheet.30</title>				<desc>DP</desc>				<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>				<v:textrect cx="20" cy="496" width="40.01" height="20"></v:textrect>				<rect x="0" y="486" width="40" height="20" class="st6"></rect>				<text x="4" y="500.8" class="st10" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>DP</text>				</g>		</g>		<g id="group43-45" transform="translate(0.499978,-49)" v:mid="43" v:groupcontext="group">			<title>Sheet.43</title>			<g id="shape24-46" v:mid="24" v:groupcontext="shape" transform="translate(0,1004.28) scale(1,-1)">				<title>Sheet.24</title>				<path d="M2.09 506 L2.45 506 L34 506" class="st8"></path>			</g>			<g id="shape31-51" v:mid="31" v:groupcontext="shape" transform="translate(37.98,0)">				<title>Sheet.31</title>				<desc>LAN</desc>				<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>				<v:textrect cx="20" cy="496" width="40.01" height="20"></v:textrect>				<rect x="0" y="486" width="40" height="20" class="st6"></rect>				<text x="4" y="500.8" class="st10" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>LAN</text>				</g>		</g>		<g id="group44-54" transform="translate(0.499978,-32)" v:mid="44" v:groupcontext="group">			<title>Sheet.44</title>			<g id="shape25-55" v:mid="25" v:groupcontext="shape" transform="translate(0,1003.78) scale(1,-1)">				<title>Sheet.25</title>				<path d="M2.09 506 L2.45 506 L34 506" class="st8"></path>			</g>			<g id="shape32-60" v:mid="32" v:groupcontext="shape" transform="translate(37.98,0)">				<title>Sheet.32</title>				<desc>HDMI</desc>				<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>				<v:textrect cx="20" cy="496" width="40.01" height="20"></v:textrect>				<rect x="0" y="486" width="40" height="20" class="st6"></rect>				<text x="4" y="500.8" class="st10" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>HDMI</text>				</g>		</g>		<g id="group45-63" transform="translate(3.19744E-14,-16)" v:mid="45" v:groupcontext="group">			<title>Sheet.45</title>			<g id="shape26-64" v:mid="26" v:groupcontext="shape" transform="translate(6.39488E-14,1002) scale(1,-1)">				<title>Sheet.26</title>				<path d="M2.09 506 L2.45 506 L34 506" class="st8"></path>			</g>			<g id="shape34-69" v:mid="34" v:groupcontext="shape" transform="translate(37.98,0)">				<title>Sheet.34</title>				<desc>Audio</desc>				<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>				<v:textrect cx="49.51" cy="496" width="99.02" height="20"></v:textrect>				<rect x="0" y="486" width="99.02" height="20" class="st6"></rect>				<text x="4" y="500.8" class="st10" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>Audio</text>				</g>		</g>		<g id="group46-72" transform="translate(0.499978,0)" v:mid="46" v:groupcontext="group">			<title>Sheet.46</title>			<g id="shape27-73" v:mid="27" v:groupcontext="shape" transform="translate(0,1002) scale(1,-1)">				<title>Sheet.27</title>				<path d="M2.09 506 L2.45 506 L34 506" class="st8"></path>			</g>			<g id="shape33-78" v:mid="33" v:groupcontext="shape" transform="translate(37.98,0)">				<title>Sheet.33</title>				<desc>Serial port</desc>				<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>				<v:textrect cx="49.51" cy="496" width="99.02" height="20"></v:textrect>				<rect x="0" y="486" width="99.02" height="20" class="st6"></rect>				<text x="4" y="500.8" class="st10" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>Serial port</text>				</g>		</g>	</g>	<g id="shape49-81" v:mid="49" v:groupcontext="shape" transform="translate(146.12,-130)">		<title>Sheet.49</title>		<desc>AI appliance box</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="74.4402" cy="496" width="148.89" height="20"></v:textrect>		<rect x="0" y="486" width="148.88" height="20" class="st6"></rect>		<text x="15.67" y="500.8" class="st11" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>AI appliance box</text>		</g>	<g id="shape51-84" v:mid="51" v:groupcontext="shape" transform="translate(149.567,-265)">		<title>Sheet.51</title>		<desc>Linux</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="72" cy="482" width="144" height="48"></v:textrect>		<rect x="0" y="458" width="144" height="48" rx="8" ry="8" class="st12"></rect>		<text x="52.96" y="486.8" class="st13" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Linux</text>		</g>	<g id="shape52-87" v:mid="52" v:groupcontext="shape" transform="translate(149.567,-321.667)">		<title>Sheet.52</title>		<desc>Cloud AI SDK</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="72" cy="482" width="144" height="48"></v:textrect>		<rect x="0" y="458" width="144" height="48" rx="8" ry="8" class="st14"></rect>		<text x="25" y="486.8" class="st13" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Cloud AI SDK</text>		</g>	<g id="shape54-90" v:mid="54" v:groupcontext="shape" transform="translate(149.567,-378.333)">		<title>Sheet.54</title>		<desc>Inference Suite</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="72" cy="482" width="144" height="48"></v:textrect>		<rect x="0" y="458" width="144" height="48" rx="8" ry="8" class="st2"></rect>		<text x="18.68" y="486.8" class="st3" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Inference Suite</text>		</g>	<g id="shape11-93" v:mid="11" v:groupcontext="shape" transform="translate(509.471,645) rotate(180)">		<title>Sheet.11</title>		<path d="M10.2 506 L10.56 506 L175.23 506" class="st15"></path>	</g>	<g id="shape65-102" v:mid="65" v:groupcontext="shape" transform="translate(522.125,-236)">		<title>Sheet.65</title>		<rect x="0" y="310.933" width="184" height="195.067" rx="8" ry="8" class="st1"></rect>	</g>	<g id="shape66-104" v:mid="66" v:groupcontext="shape" transform="translate(516.125,-242.967)">		<title>Sheet.66</title>		<rect x="0" y="310.933" width="184" height="195.067" rx="8" ry="8" class="st1"></rect>	</g>	<g id="shape67-106" v:mid="67" v:groupcontext="shape" transform="translate(509.125,-249.933)">		<title>Sheet.67</title>		<rect x="0" y="310.933" width="184" height="195.067" rx="8" ry="8" class="st1"></rect>	</g>	<g id="shape69-108" v:mid="69" v:groupcontext="shape" transform="translate(551.615,-425)">		<title>Sheet.69</title>		<desc>AI application</desc>		<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>		<v:textrect cx="54.1925" cy="496" width="108.39" height="20"></v:textrect>		<rect x="0" y="486" width="108.385" height="20" class="st6"></rect>		<text x="4" y="504.4" class="st11" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>AI application</text>		</g>	<g id="group87-111" transform="translate(532,-262.5)" v:mid="87" v:groupcontext="group">		<title>Sheet.87</title>		<g id="shape68-112" v:mid="68" v:groupcontext="shape">			<title>Sheet.68</title>			<desc>Inference Suite SDK</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="72" cy="482" width="144" height="48"></v:textrect>			<rect x="0" y="458" width="144" height="48" rx="8" ry="8" class="st2"></rect>			<text x="18.68" y="477.2" class="st3" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Inference Suite <tspan x="56.99" dy="1.2em" class="st4">SDK</tspan></text>			</g>		<g id="shape84-116" v:mid="84" v:groupcontext="shape" transform="translate(0,-54.5)">			<title>Sheet.84</title>			<desc>Third party</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="72" cy="482" width="144" height="48"></v:textrect>			<rect x="0" y="458" width="144" height="48" rx="8" ry="8" class="st17"></rect>			<text x="33.73" y="486.8" class="st3" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Third party</text>			</g>		<g id="shape85-119" v:mid="85" v:groupcontext="shape" transform="translate(0,-109)">			<title>Sheet.85</title>			<desc>Open source</desc>			<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>			<v:textrect cx="72" cy="482" width="144" height="48"></v:textrect>			<rect x="0" y="458" width="144" height="48" rx="8" ry="8" class="st12"></rect>			<text x="27.15" y="486.8" class="st13" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Open source</text>			</g>	</g>	<g id="group93-122" transform="translate(466.5,-56)" v:mid="93" v:groupcontext="group">		<title>Sheet.93</title>		<g id="group90-123" v:mid="90" v:groupcontext="group">			<title>Sheet.90</title>			<g id="shape17-124" v:mid="17" v:groupcontext="shape" transform="translate(16,0)">				<title>Sheet.17</title>				<desc>Qualcomm</desc>				<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>				<v:textrect cx="34.56" cy="496" width="69.12" height="20"></v:textrect>				<rect x="0" y="486" width="69.12" height="20" class="st6"></rect>				<text x="4" y="499.6" class="st7" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>Qualcomm</text>				</g>			<g id="shape19-127" v:mid="19" v:groupcontext="shape" transform="translate(1.4988E-14,-2)">				<title>Sheet.19</title>				<rect x="0" y="490" width="16" height="16" class="st2"></rect>			</g>		</g>		<g id="group91-129" transform="translate(86.36,0)" v:mid="91" v:groupcontext="group">			<title>Sheet.91</title>			<g id="shape16-130" v:mid="16" v:groupcontext="shape" transform="translate(16,0)">				<title>Sheet.16</title>				<desc>Open source</desc>				<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>				<v:textrect cx="38.28" cy="496" width="76.56" height="20"></v:textrect>				<rect x="0" y="486" width="76.56" height="20" class="st6"></rect>				<text x="4" y="499.6" class="st7" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>Open source</text>				</g>			<g id="shape18-133" v:mid="18" v:groupcontext="shape" transform="translate(-1.39888E-14,-2)">				<title>Sheet.18</title>				<rect x="0" y="490" width="16" height="16" class="st18"></rect>			</g>		</g>		<g id="group92-135" transform="translate(180.16,0)" v:mid="92" v:groupcontext="group">			<title>Sheet.92</title>			<g id="shape88-136" v:mid="88" v:groupcontext="shape" transform="translate(-1.39888E-14,-2)">				<title>Sheet.88</title>				<rect x="0" y="490" width="16" height="16" class="st17"></rect>			</g>			<g id="shape89-138" v:mid="89" v:groupcontext="shape" transform="translate(15.72,0)">				<title>Sheet.89</title>				<desc>Third party</desc>				<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>				<v:textrect cx="34.56" cy="496" width="69.12" height="20"></v:textrect>				<rect x="0" y="486" width="69.12" height="20" class="st6"></rect>				<text x="4" y="499.6" class="st7" v:langid="1033"><v:paragraph></v:paragraph><v:tablist></v:tablist>Third party</text>				</g>		</g>	</g></g>
</svg>

**Dragonwing AI On-Prem Appliance components**

When fully configured the AI appliance box should meet the following prerequisites for optimal performance.

- CPU: Server grade x86 or ARM multi-core CPU
- RAM: Minimum 96 GB. Required for the compilation of large models and corresponding configurations like batch size and context length.
- Storage: Minimum 1TB (recommend 4TB). Requires large storage to store multiple models, associated artifacts, and serialized engines.

See the [manufacturer’s documentation](https://www.aetina.com/wp-content/uploads/2025/other/Aetina_AI%20On%20Prem%20QSG.pdf?0814) ![devhw](data:image/png;base64,UklGRt4AAABXRUJQVlA4TNIAAAAvD8ADED/BoG0jSe5SXP5I7gkNRG3byLnX4Tn+2K4I2raNw5/iqPxlEwBAGlwuj8BNBPpnsblrANx3P36s+DHQIcQ0dmEfEGPc8WEcCCcO/M2hXv3rDJTcHCTB1es7l9P2UoywA2a3jSW/pp77EhxGkq1E8zjH3R3e/fxjREOI6P8EcH+lqu/oTK/6kS+YwlHVAMjkP0ErP1UNIZZmnsB32Y2lZjNPO7HUUA1HkVWz73lAIiWM6WaegFcHzNOJ3bv89WhdNu1TDx/txhT2np2bzWU=) for additional information.

## Cloud AI accelerator card

You can configure the Dragonwing AI On-Prem Appliance with up to two Cloud AI 100 Ultra, Cloud AI 80 Ultra, or Cloud AI 100 Pro AI accelerator cards. The cards contain one or more Cloud AI 100 SoCs per card. The cards interface to the host using PCIe and to the BMC using SMBus/I2C. When combined with the host computer in the AI appliance box, the cards provide neural network inference acceleration within your own infrastructure. The following image shows the Cloud AI 100 Ultra.

![../../_images/cloud_AI_100_ultra.png](data:image/png;base64,UklGRpYYAABXRUJQVlA4IIoYAABQpgCdASrdAZ4BPwF+tlYrKCSjozL52WAgCWdu/HyXY0YDSqIHHN/lV5l/5Oan9t3MfVDzWvxA+EnPt+fZfUuQr+h/OT5Qfzeod+ry8mfrL74vZUPUZiX9KqC/0bvVNZtZJ+3+ob/Q/9LzPkA59XFGiuEs4dC4T8Fa+ACgCjcEf7+4ZGpq9K3NB8vofxkVpLKmOKNFcJZw6Fwn4DgJPD5SPiUrdmq5f//ra0Uz30aW2bSP16IO67heAx7Kvac/HPq4o0VWzQrqIj/hJlHVZEgW+pUWMjyvEdaRfaPGBJeP/UtPsU9SNyZGRObs6oE5w6Fwn4T8YMO4Q8ZnGN4glgKjGfDguVEh1EYcZ/TcuSG1+U3eJytZPAkAh+XEbcGnOHQgbeedeGdlZ3rlWk/quffLaL+3oyzva6W4TWZeX/9C/xPi+oJ+OfVxBenZlAds5vGEob1wsoRpu53azy7Mzr9xZPwkfIs6+Jf7Qz0nadDgGCc+tIXCfgZbfuGLSModqc+h9hx9fgoaGllLEt3eNhePIa0kPhCb5I9tWLIR6LKQLQWwYVQ319vNHxGd2giB1A/rFth56UbRggocHkc48FDKQqLnA26r1k/48QvXBVzmT9z3aUL4FfESJ9v7hJyE/8Bm4+F5uZvjoU6pScOeBT0k0pnBALMEb0y6s2iDqhodaHIqmhpFkHyKHChBXql9zWBLCvBJc/SZqdg31lELNBTUIdrPr/DMTgJzrBZ9a2EiI7S/OBHIeAK8EdU//qWQnJRwFVGEX2RS6XgoZOV6UdnQ8Z/kt2c6RWBSTBBGcDf/EtMZYGm32B6MmzXhdnwzfVPnLdTVi7UAQ6GN5xm6BUi6swzB3x78/jQIMSmKJfMAQK4YfhoEuwCIkmyMigoLaOclbUf/Z2eWlbL7WG9Ypxh6iPwTbCUJpt79+w72L/heopQdw7U1f16UyKer70F5b02KZqZf2KjzVOoosglaBsdXw4mEvwLEkGxlzFk7aBEDShYh1SVjtsRv4AD8KqUats7gt790HvLazNLgWRsrctaDF+qJATPrmX/6W8/fnD5hM63VcPwX8eVci1/DgEqsY7KZ28V/aSfPq6UPLOfWWORr//uV/9ve/jf4D5wN+Q/kS2iloYv7HZ18VXg37EuAokgWRmPLcRtEp/g2xC0mYfX5N//qaPwA4abo7/9AuflOcWTQ7//wiv8hk+b2sEYa3GVZw1Bqj1sur+RPiOf0E/AsZH/9Zlu9h27O63wML/2Sqg7Mxy+Zegc+NTcFkv9P+quKNDdW4UpGSdR9gXvKC4kH0lkf/uF8GXTn7/WlhUsUIqpg3g7WcP+xGgdhLOHQYMUjFiFxjJcsxtUqaYe0hd1Ff/ydjDjVV/YeDXF/UJ7Bt/vk3ks9DsqCMGt9/bOtaPd3pBZw6FwntI3V5OSovfH8peSdjD6QNb+BIvtQkTDsv//OMJvkH59jvu2K//bWr/LzQ+Jz6uKNFTkp8itEdMR94Aibbgs3X+XgUBkBLKrDp/31KT/+DHbzR/22j2g//7x8yxPN7YLhPxz5A077QD0nQ2TW9gSrnrMBhPQkrnPgp1+fue+BrZijA5vWP+/rT+yEn99x7Y51hXCWcOhcJMC9YyFhnEpp87HCbc9/+rt98GOhGa8nwnFGiuEs4dC4T2dZ73Zl+rhMcO/m1+Ufjn1pEGEkFnDoXCfgaMKv3SM2RofwDJfV2rQQYSQWcOhcJ+BLDiEx64bi2OCUE/H1sFnDoXCfjn1bbZUQZ35mnPYucOhcJ+OfVxRorg0AAP753cAAEZxPldYyI9doNbAsHAtivAsa+Q2njO0OD/Ono+nfDnV6jINKzPa8GeG45AbKPS4W1TOSzGnqMY5kxFRNlxQMaAfrxglyX/HcEbF7/uwfoIucQTSdQt3Bg5il947HWl7B425mesCZTm3Pea5AABJcYO765U3umCTqGBZYX4f+jIbibuDk/oT4zqLYahkR9DszFnrPuKAQXg+0t/J7y4cesIWZyKHAvxf8SCerd7g28xQvNixHyG8vAU45Ithnml/tHOabpDzET3m0X997xXts/xt45s9VnBw6vI9QFoFsCTzzC+F/PTF1hAhEHxpXgfAA8ej7oJyd7Hn2Hh6OPnwSzaaQH8shd3GVlUxNwHJD52AqaEtRoYHJFLYlI3rzmXIEPJo3tF83BsV41xwpHlqcJe6oN2FVk2ztl2wSuYkmTXBHRMPtELlkPduLr1S+LTTViHqFf1+oPx5cwwWK5eV0634+KvWbJoiYMfQzumlRuY8LSCwkHVXSuCJSya9Rd+c5KBFmdVMZPKwdLdam5kIGIXTxnakCOWoGJv6Cnw4bPXnQorAbt32Pku4AQuQSMLW45EHxKFMnH25f7uQItueD170jHaMwy/hUyA1Als3LkcO3smIX9nNf8vFv8kRE6YpWyEw7TiD8pdtAFh9WAeNogUbp2nrwr5XKyA4gNvDbmI+T1Oiny2g5Wc0U4LTQxlGxLiwBYmK9OFgI0VQGXhtFUbOgb6Jhk/PfFnhl45ioUqICX6PamkjWedDpvLAnvjr1H6U4LmZVrx+W9iTiyUeFTgyIzM/zWXxHbHsrx2QHN3g6cGZScVqmTWkhrA3IwFsQzgxHPcvSMq9gOsKYbkf9L0RN4mwOivvWeeDm77iZDSDfIEDWLeb/rLs+qDrfy7QbpUhUtN6jz4ZqNmM4JEtcwpUN5xrAGf1vYJawEUupeFb5w6XUcusB87Yn5ewS3N8dKhM5oWiq/PeycwfAdajaPJq152XCsI77aIjhHJFYz27LsXkM6bVbY5I7NwpQ7oX3oyjwCRnDPcL7CI1hW+QOJOmLMbaOFQ8sFjgyYFDiO9nHsEQO8Ybpc6siKphHsLXgJV16JU0f+B/si4vclwMarwu+ayJo+/6IInmtp1vaCkBJpQamt5gZPQoE2MpzwH/kf1f5trp1EyXsOIfmN1NBJDEWSvvjZqCW92xc5rYvv96ZK9LHbIDFY9nH8YhYn+xYWcpH9FlYDJr01WO/7D6a7rRfIsp9SDKV7Uuh3GBKI2QNn7VXFG2eTR0zY146d7tL+ccBr6WIRotazlnGzSq6QstA/l6K4vlH2dPV4PM13tzFScZX+ZhsCt1kc/M1Vr5QbS0Y6FumM5sgaoWW0WVjtk9KEHAurT8JpgKuAfobrr3ydzCzGaPx3uuh8KPvjSAOdOAXI1kuPf8fGWS8yYHqRLpAJc0GEXkg1TRHIriVcTlA6qYGdSQpyPxJFuKHuPOZZxhc3KTGuC3Z2Mpy0mRIypA91ZrnDQaXK1CzbqrQCHvd6s2X64PQrad47UTzJM6itKthSc7VH4450hiwbd985JVnuV1+jtqFjZd/J3Yv1mE1jiEQxIhxmF1DTvosac2ZgF0sxHTJLgIu2Xnu/4GG6fuP/ZQddtHir3j4Yml+ALIcjUuOTWPAfxZIxB+Fdg7jmouPPHES2anqVYfYxkyJ3TxXxMCh4nPqj4CYv3mOx64gOt8N3122y5j/3wX84xLYxUO1e/ZIr/JhaLKs6UX39LEAyDMzYMyVEYY6zs27nBVUbP691wwvDS/OqpbDjvhuCddn77dgr6gHI6no0zFNDiRkJHBRGFnN3/GLAXGof6gLQDi5ZX1+E0eEh8OKLWJjWovQOvoG7Cdiweqlg2/yvDJeC1GdtahbYLNGjNrKGLZl2fZCovesUrI5XkddUEBQ89IUNBTDQm+ZDrVYJQTHCJWz6E4kRMa7+WvnHyO6AhGx3Vz0GuvGm+Blvfa2ZD3RKaDnNrUKqk7Unaj2WC7cWMuU4Z+4BYrMAh2uxHKPmbqr9fPKGIreu3YHRehzASzTNX7ej1VMPDoVkFlhHt/87sT2mtszVnVT1pemy2Ryj+pN6bDn8mQzxplbvW6U2R/R34f/tUgBk9i0KHUG26l/UdqyZQWx11fhFEW5wVu5diziK9q+S6bXNdf8r0C9mCMWbEvDXVTVhQTl0rctWzWDYlM/FsTisjMpqE2kDx/NHU7I4ucN5siy2OA6IikcAo4WNCcYV8WRKyJD46MfwSOQrH4nnOQBjIfBxkqlGfgtK67enV0XbCuQl43hPPFTtLIxPB114mPEXB+H0fR3S/HV17uiq9H8mEPlw6JNr3Cj9m0zaK2NTLNF50v8W0WYymENtBUNKYnOwAbcjqHysNtqh/SW7vQEtPsla5x1Se1auExvtqeXY3nobL8NDfUDD0KE5Cg7o6EZMdGiEnilB+VggK9se2r+7Z9xikLJDDmrB2mrlVaG1HRkKXz5zcBbQxXkhj4BrLnvHyTTCfw3dFr98m8BTZcQnXFTaqOeMmPgzwFJ8C8IWem8cA8ZtQPNeVzi8FhOjUBRGN35qs2k8Gj+JzBlNf6QAwFJ8LxNNhwZ0ivJgNPChM/o1YCIOmnPCAU120NghFh5Utm692FkYCbhA6BqpSuWGFYxBk0v0+oyA/bWC9jf7XBIXTZRJ8xHBvVServFpJsKE3VjzXR5n4Hoq8vjCNAUqktV9vBcI5H0aaZT64Ha3iBCjAb4ollyg6MG6VzRxKLODfB5rXDvn2MDXO3m4Ah814JjQLwBSmpFQhBzMVBfwumsPD5a2cu3FjINgSDZ0MR1JODeP89yW+rlXcaTadNYpEk15yGqYlhWItTL0rDM/eApDOcW86YmaAN8W08UVWzWj+6McJ7ke2GzA+BhYu889OoQsYpM9QnNuFl/eZqJTu5WrkYpHQzLWSqu9hICoWEGsnOY+gs1BOdbTfiw0dHMI0ARX8PqjxyVEgjgEMHETV1Qsl3B3N6VEECVeU7Q0obnlOyx5ELTrgBL7i+99hey+rqOdtTWmiz7adN6nNJK0CDp7zVs8XOIf9v28tagPctOSC+7YrVcsSHyeSB/7edVErTLVV6GUQZycDoOgMJ4eUdVwaahZ0XcbZ55ZTCQcy0ucKTXpLdwJdWWvqHW32lR2lVTG6noUSYEBt5SWKNvIffxBWIxtNVJUfBSd/7UV86bcHNejhUCbM2u1zGJ0TBQ0vULufQuAoFO93wsqyVMDhw9a2Wk7bGfJnnpICZ9MwoLdgQHumxQ2s4iotW91XwEgqKfVJxSMouEFRfzsgaJY+vyuDg68kZD8IfvX3G6T9rb1kWemlQNUEFOTfpnOkZT8P/cAVMmTyO1e2d2qc6aerAT2dHnpA4M14rKLDrZWR9eAbwf/qCobcIbLzaOG82HPcSAOCQsgbUMfWoO8rV5QEkuvI7+1b2IoFX68EVtzZwUdsj8/C/hA6E5G5iGjyHzaVXxkLKkQfncKH0MPfkzOyNu82gH+rPmGPvMJi7U0bw/J0w7oCqI+7UASB2nAsHN7gBJZpQexHpjY5MMg8i+H6bJrBSj96x8RjtVBPTyenR934me9JELapQXSqYpeF+kAGTAnNye+pq2JlHF2jPc295GWLNVct1sVLT1QtMTK65t4LhH0CUx+bFUhNJpAm8iK/pdRO1lEyZOh0cA9xvVJN31KjihMeVBnQQnSS0uHkNDZcpBjR63T+mRW361yLAfEM4br7DITn2BmTVDb1pCSK9UmGFdLjPn+/XG0kTFRnl2diALB7U7sKYVaucQHqiSH9DeV6m6ScSwtLV4ZinT5c/Z6lOUXOPvCMZdyfSLLDi8OWiIb4qmAh0Z4EcSDt2/4l5gsXAt5nheElfhy0+Xz4z4TUJ+IzESoQWakU7Fq0wo4RPtY8S5FOZ1Z/mAnxj/lg8TYAJG+cFy8bKI+O42KcGH3rd4t4ngn0aOofKN8OBxuckU+XZCrWsoruDTsJtr6YFm1/9C0+5sTkaJQogfABzCQu6HHd+faHgkOoIsRPmTbdpDfmL//wvVdPJn9no8uAoMQX4byv2kcqkCaMjHhNoTgFBf1ZLLvseYxkKwgx6qr6b+aQyZDiHpfkDH5OMnoeTdg2EbAYwVWXy3VkVC3k0xvcuUOWZCnZRvQKPMUFEq9al9RztatRm0n4DqgI8L/VdyFTKU76p4GUH9mnzXnmNuELmRU2i1Waj/gMJ8VPixlin7PHIoYJBCNvvhqjZ4Q1W76KARG5G+9ajuwbX14+2+0Xe7j1m8H1ixIe4NhOC/1FBSlb1HfLxYkSlvCQsbeAcj+EsJjVNcbUdxWcIKYnnIAa1trlEmQuRO7SV1sWta8hm+bLFoj22y9Z0nvQMuxtZhQKkTSP1lGOclfTSY0fQ0FrcM2LeEEEVqyVXjlADtLtroDi6HZmJqNTmlhhwtld+Om+Ua8W9OyEH2L14ZNgZGrbfLB6VuMcg8T+ib4H0AfUUBWGKGUyWirjIKoMvOyBFI/+2M4G+nN912SDtzA8Ip4zBY0nPlQR2ZauUTQl9/GznUL45R44Mgln2wDQC9m4QECIGQ5/oPyzBZtwOOy+Bdp7YxXrRLyiaDkVAA4IuahVS505P0/ncQyT4nRDhDi1A73O8cKrKiQNG4el+Z3vgOwINcKTRiG2q0lZ0Hv1Oe6msmS2c5ii5FoZCJ/VtxHOLch4z5S17PV4Dy+/2GOhdDMrZkv3y0Kpz2FfdozvcUd9drLC+APjxwf3sR4MHR+EsVqmO1ugxRwbCzn6irIihQ0NzQpVxV3x3LMRDEgf28xoJsyWvpCSp2WeRAWySbGSINEakqaOjXY+XRWyzsJ1wz7upA+MihhZGEfe6brGnLu9eAARAHVj2t1dZHUg/pFXsGtZt0SfJarHFGYVw6x5w6l1G+gNYyxOIW5Ln3iObOMB15rqcNGWfT06qnANJ/wVaXNz6EJkREdnQ6RL1XDvMeNFGcNoFUZ4llbbfskGpH8wzjC/OAmcZy1WH6W2X/oYXPZjFyATavdqH0jGSZJkn/QV5TL/F8X16hfKlJ6/MNuuV9c5mznC7tjfy8duP9jPZSzt4y6Nnv97CJaZw4bDM6nmlRhsCSAIHFOgIVCRHPDkdpSE739DfDMFncf1vjx6vfiTO1eCGb0xOR4+N3TeklW/jRPqMpVnynhuoqevJx3rhcpzi/e9LoAILFIzmvsByaYxiH/HGHMKCwe4Lgmp+fOr2L5Aq51xth2H+7dwuvz2DPjsRM88UmqrKqk2nekKmmk3prhtVwGdHTtaizCmHs81RGV6KdKc5pT/ModMQ+3Uib+bD7C0L7SIpVkIunBI5BKbkWZsg+NPOKdcILp4FR0uk5CH1Nsqkq+8Q5NtRwIqeeVk/U6aIdqltYAcOGNjGtGNiSCp6FQWhdxAiHYJfnFh9GjatYCalGeivInKpGRPobmji58UROrEuZ/HVCtMZ5986yADm6MZZgJA7CthXw8mkmzIzEBVsPwZHe6NbslBN7MnuizTIhghnuC2zue0iupNjlne++NU1li2DtT7eFNa+Re55daMefqFblNDqzWNcml8amskQpLe0mqncKripmCclqnRFS4863MzoWCYeux6w+s4OPzwPmemDAIvDwvnYxT/OYVF/9cMJ8HsI+xniz911D3fRQVAK2JzKMkziiTgAUlnTusCWtBPlbWYJcn/AlQJbc7d9h361/6GohXpfDfTdHVqp/7//zqFsY0djOzWCThzQNJbtQt7/0fEF7iBtsToVUcTg+ri5KFdEabGYXpg19EgQce0izHjkKMwKDIF6+ZySGj7lG3jZlqjUBDpurCBoiiig/V+GjPpaJxU8i+ObjHZ5JMaE2PRAjAhjrGU82MSVDikqgjOonkydeyb7Fk1PuxbIRn9n8motB/Lz8tabB6JNUgdm4rGktZHUuRqwns+uIQFK77+iiEJvuq0+VANPMIk2gAAYjC1usqwomak6ExxgTn1LeYYFow07nVQOuX/1x2hNftYmVWkTQQ6uwNjmwfEqjliUw1MW+lWCi0NOS6EYbl9n3uT29gJGBdLr6iCNKlR2aW3WvBQ8SGWZIpddoPIixel5xdvCOtrnK/8SX8WDXEw5n/6l+ID+tVrOl+PbXiCF8fO+sQXXTt/Y6CHZnjKFNBgP7H7XSgllkhozYul/TybVGN2M/wAIu53HFJuPEb31Zq/KIZNbjztY6k4ft2VjwNflkR5cMNUO0/OUyiUXX7GE+U2SP/fvkKw8KPOPblgABnXJqFxWXRpGl2fuLMe2jLoEwppCtzLUjgjiwclFlEDJi7Pq462zYWYCD9jYOoZnV48ag34KhduPBn7W5QlHlxDyjGgc9O9MCUrpjkUnT1GEiIIpNUSROjYAM70ig3vUI4GaN8UIAV+SnkJK/V89Fy2Xq1oZSrFKjRlCPVkWsXbn61FrSddeNgLquGCVrA5oA53LgBfull2ak7cU/e5yRY6ZaF07FPa9PyONvcAowgDNcHrXCHWfOiFfeer71ePODgQdLoWGAp/I4tpicAACE3UvsowDmXd4U9k/I3zIwvW/63hGvgAAAAAA=)

**Cloud AI 100 Ultra inference accelerator card**

The following table lists key hardware specifications for each card.

|  | **AI 100 Ultra** | **AI 80 Ultra** | **AI 100 Pro** |
| --- | --- | --- | --- |
| AI SoC Count | 4 | 4 | 1 |
| AI cores per SoC | 16 | 8 | 16 |
| AI cores per card | 64 | 32 | 16 |
| DDR Capacity | 128 GB | 128 GB | 32 GB |
| DDR BW | 548 GB/s | 548 GB/s | 137 GB/s |
| On-chip SRAM | 576 MB | 576 MB | 144 MB |
| FP16 | 290 TFLOPs | 222 TFLOPs | 125 TFLOPs |
| Int8 | 870 TOPs | 618 TOPs | 375 TOPs |
| Connection to host via PCIe | Gen4 x16 | Gen4 x16 | Gen4 x8 |
| TDP | 150 W | 150 W | 75 W |
| Form factor | PCIe FH3/4L | PCIe FH3/4L | PCIe HHHL |

For more information, see [Cloud AI 100](https://www.qualcomm.com/products/technology/processors/cloud-artificial-intelligence/cloud-ai-100).

## Cloud AI SDK

The Cloud AI SDK consists of the Application (Apps) SDK and the Platform SDK.

Use the Apps SDK to convert models and prepare runtime binaries for the AI appliance box. The Apps SDK contains model development tools, a parallelizing graph compiler, performance and integration tools, and code samples.

The Platform SDK provides driver support for the Cloud AI accelerator cards, APIs and tools for executing and debugging model binaries, and tools for card health, monitoring and telemetry.

For more information, see [Cloud AI SDK](https://docs.qualcomm.com/bundle/publicresource/topics/80-99100-3).

### Containers

Use containers for inferencing workloads using Docker, Kubernetes, and the Triton Inference Server. The Apps SDK includes scripts for building your own Docker image, Kubernetes plugins, and scripts for generating Triton Docker images See [Containers](https://docs.qualcomm.com/bundle/publicresource/topics/80-99100-3/index_Docker.html) in the Qualcomm Cloud AI documentation for more information.

## AI Inference Suite SDK

The AI Inference Suite SDK is a comprehensive toolkit for developing Generative AI applications. Within the AI On-Prem Appliance, its primary use is to facilitate text generation, translation, and tool calling. For more information, see [Qualcomm AI Inference Suite SDK User Guide](https://docs.qualcomm.com/bundle/publicresource/topics/80-88545-1/getting-started.html).

## AI Inference Suite

The AI appliance box uses services, accelerator runtimes, and tools from the AI Inference Suite for the following key features:

- One-click deployment: Deploy AI models and applications with minimal infrastructure management.
- Support for various AI models: Supports general AI, computer vision, and natural language processing models.
- High-performance inference accelerators: Maximizes performance and cost efficiency with powerful accelerators and embedded optimization techniques.
- OpenAI compatibility: Provides APIs compatible with OpenAI standards.
- Multi-tenancy support: Supports multiple tenants, ensuring secure and isolated environments for different users.
- Ready-to-use applications: Includes ready-to-use applications such as chatbots, AI agents, and retrieval-augmented generation (RAG) to accelerate generative AI development.

For evaluation purposes, you can deploy the AI On-Prem Appliance with a single appliance box without the AI Inference Suite. However, to avoid scaling issues and to take full advantage of the solution, the AI Inference Suite is essential. For more information, see [Qualcomm® AI Inference Suite](https://www.qualcomm.com/developer/software/qualcomm-ai-inference-suite).

## Next steps

- [Connect to the appliance box](https://docs.qualcomm.com/doc/80-92111-1/topic/connect.html#connect).
- [Download and install the Cloud AI SDKs](https://docs.qualcomm.com/doc/80-92111-1/topic/references.html#download).
- [Models, workflows, and system management](https://docs.qualcomm.com/doc/80-92111-1/topic/models-and-workflows.html#deploy-models)

Last Published: May 13, 2026

[Previous Topic
Appliance setup overview](https://docs.qualcomm.com/bundle/publicresource/80-92111-1/topics/appliance-setup-overview.md) [Next Topic
Connect to the appliance box](https://docs.qualcomm.com/bundle/publicresource/80-92111-1/topics/connect.md)