# Architecture

Source: [https://docs.qualcomm.com/doc/80-70014-54/topic/arch.html](https://docs.qualcomm.com/doc/80-70014-54/topic/arch.html)

The TensorFlow Lite framework runs models on devices with low-power requirements,
        such as mobile, embedded, and edge platforms by optimizing them for latency, model size, and
        power consumption.

The framework runs models with the help of delegates. Delegates are software layers that
            use libraries written to execute a neural network model efficiently on a specific
            hardware.

Figure : TensorFlow Lite Runtime architecture
            
            <?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
<!-- Generated by Microsoft Visio, SVG Export qualcomm-tensorflow-lite-sdk-architecture.svg Page-1 -->
<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:ev="http://www.w3.org/2001/xml-events" xmlns:v="http://schemas.microsoft.com/visio/2003/SVGExtensions/" width="8.88542in" height="4.63542in" viewbox="0 0 639.75 333.75" xml:space="preserve" color-interpolation-filters="sRGB" class="st10"><v:documentproperties v:langid="1033" v:viewmarkup="false">	<v:userdefs>		<v:ud v:nameu="msvNoAutoConnect" v:val="VT0(1):26"></v:ud>	</v:userdefs></v:documentproperties>
<style>.svg-1 .st1 { fill: #f7f8fa; stroke: none; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1 }
.svg-1 .st2 { fill: none; stroke: #3253dc; stroke-width: 1 }
.svg-1 .st3 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1 }
.svg-1 .st4 { fill: #000000; font-family: Arial; font-size: 1.00001em }
.svg-1 .st5 { font-size: 1em }
.svg-1 .st6 { marker-end: url("#mrkr5-38"); stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1 }
.svg-1 .st7 { fill: #3253dc; fill-opacity: 1; stroke: #3253dc; stroke-opacity: 1; stroke-width: 0.28409090909091 }
.svg-1 .st8 { marker-end: url("#mrkr5-64"); stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1 }
.svg-1 .st9 { fill: none; stroke: none; stroke-linecap: round; stroke-linejoin: round; stroke-width: 0.75 }
.svg-1 .st10 { fill: none; fill-rule: evenodd; font-size: 12px; overflow: visible; stroke-linecap: square; stroke-miterlimit: 3 }</style>
<defs id="Markers">	<g id="lend5">		<path d="M 2 1 L 0 0 L 1.98117 -0.993387 C 1.67173 -0.364515 1.67301 0.372641 1.98465 1.00043 " style="stroke:none"></path>	</g>	<marker id="mrkr5-38" class="st7" v:arrowtype="5" v:arrowsize="2" v:setback="6.16" refx="-6.16" orient="auto" markerunits="strokeWidth" overflow="visible">		<use xlink:href="#lend5" transform="scale(-3.52,-3.52) "></use>	</marker>	<marker id="mrkr5-64" class="st7" v:arrowtype="5" v:arrowsize="2" v:setback="0" refx="-0" orient="auto" markerunits="strokeWidth" overflow="visible">		<use xlink:href="#lend5" transform="scale(-3.52,-3.52) "></use>	</marker></defs><g v:mid="0" v:index="1" v:groupcontext="foregroundPage">	<title>Page-1</title>	<v:pageproperties v:drawingscale="1" v:pagescale="1" v:drawingunits="19" v:shadowoffsetx="9" v:shadowoffsety="-9"></v:pageproperties>	<g id="shape19-1" v:mid="19" v:groupcontext="shape" transform="translate(18.375,-18.375)">		<title></title>		<rect x="0" y="36.75" width="603" height="297" class="st1"></rect>	</g>	<g id="shape1-3" v:mid="1" v:groupcontext="shape" transform="translate(140,-87.478)">		<title></title>		<rect x="0" y="171.75" width="360" height="162" class="st2"></rect>	</g>	<g id="shape2-5" v:mid="2" v:groupcontext="shape" transform="translate(203,-195.478)">		<title></title>		<desc>TensorFlow Lite Runtime</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="117" cy="315.75" width="234" height="36"></v:textrect>		<rect x="0" y="297.75" width="234" height="36" class="st3"></rect>		<text x="50.31" y="319.35" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>TensorFlow Lite Runtime</text>		</g>	<g id="shape3-8" v:mid="3" v:groupcontext="shape" transform="translate(243.5,-278.728)">		<title></title>		<desc>TensorFlow Lite model</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="76.5" cy="318" width="153.01" height="31.5"></v:textrect>		<rect x="0" y="302.25" width="153" height="31.5" class="st3"></rect>		<text x="15.81" y="321.6" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>TensorFlow Lite model</text>		</g>	<g id="shape4-11" v:mid="4" v:groupcontext="shape" transform="translate(23,-195.478)">		<title></title>		<desc>Input data</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="40.5" cy="315.75" width="81" height="36"></v:textrect>		<rect x="0" y="297.75" width="81" height="36" class="st3"></rect>		<text x="13.81" y="319.35" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Input data</text>		</g>	<g id="shape5-14" v:mid="5" v:groupcontext="shape" transform="translate(536,-195.478)">		<title></title>		<desc>Output result</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="40.5" cy="315.75" width="81" height="36"></v:textrect>		<rect x="0" y="297.75" width="81" height="36" class="st3"></rect>		<text x="6.15" y="319.35" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Output result</text>		</g>	<g id="shape6-17" v:mid="6" v:groupcontext="shape" transform="translate(156.875,-96.478)">		<title></title>		<desc>Delegates</desc>		<v:textblock v:margins="rect(4,4,4,4)" v:verticalalign="0"></v:textblock>		<v:textrect cx="163.125" cy="296.625" width="326.26" height="74.25"></v:textrect>		<rect x="0" y="259.5" width="326.25" height="74.25" class="st3"></rect>		<text x="136.11" y="274.3" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>Delegates</text>		</g>	<g id="shape7-20" v:mid="7" v:groupcontext="shape" transform="translate(167,-100.875)">		<title></title>		<desc>XNNPACK delegate for CPU</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="40.5" cy="309.562" width="81" height="48.375"></v:textrect>		<rect x="0" y="285.375" width="81" height="48.375" class="st3"></rect>		<text x="11.49" y="298.76" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>XNNPACK <tspan x="8.81" dy="1.2em" class="st5">delegate for </tspan><tspan x="27.83" dy="1.2em" class="st5">CPU</tspan></text>		</g>	<g id="shape8-25" v:mid="8" v:groupcontext="shape" transform="translate(279.375,-100.875)">		<title></title>		<desc>GPU delegate</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="40.5" cy="309.562" width="81" height="48.375"></v:textrect>		<rect x="0" y="285.375" width="81" height="48.375" class="st3"></rect>		<text x="27.5" y="305.96" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>GPU <tspan x="17.48" dy="1.2em" class="st5">delegate</tspan></text>		</g>	<g id="shape9-29" v:mid="9" v:groupcontext="shape" transform="translate(392,-100.875)">		<title></title>		<desc>QNN delegate</desc>		<v:textblock v:margins="rect(4,4,4,4)"></v:textblock>		<v:textrect cx="40.5" cy="309.562" width="81" height="48.375"></v:textrect>		<rect x="0" y="285.375" width="81" height="48.375" class="st3"></rect>		<text x="27.17" y="305.96" class="st4" v:langid="1033"><v:paragraph v:horizalign="1"></v:paragraph><v:tablist></v:tablist>QNN <tspan x="17.48" dy="1.2em" class="st5">delegate</tspan></text>		</g>	<g id="shape12-33" v:mid="12" v:groupcontext="shape" transform="translate(649.25,55.022) rotate(90)">		<title></title>		<path d="M0 333.75 L41.09 333.75" class="st6"></path>	</g>	<g id="shape13-39" v:mid="13" v:groupcontext="shape" transform="translate(550.25,138.272) rotate(90)">		<title></title>		<path d="M0 333.75 L18.59 333.75" class="st6"></path>	</g>	<g id="shape14-44" v:mid="14" v:groupcontext="shape" transform="translate(649.25,138.272) rotate(90)">		<title></title>		<path d="M0 333.75 L18.59 333.75" class="st6"></path>	</g>	<g id="shape15-49" v:mid="15" v:groupcontext="shape" transform="translate(757.25,138.272) rotate(90)">		<title></title>		<path d="M0 333.75 L18.59 333.75" class="st6"></path>	</g>	<g id="shape16-54" v:mid="16" v:groupcontext="shape" transform="translate(104,-213.478)">		<title></title>		<path d="M0 333.75 L29.84 333.75" class="st6"></path>	</g>	<g id="shape17-59" v:mid="17" v:groupcontext="shape" transform="translate(500,-211.228)">		<title></title>		<path d="M0 333.75 L31.5 333.75 L36 333.75" class="st8"></path>	</g>	<g id="shape20-65" v:mid="20" v:groupcontext="shape" transform="translate(171,-23.3126)">		<title></title>		<rect v:rectcontext="foreign" x="0" y="273.813" width="289.11" height="59.9374" class="st9"></rect>		<image x="0" y="273.813" width="289.11" height="59.9374" preserveaspectratio="none" xlink:href="data:image/png;base64,					iVBORw0KGgoAAAANSUhEUgAAAUgAAABECAIAAABswzurAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAAAJcEhZcwAADsMAAA7D					AcdvqGQAABJYSURBVHhe7Z3vixbXFcf3b8mrQsAXhYDQF0LAkheBgMUgNCUSMI3SIASJpAgSTCIBaQiCEBKKjUUSgnSxUcIWq7SiRQyt					KJUEXX//zmrWdf2RV/08+12/e3pmnmfXJ33qzPVZvgz33DPPzLnne8+de8/Mzozcu/+D8fd/3t708bUX3jj/zK/Gf/KLU43Cs6+dffPD					K6cv3I0Gl40hHc1B67iYDezrN+9jNzu9tOHCBztvfD52q2nAKmzDQtpg60vFkI7moKVcdAIb01dvvsRQtPfg5L++uUMzGAMe48jEqavA					JAz7yz8mKdMMN6A8mI6P/zTRZC64RNBbEAumo72h0QlsIp4q7BZPzDcaODJhEg2gbWOHOw0o+EIhOkYP3Go+F0xQ6foF0yEu2hgaI4y7					CKjFEKFPIbatUcBojBzdf4tmFLnAEx1/+PJmW7jAYMK7SDpaHRojhDvjEArFfZNNFzCSNrDF0UlVAERHu7hQoTw6Wh0aIywhsFu1KjQc					jKCMTJ+MTrBNqgIgOtrFBYUi6Wh1aIxg9N6Dk9QiqCD8+W/ff33yjsUN266+8bu5dRRLjn1HbltM2pPj05zjzvSsePHaPcSJ7x9I/GjX					dz975Yw9Rf2OPTfPXr5Xq+Ugu/bdOn5qWiLg1FrdldeTgOhIXDCzwgn2Z9WBuBcn12r51c6vbsKIRABx+NBi4g7tgaNdmeWHnCuKcEGh					SDpqQ0MdMvoTF238aG62cujYFLCYtEdOTBFZFr89V8Ps1s9mubty4/723ROeKSTt5NQDmI0roBgaIypR6wLg9Ig//eVpH5Rdn36xQyHg					fKjYwZEfteC518+h5awSl6/v5OLdPIzTwSVSj/jyxou1WmIeccmqMxKBrHeXKgw0Cha0deWydeep2fbFdxKTi9ZuuYy46p1LtVp6BuLS					NWclErdRCyJ39Fe0iO64idnFKzsJYfqiRLNQJB20qBoao/u/R4wdEhcBlbkC4S7gcTZqCWA8z889dIosIjaKZgdOEd/aerVWS39AXPHb					uVsSMTTqA1v2YRCjgmoYtn/z/mWVFdiA8aaqBYpkXCDxlbcvIjrOGXL47Xu/vy6RVqH1ZSFp1REZKSSCaL0riwGNggVtXSmCuzmQawJa					trVarg9otVYEVX9G7uiOkL5oxWlfBxKzz6/tDNnul2ahSDpoUTU0ah3o3qvAIQJ9RYxaoolZQDyaLoFjh2enA4k7XfO27Ji9RCetrnkE					l0QQQ6M+sAFjtkedKohtkCoNWsXRLdIez7SrYBjjyu/ZSBUcKuYtovWuLAZiIXHBZDv6MwHXEYcLdyBceFlUBYeKs7sEjlNdFsVCSTAL					iY7kzwSiprc2OhAieoQGgROXwwkKHF96gVjQtmtgNxbR+qQqAGKhXVzEQkkwC+2iQ9thYDcLYqFdXMRCSTAL7aJD2/rAZsLAYmD15kue					4MXsKFd/luwsJDyLiFqJS1ad4QQSWUWz8HBeUck9p21ZirNy2L57olZ75MTU4pXjXkCCaL0ri4FYiFyA97dfxwm4QmJykVbRvR3IESR+					e+4u2phxidwxh2TVt3z9Bc/VE7Nrt1yGWc/VzUKRdJiFSAcTaRwYOyRlJ4bx2/Nrz+HD6MCYFWdJjNaBg4rOn5hlLW0RbQocaw8cvQ2z					FkEMjfrAVoYAeCH9TMiOwqu03j9qAadHix0SlTDoltyjHpHOVKtVhsAiiNa7shjQKLyqrSuXruk40MGZXKR/AOh2WwHiEZ2Y/Xys82QS					kAgid8qKg9r7HYzyi1Z0krqQohqzUCQdtKgaGtUOiYvsXnEHPPZFLdGOM9H6toJ27na/A04RGUxrtfQHRMYRiSCGRn1gQ+Gmj6/FwYBh					O2ZHMYXj+nqetFxDqHHujSGH6LXIYTHOyT2uIezsRGvS4os3P7zihDCI1ruyGIiFyAVgnMVF7ivJRYeOTeEi36BKWoZmtO5J+JOrRPRn					4o6fQ303ZjkOVHq4NwtF0mEWIh3VDomLgMr4jbhwoCYtYFzAgc6ucRzo8OU9ccfwSlTj21otl320zqiDGBrDNXazIBbaxUUslASz0C46					tB0GdrMgFtrFRSyUBLPQLjq0bWJgMwOJN8mTGK13ZTEQC83hIt13TaJZKJIOs9AcOlh2ed5eFWNodA3s1ZsvOR9TFQeH9KRUEkG03pXF					QCxo68oN264uXjnuJEoSBwpOFI1Jolkokg63NDYZEAsx75DEweGjmWc0OV2tCGJoNC6wlbb1s7hJBNF6VxYDsaCtKx9jYON5jGF4rRXN					QpF0mAUXhBTJSRwcPtjZucHhW5VJBDE0mjgV33tw0k+hA7pRFKP1riwGYqE5XJwcn/Z91KpoFoqkwyw0hI47052HPnx3KYkghsYwedYs					iIV2cRELJcEstIsObYeB3SyIhXZxEQslwSy0iw5tuwY2C7l4Yz2Jg0N6guL0hc7jK17UgWi9K4uBWEhc6FlCPyWaxIEiPUHBqRH9H0Vm					oUg6zEKig1jACd3EwYFZ91tbr3ophM9Z3kfDYmh0Dez4LGFVHBy2zjwCCaK4eOXsQ3kgWu/KYkCjYEFbV6ZnCZM4UHAioLemEN4Sn+QX					LYD4lGhVHBz08PWzr82+M0PisnX1N4y6BjbXyZjrS+LgcOTE1NI1Z/3c3PFT07QkjojRelcWA7GQuEjPEiZxcLgz3fmnheXrLzhDQzeA					HecyzUKRdJiFRAdOAN3EwYFrNbHwyejsf/scOHp7yaoz8fHVGBrDNXazIBbaxUUslASz0C46tP2xgf3UU0+NPPx79933auv1Zy2qTz/9					o/cE+/66nx1iTQ9E65OqAIiF/rhYuvTncrX+/n3yG6sGRIdZKJIOs9AHHT28mmjyHzug7cHUvIih0X9g0284a7Qe8dVXf61ytWHeed6e					FB8grYrR+lhfBsTCo3IBovMBHqZGfQX0Tcfk1IP40GISzUKRdJiFPuiYt5MDdmC3WAN6MAUWHhpdA3verDgWpLFEoe6BJ9nHzoxVtarY					Zr0F0u/cTCKI1ruyGIgFbV05b1ackI5RLdjhoD86CGNWcc/MfOOmKgKzUCQdZiHRsZCseO9OLrADu8Ua0IMpvZbU50oiEAvadg1s+OuR					FVcMx8leQn89CXwy2nldrtPgSQTRelcWA7GgrSvnzYrjPY2n3dAfHVyc4Z1z6e5jEoFZKJIOWtQtNEA3UejdyQV2YLdYA3owtWnmo59O					gycRxNDoGthcn3tkxatWJiT74ry9d5u5LOzad8tv8EgiiNa7shiIhcRF76z4vFyAvuk4fqrz7QdYqBXNQpF0mIVEB7EQZ69JFPAqPqz+					xX1wO7vFGtCDKQZWhlS/USOJIIZGn2vshQT2TEPm/mxu7540L6L1SVUAxMKP4UKi/1Q5IDrMQpF0mIVHokNYiFfZgd1iDejB1LyIodFn					YHebirum2jDjx/QkEK1PqgIgFv4nXESvDogOs1AkHWbhkegQFuJVdmC3WAN6MDUvYmj0nzxj3s/sP9YATFdlD/uqP0R0C6/cuM/iwa9A					SyKI1ruyGIiFxMW8yTNcWk2eLTCwe9PBZC++3C6JZqFIOsxCouP/nDwzTl+4y4m8LE0iiKHRZ/IMyNDYJxC1ygc97NMP2UrUBcc7K1vm					bEQSQbTelcVALGjrynmTZyA6H8ir/Ensmw5OBEYffq0piWahSDpoUbfQiB0yicIgAlvZMr90JIkghkafyTOj03ce/sWLRg/7gBrpv7gn					ZtFlVz98L0QSVWPrXVkMxELiYoGPlOL/WYfO/EWv9k0HpNNr/eLrVe9ciqJZKJIOs5DoIBbi7DWJwiACe9+R24tWnCaea0UQQ6PPNfZj					RLQ+qQqAWGgXF7FQEsxCu+jQdhjYzYJYaBcXsVASzEK76NC2BYEdn2EE0fpYXwbEQmO5uDPdgUWzUCQdZqGxdPQIja6BPW9WfEBg/cYC					0q9oO3C0s5CIp47Wu7IYiIXExbxZ8cEBIqADb0tctu48a2x/k8QsFEmHWUh0LCQrPgjsPTj59ItzX5L/fOwW4paHX88GMTS6Bjb89c6K					Dwj0VyyhM0mkEyMOHymlxj6pzYoPCJwI6M0KXB/07a5hVhx0EweHNz+8giX+WBejCWJrXrRw8do9Ytt5VzoTYjQsWu/KYiAWEhcLzIoP					AsQwY6un32OHJzn78JHSOIVM4uBwcnyaWPAzpEQKl2s87x1iaAyTZ82CWGgXF7FQEsxCu+jQdhjYzYJYaBcXsVASzEK76NC2ccmz6zfv					79gz9z8rSQTRelcWA7GQuHiMyTPm3szG41Q8imahSDrMQqLjcSXPmHtv3z3hj+YnEcTQaGjybMnDb/okEUTrXVkMxIK2rnxcybMrN+5D					OufS65+TCMxCkXTQom6hEbNlSRwclDzzDaMkghgajUue6f6Wn4BNIojWu7IYiIXExWNMnuF5gtnGJNEsFEmHWUh0EAtx9prEwUH3t/x4					dRJBDI0mrrGZfsenIJIYrXdlMRALzeEC4P9uolkokg6z0Bw60kvOkhhDY5g8axbEQru4iIWSYBbaRYe2w8BuFsRCu7iIhZJgFtpFh7b1					gT059WDbF9+NHZ77YGrKiu/86qa/SACSdu/ByS07bkw8fJCVwyJ62pCSuifHpzd9fA1rarX86v3t15/wFy3IgZ4DVx2I1o95Vh3IatxH					4yCooj8jdyx54B1ya7WAdR3nepKz4nLgoWOzD1CBmBXHM/jfn0BKWoBv8bAdSKRs/WwuUsQdNRKPnJgiNBKz1lIPs4/2ooXRmZf+sjR3					Mj1mxb89dxct2Hdkdv+oBYtXdt5liR0Sl645i0gLJWIcopO6Su698vbsV/WTdviiBbBk5nPzDHASk4twHeICHbhjz03ERStOe5iI3Mmr					gEJVC6R9kh8p1Ut/cYsfv6Ns9zJiogW+QRu1QFrdViC89Ygux5Q2cffShguI3QKnnxctXLx2j2jkN7aeYdtZcQx6eeNFepvHkqgFb229					isWMRhKxG2sY7CWmpC6NZGf32qTFSvzyhL9ogYskTrA/k4u4PiB6IK86ENEOZFCG2XiPJHLHpeP5teeefe2swz4xS5mjPckvWjh+apoA					8zAKcBFQGb8RNTjQ89OoBelNFVzMEX2BTNwxKBMa23fPTo2Tll8hxulADI3hGrtZEAvt4iIWSoJZaBcd2g4Du1kQC+3iIhZKglloFx3a					dg1sVtde01fBTIPpeqo0mMDHJ92YuvvDq7VgZ6cTquBE0ZJovSuLgVhIXOCc+FBtFb21ONBLKsACqgezTCY9jayC40TezUKRdJiFRAcO					jP5MoDN7IVMFno8O5Dhez9ait5ZzRUtiaNQHNnHI5J6lgn8Ws6P0s8Urx9nB4Rq1gJUYR3OKZe2Wjrhjz2yuNaVtd37VSec4Q5C0LCSe					fvHUc6/P/g8qiNa7shjQKFjQ1pWskKlxrjW5iKUXWicpah3oNeGhY1Pyp0fSyB0dhd+ycuvGLItzfu6csFkokg6z4AKggAeWr59LUuAi					L3RxIN4jOhzbUQuWres8umcHchwO7jW2uHO6ZMuODrNOrSWtAieu9mNo1Ac2J0YEto8lPgapzIhOVMf9oxYoDY4dEpXc8+sUMQ6R9kvU					h/n92b2k5SCIVEoE0XpXFgMahVe1dSW9gRrHaq0DnR5LWoW9/zt/7PAkIvR5yI7cfX2y41XE46fmkrqRWcrs8CQ/K87wiohbJALKFvEb					WtAtK54cyLUT0XeOE3cvb+zc7/C4kLTUI5pZEENjhLPKaBcEzu2BBDBsx+woezrLDZKWQ9N+XxMYxjDdY0RK7jEz4VCenyQtB+FQHFAi					kN0YwNaVxUAsJC64fuJAz5+Ti3AsWpxcq+VXuDcuhRDjwRN3kN6Dd0Z8d0ogLigUSUe30OBS6bQ2wEXA4t6DnX+As5i0yYHE//bdEx5k					E3ewBlndeK8yG0Nj5IU3zmvAYPDwyNFk0BiZGu/gFQPR0S4uKBRJR6tDY4QZsrhxoeFgYo+p2iZVARAL7eIiFkqCWWgXHdqOMJHjws38					QYWG08M6k3mR0gZxdlQMxMKufZ0n/1rBBdM/zf3Ko6PVodH55ggWU3X6wl0xpBkI7WkUNMHAzj98eVPXtNiqkiA6Rvd3kjQN54K5H52+					YDraGxqzHxPi8o2C0Rfo4e2mAfMwkgEJ02kG/UmWFwnRMXrgVpO50LW6eDpaGhpzXwmT0as3X2rgmAQ8LNGGsqNaGNLRHLSRi//6/B8D					MG1gD40EjYLsxsJocNkY0tEctIyL+z/8B7ItkZ9CAU3DAAAAAElFTkSuQmCC"></image>		<rect v:rectcontext="foreign" x="0" y="273.813" width="289.11" height="59.9374" class="st9"></rect>	</g></g>
</svg>

- **[TensorFlow Lite Runtime](https://docs.qualcomm.com/doc/80-70014-54/topic/tensorflow-lite-runtime.html)**  

The TensorFlow Lite on-device inference loads the model into an interpreter, which         parses the model and uses a delegate to run it.
- **[Delegates](https://docs.qualcomm.com/doc/80-70014-54/topic/delegates.html)**  

Delegates help you offload the TensorFlow Lite graph execution to the CPU, GPU, and         Hexagon Tensor Processor hardware accelerators.

Last Published: Jul 12, 2024

[Previous Topic
Run a TensorFlow Lite model using a native TensorFlow Lite sample application](https://docs.qualcomm.com/bundle/publicresource/80-70014-54/topics/run-a-tensorflow-lite-model-using-a-native-tensorflow-lite-sample-application.md) [Next Topic
TensorFlow Lite Runtime](https://docs.qualcomm.com/bundle/publicresource/80-70014-54/topics/tensorflow-lite-runtime.md)