# 概述

Source: [https://docs.qualcomm.com/doc/80-70015-54SC/topic/tflite-landing-page.html](https://docs.qualcomm.com/doc/80-70015-54SC/topic/tflite-landing-page.html)

TensorFlow Lite 是一个专为设备推理而设计的开源深度学习框架。TensorFlow 框架提供了工具和 API，用于将标准的预训练 TensorFlow 模型从 SavedModel 或 Keras 格式转换为 TensorFlow Lite 格式。

本指南介绍了可用的 delegate 以及使用 Qualcomm 软件堆栈执行 TensorFlow Lite 模型的和方法，其中介绍了如何进行以下操作：

- 使用基于 Gstreamer 的 Qualcomm^®^ Intelligent Multimedia SDK (IM SDK) 或原生 TensorFlow Lite 应用程序运行 TensorFlow Lite 模型。
- 将 TensorFlow 模型转换为 TensorFlow Lite 模型，并针对设备推理进行优化。
- 使用 delegate 在硬件加速器（如 CPU、GPU 和 Qualcomm^®^ Hexagon™ Tensor Processor）上执行 TensorFlow Lite 模型。
- 对 TensorFlow Lite 模型进行基准测试。

运行 TensorFlow Lite 模型

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-1 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [使用基于 Gstreamer 的 IM SDK](https://docs.qualcomm.com/doc/80-70015-54SC/topic/getting-started.html#run-a-tensorflow-lite-model-using-the-gstreamer-based-qim-sdk)

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-4 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [使用原生 TensorFlow Lite 示例程序](https://docs.qualcomm.com/doc/80-70015-54SC/topic/getting-started.html#run-a-tensorflow-lite-model-using-a-native-tensorflow-lite-sample-application)

TensorFlow Lite 开发者工作流程

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-2 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [将 TensorFlow 模型转换为 TensorFlow Lite 模型](https://docs.qualcomm.com/doc/80-70015-54SC/topic/tensorflow-lite-developer-workflow.html#convert-tensorflow-lite-models)

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-5 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [创建应用程序并运行推理](https://docs.qualcomm.com/doc/80-70015-54SC/topic/tensorflow-lite-developer-workflow.html#run-inference)

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-7 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [开发定制的应用程序](https://docs.qualcomm.com/doc/80-70015-54SC/topic/tensorflow-lite-developer-workflow.html#develop-a-custom-application-to-run-the-tensorflow-lite-model)

示例程序

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-3 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [下载模型和示例图像](https://docs.qualcomm.com/doc/80-70015-54SC/topic/sample-applications.html#download-models-and-sample-images)

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-6 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [使用可用的 delegate 运行 TensorFlow Lite 模型](https://docs.qualcomm.com/doc/80-70015-54SC/topic/sample-applications.html#label-image-tool)

<?xml version="1.0" encoding="UTF-8"?>

<svg id="Layer_1" data-name="Layer 1" xmlns="http://www.w3.org/2000/svg" width="21" height="18" viewbox="0 0 21 18">
  <defs>
    <style>.svg-8 .cls-1 { fill: none; stroke: #3253dc; stroke-linecap: round; stroke-linejoin: round; stroke-width: 1.5px }</style>
  </defs>
  <path class="cls-1" d="M4.7,9.4h11.7M16.4,9.4l-5.8-5.8M16.4,9.4l-5.8,5.8"></path>
</svg>
 [使用外部 delegate 运行 QNN delegate](https://docs.qualcomm.com/doc/80-70015-54SC/topic/sample-applications.html#run-qnn-delegate-using-the-external-delegate-interface)

Note: 可参见 Qualcomm^®^ Linux^®^ 上支持 [的硬件 SoC](https://docs.qualcomm.com/bundle/publicresource/topics/80-70015-115/soc.html)。

Last Published: Dec 04, 2024

[Next Topic
入门](https://docs.qualcomm.com/bundle/publicresource/80-70015-54SC/topics/getting-started.md)