# LiteRT overview

Lite Runtime (LiteRT) is an open-source deep learning framework designed for on-device inference. The TensorFlow framework provides tools and APIs to convert a standard pretrained TensorFlow model from the SavedModel or Keras format into a LiteRT format.

Topics covered describe the available delegates and methods to run LiteRT models using the Qualcomm^®^ software stack, and explain how to:

- Run LiteRT models using the GStreamer-based Qualcomm^®^ Intelligent Multimedia SDK (Qualcomm IM SDK) or the native LiteRT application.
- Convert TensorFlow models to LiteRT models and optimize them for on-device inference.
- Run LiteRT models using a delegate on hardware accelerators, such as CPU, GPU, and the Qualcomm^®^ Hexagon^™^ Tensor Processor.
- Benchmark LiteRT models.

## Next steps

Run a LiteRT model

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Use the GStreamer-based Qualcomm IM SDK](https://docs.qualcomm.com/doc/80-70018-54/topic/getting-started.html#run-a-tensorflow-lite-model-using-the-gstreamer-based-qim-sdk)

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Use a native LiteRT sample application](https://docs.qualcomm.com/doc/80-70018-54/topic/getting-started.html#run-a-tensorflow-lite-model-using-a-native-tensorflow-lite-sample-application)

LiteRT developer workflow

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Convert a TensorFlow model to a LiteRT model](https://docs.qualcomm.com/doc/80-70018-54/topic/tensorflow-lite-developer-workflow.html#convert-tensorflow-lite-models)

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Create an application and run inference](https://docs.qualcomm.com/doc/80-70018-54/topic/tensorflow-lite-developer-workflow.html#run-inference)

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Develop a custom application](https://docs.qualcomm.com/doc/80-70018-54/topic/tensorflow-lite-developer-workflow.html#develop-a-custom-application-to-run-the-tensorflow-lite-model)

Sample applications

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Download models and sample images](https://docs.qualcomm.com/doc/80-70018-54/topic/sample-applications.html#download-models-and-sample-images)

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Run a LiteRT model using an available delegate](https://docs.qualcomm.com/doc/80-70018-54/topic/sample-applications.html#label-image-tool)

![ico1](data:image/png;base64,UklGRrQAAABXRUJQVlA4TKcAAAAvFEAEEMegILJtat8HCYTSP4QW1FATSVLUxxdBiAP8S1wUNZIUNYcw/GvgjQtSjAMAKJSx/2S9m8DmMQgAnnfZ2ltW+4k++hkbhjp+pglu6P/banJFRfo1K5J9yVvWjHrPy/ue38CgkSRFx8z35N/rsYH9iP6bTdumcub+gY545ib8VJHNFdiPz1RLy7DY3CdZj3jaX3fj0jyjIeJ4OrfXzgyoynAAAAA=) [Run a QNN delegate using an external delegate](https://docs.qualcomm.com/doc/80-70018-54/topic/sample-applications.html#run-qnn-delegate-using-the-external-delegate-interface)

Note

See [Hardware SoCs](https://docs.qualcomm.com/bundle/publicresource/topics/80-70018-115/soc.html) that are supported on Qualcomm^®^ Linux^®^.

Last Published: Apr 07, 2025

[Next Topic
Get started with LiteRT](https://docs.qualcomm.com/bundle/publicresource/80-70018-54/topics/getting-started.md)