# Parallel inferencing
Source: [https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-parallel-inference.html](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-parallel-inference.html)
The **gst-ai-parallel-inference** application allows you to perform object
detection, object classification, pose detection, and image segmentation on an input stream
from different sources such as a camera, a file, or an RTSP network. The use cases implement
the LiteRT models for object detection, image segmentation, classification, and pose
detection.
Note: This
application isn't supported on IQ-8275.
The following figure shows the pipeline, which receives input streams
from a camera, file, or an RTSP stream, performs the parallel inferencing for the four
use cases, and displays the results side by side on the screen.
For information about the plugins used in the pipeline flow, see [Pipeline flow](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-parallel-inference.html#gst-ai-parallel-inference__section_gcg_r3s_lbc).
Figure : gst-ai-parallel-inference pipeline
## Sample model and label files
Table : Sample model and label files for gst-ai-parallel-inference
| Application | Model files | Label files |
| --- | --- | --- |
| Object detection | yolox_quantized.tflite | yolox.labels |
| Pose estimation | hrnet_pose_quantized.tflite | hrnet_pose.labels |
| Segmentation | deeplabv3_plus_mobilenet_quantized.tflite | deeplabv3_resnet50.labels |
| Classification | inception_v3_quantized.tflite | classification.labels |
## Run the application on the target device
Note: The commands in this section are targeted for the sample
applications based on QLI GA 1.5 (PPA version 05900 in Ubuntu) or later releases.
Run the `apt-cache policy gstreamer1.0-qcom-sample-apps` command to
check your QIM version. If you are using sample applications from older versions,
run the application with the `--help` option for more
instructions.
For sample model and label files, see [Sample model and label files](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-parallel-inference.html#gst-ai-parallel-inference__section_pnn_hmb_4dc).
The sample application uses the
/etc/configs/config-parallel-inference.json file to read
the input parameters.
To create your own config JSON file, use [config-parallel-inference.json](https://git.codelinaro.org/clo/le/platform/vendor/qcom-opensource/gst-plugins-qti-oss/-/blob/imsdk.lnx.2.0.0.r2-rel/gst-sample-apps/gst-ai-parallel-inference/config-parallel-inference.json) as a
reference.
1. Ensure that you complete the [Prerequisites](https://docs.qualcomm.com/doc/80-70020-50/topic/download-model-and-label-files.html).
2. Update the config JSON file based on the model, input stream, and other
properties. For more information, see [Config JSON field description](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-parallel-inference.html#gst-ai-parallel-inference__section_hwy_xqm_nfc).
For QCS6490, if
`file-path` and `rtsp-ip-port` are
*not* present in the configuration file, then the camera input is
selected.
3. Use the following format of the
config-parallel-inference.json
file:
{
"camera": "",
"file-path": "",
"rtsp-ip-port": "",
"detection-model": "",
"detection-labels": "",
"detection-constants": "",
"pose-model": ""
"pose-labels": ""
"pose-constants": ""
"segmentation-model": ""
"segmentation-labels": ""
"segmentation-constants": ""
"classification-model": ""
"classification-labels": ""
"classification-constants": ""
}Copy to clipboard
For example, run the application using
the custom video input file, model and label paths, and
constants:
{
"file-path": "/etc/media/video.mp4",
"detection-model": "/etc/models/yolox_quantized.tflite",
"detection-labels": "/etc/labels/yolox.labels",
"detection-constants": "YOLOx,q-offsets=<38.0, 0.0, 0.0>,q-scales=<3.6124823093414307, 0.003626860911026597, 1.0>;",
"pose-model": "/etc/models/hrnet_pose_quantized.tflite",
"pose-labels": "/etc/labels/hrnet_pose.labels",
"pose-constants": "Posenet,q-offsets=<8.0>,q-scales=<0.0040499246679246426>;",
"segmentation-model": "/etc/models/deeplabv3_plus_mobilenet_quantized.tflite",
"segmentation-labels": "/etc/labels/deeplabv3_resnet50.labels",
"segmentation-constants": "deeplab,q-offsets=<0.0>,q-scales=<1.0>;",
"classification-model": "/etc/models/inception_v3_quantized.tflite",
"classification-labels": "/etc/labels/classification.labels",
"classification-constants": "Inceptionv3,q-offsets=<38.0>,q-scales=<0.17039915919303894>;"
}Copy to clipboard
4. Run the gst-ai-daisychain-detection-classification
application:
gst-ai-parallel-inference --config-file=/etc/configs/config-parallel-inference.jsonCopy to clipboard
5. To display the available help options, run the following command in the SSH
shell:
gst-ai-parallel-inference -hCopy to clipboard
6. To stop the use case, use CTRL +
C.
## Expected output
After performing the four parallel inferences, the results are displayed side by side
on the screen.
Figure : Expected output for gst-ai-parallel-inference application
## Pipeline flow
The following table lists the plugins used in the parallel inference
pipeline:| Plugin | Description |
| --- | --- |
| Camera source:[qtiqmmfsrc](https://docs.qualcomm.com/doc/80-70020-50/topic/qtiqmmfsrc.html) |
Captures the live stream from camera.
Uses tee to split the stream for inferencing.
|
| File source: filesrc |
Captures the video stream using filesrc, followed by qtdemux, which demultiplexes the stream.
Uses tee to split the stream for inferencing.
|
| RTSP source: rtspsrc |
Captures the RTSP stream using rtspsrc, followed by rtph264depay for video extraction.
Uses tee to split the stream for inferencing.
|
| h264parse | Parses the H.264 video. |
| [v4l2h264dec](https://docs.qualcomm.com/doc/80-70020-50/topic/v4l2h264dec.html) | Decodes the video |
| [qtimlvconverter](https://docs.qualcomm.com/doc/80-70020-50/topic/qtimlvconverter.html) |
Receives the video stream on its sink pad.
Performs the following preprocessing on the stream data. This preprocessing is done when the model expects floating-point values as input.
Color conversion
Scaling (up or down)
Normalization
The tensor stream is used for inferencing in the later stages of the pipeline. |
| [qtimltflite](https://docs.qualcomm.com/doc/80-70020-50/topic/qtimltflite.html) |
After the inference runtime receives the tensor stream on its sink pad, it runs the inference.
Produces a tensor stream with the inference results on its source pad.
|
| Postprocessing plugins | Handles the inference results from any object detection, classification, pose detection, and segmentation model.
Applies the threshold to the chosen number of results.
Loads the corresponding modules for various pose estimation models. For the use cases described in this section, qtimlvpose loads the PoseNet module.
Produces results as video frames with poses drawn, sending them to the sink pad of the qtivcomposer.
qtimlvsegmentation: Converts the inference tensors that it receives on its sink pad into video formats that the multimedia plugins for further processing.
Waylandsink submits the video stream received on its sink pad to Weston.
Weston renders the video stream on a local display.
|
## Config JSON field description
The different parameters available to configure the JSON file and run the use case
are as follows:
Table : Field description–config-parallel-inference.json file
| Field | Values/description |
| :--- | :--- |
| **Input source** | Use one of the following input sources:
camera: Primary (0) or secondary (1).
file-path: The directory path to the video file.
rtsp-ip-port: The address of the RTSP stream: rtsp://<ip>:<port>/<stream>
|
| **Models and labels** |
detection-model: The path to the detection model.
detection-labels: The path to the detection label.
detection-constants: The LiteRT detection model constants.
pose-model: The path to the pose model.
pose-labels: The path to the pose labels.
pose-constants: The LiteRT pose model constants.
segmentation-model: The path to the segmentation model.
segmentation-labels: The path to the segmentation labels.
segmentation-constants: The LiteRT segmentation model constants.
classification-model: The path to the classification model.
classification-labels: The path to the classification labels.
classification-constants: The LiteRT classification model constants.
|
## Known issues
- Identifies only one person pose even if multiple people are present in the
frame.
- Inception V3 model doesn't include people class. This model is trained on an
Imagenet dataset and is used in classification.
## Related information
- [Parallel inference using Python](https://docs.qualcomm.com/doc/80-70020-50/topic/parallel-inference-using-python.html)
- [Image classification](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-classification.html)
- [Object detection](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-object-detection.html)
- [Pose detection](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-pose-detection.html)
- [Image segmentation](https://docs.qualcomm.com/doc/80-70020-50/topic/gst-ai-segmentation.html)
**Parent Topic:** [Run AI/ML sample applications](https://docs.qualcomm.com/doc/80-70020-50/topic/ai-ml-sample-applications.html)
Last Published: Jan 30, 2026
[Previous Topic
Image segmentation using Python with container](https://docs.qualcomm.com/bundle/publicresource/80-70020-50/topics/image-segmentation-using-python.md) [Next Topic
Multi input/output object detection](https://docs.qualcomm.com/bundle/publicresource/80-70020-50/topics/gst-ai-multi-input-output-object-detection.md)