hrnet_pose.json
hrnet_settings.json
Captures the live stream from camera.
Uses tee to split the stream for inferencing.
Captures the video stream using filesrc, followed by qtdemux, which demultiplexes the stream.
Uses tee to split the stream for inferencing.
Captures the RTSP stream using rtspsrc, followed by rtph264depay for video extraction.
Uses tee to split the stream for inferencing.
Receives the video stream on its sink pad.
Performs the following preprocessing on the stream data. This preprocessing is done when the model expects floating-point values as input.
Color conversion
Scaling (up or down)
Normalization
After the inference runtime receives the tensor stream on its sink pad, it runs the inference.
Produces a tensor stream with the inference results on its source pad.
qtimlpostprocess for detection use case:
Applies a threshold to the chosen number of results.
Loads the YOLOv8 module.
Produces video frames with only bounding boxes that can be overlaid on objects, sending them to the sink pad of the qtivcomposer.
qtimlpostprocess for classification use case:
Applies the threshold to the chosen number of results.
Loads the MobileNet-softmax module.
Produces results as video frames with classification labels, sending them to the sink pad of the qtivcomposer.
qtimlpostprocess for pose estimation use case:
Applies the threshold to the chosen number of results.
Loads the corresponding modules for various pose estimation models. For the use cases described in this section, qtimlpostprocess loads the HRNet module.
Produces results as video frames with poses drawn, sending them to the sink pad of the qtivcomposer.
qtimlpostprocess for segmentation use case: Converts the inference tensors that it receives on its sink pad into video formats that the multimedia plugins for further processing.
Composes frames with contents from its sink pads.
Pushes the GStreamer buffers containing these composed frames to its source pad.
Waylandsink submits the video stream received on its sink pad to Weston.
Weston renders the video stream on a local display.
camera: Primary (0) or secondary (1).
file-path: The directory path to the video file.
rtsp-ip-port: The address of the RTSP stream: rtsp://<ip>:<port>/<stream>
detection-model: The path to the detection model.
detection-labels: The path to the detection label.
pose-model: The path to the pose model.
pose-labels: The path to the pose labels.
segmentation-model: The path to the segmentation model.
segmentation-labels: The path to the segmentation labels.
classification-model: The path to the classification model.
classification-labels: The path to the classification labels.