# Pose estimation use case

Source: [https://docs.qualcomm.com/doc/80-88500-3/topic/pose_estimation_use_case.html](https://docs.qualcomm.com/doc/80-88500-3/topic/pose_estimation_use_case.html)

- Use cases
    - Single camera stream: 1080p with AI inference.
    - Single file stream: 720p with AI inference.
- Steps to execute the use cases
    - Display (variant 1): Use the `qtioverlay`plug-in to
                            apply the pose estimation overlay.
        - Camera source:
            - Linux
                                            Ubuntu:

                    export XDG_RUNTIME_DIR=/run/user/root && gst-launch-1.0 -e --gst-debug=2 qtiqmmfsrc name=camsrc ! video/x-raw\(memory:GBM\),format=NV12,width=1920,height=1080,framerate=30/1 ! queue ! tee name=split ! queue ! qtimetamux name=metamux ! queue ! qtioverlay ! queue ! waylandsink sync=false fullscreen=true split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! text/x-raw ! queue ! metamux.Copy to clipboard
            - Linux
                                            Embedded:

                    export WAYLAND_DISPLAY=wayland-1 && export WAYLAND_DISPLAY=wayland-1 && export XDG_RUNTIME_DIR=/run/user/root && gst-launch-1.0 -e --gst-debug=2 qtiqmmfsrc name=camsrc ! video/x-raw\(memory:GBM\),format=NV12,width=1920,height=1080,framerate=30/1 ! queue ! tee name=split ! queue ! qtimetamux name=metamux ! queue ! qtioverlay ! queue ! waylandsink sync=false fullscreen=true split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! text/x-raw ! queue ! metamux.Copy to clipboard
        - File source:

                export XDG_RUNTIME_DIR=/run/user/root && gst-launch-1.0 -e --gst-debug=2 filesrc location=/data/office.mp4 ! qtdemux ! queue ! h264parse ! qtic2vdec ! queue ! tee name=split ! queue ! qtimetamux name=metamux ! queue ! qtioverlay ! queue ! waylandsink sync=true fullscreen=true split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! text/x-raw ! queue ! metamux.Copy to clipboard
    - Display (variant 2): Use the `qtivcomposer`plug-in to
                            mix the original frame with the pose estimation mask.
        - Camera source:
            - Linux
                                            Ubuntu:

                    export XDG_RUNTIME_DIR=/run/user/root && gst-launch-1.0 -e --gst-debug=2 qtiqmmfsrc name=camsrc ! video/x-raw\(memory:GBM\),format=NV12,width=1920,height=1080,framerate=30/1 ! queue ! tee name=split ! queue ! qtivcomposer name=mixer sink_1::dimensions="<1920,1080>" ! queue ! waylandsink sync=false fullscreen=true split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! video/x-raw,format=BGRA,width=640,height=360 ! queue ! mixer.Copy to clipboard
            - Linux
                                            Embedded:

                    export WAYLAND_DISPLAY=wayland-1 && export XDG_RUNTIME_DIR=/run/user/root && gst-launch-1.0 -e --gst-debug=2 qtiqmmfsrc name=camsrc ! video/x-raw\(memory:GBM\),format=NV12,width=1920,height=1080,framerate=30/1 ! queue ! tee name=split ! queue ! qtivcomposer name=mixer sink_1::dimensions="<1920,1080>" ! queue ! waylandsink sync=false fullscreen=true split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! video/x-raw,format=BGRA,width=640,height=360 ! queue ! mixer.Copy to clipboard
        - Offline case:
            - Linux
                                            Ubuntu:

                    export XDG_RUNTIME_DIR=/run/user/root && gst-launch-1.0 -e --gst-debug=2 filesrc location=/data/office.mp4 ! qtdemux ! queue ! h264parse ! qtic2vdec ! queue ! tee name=split ! queue ! qtivcomposer name=mixer sink_1::dimensions="<1920,1080>" ! queue ! waylandsink sync=true fullscreen=true split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! video/x-raw,format=BGRA,width=640,height=360 ! queue ! mixer.Copy to clipboard
            - Linux
                                            Embedded:

                    export WAYLAND_DISPLAY=wayland-1 && export XDG_RUNTIME_DIR=/run/user/root && gst-launch-1.0 -e --gst-debug=2 filesrc location=/data/office.mp4 ! qtdemux ! queue ! h264parse ! qtic2vdec ! queue ! tee name=split ! queue ! qtivcomposer name=mixer sink_1::dimensions="<1920,1080>" ! queue ! waylandsink sync=true fullscreen=true split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! video/x-raw,format=BGRA,width=640,height=360 ! queue ! mixer.Copy to clipboard
    - Encode (variant 1): Use the `qtioverlay`plug-in to apply
                            the pose estimation overlay.
        - Camera source:

                gst-launch-1.0 -e --gst-debug=2 qtiqmmfsrc name=camsrc ! video/x-raw\(memory:GBM\),format=NV12,width=1920,height=1080,framerate=30/1 ! queue ! tee name=split ! queue ! qtimetamux name=metamux ! queue ! qtioverlay ! queue ! qtic2venc target-bitrate=6000000 ! h264parse ! queue ! mp4mux ! queue ! filesink location=/data/video.mp4 split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! text/x-raw ! queue ! metamux.Copy to clipboard
        - File source:

                gst-launch-1.0 -e --gst-debug=2 filesrc location=/data/office.mp4 ! qtdemux ! queue ! h264parse ! qtic2vdec ! queue ! tee name=split ! queue ! qtimetamux name=metamux ! queue ! qtioverlay ! queue ! qtic2venc target-bitrate=6000000 ! h264parse ! queue ! mp4mux ! queue ! filesink location=/data/video.mp4 split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! text/x-raw ! queue ! metamux.Copy to clipboard
    - Encode (variant 2): Use the `qtivcomposer`plug-in to mix
                            the original frame with the pose estimation mask.
        - Camera source:

                gst-launch-1.0 -e --gst-debug=2 qtiqmmfsrc name=camsrc ! video/x-raw\(memory:GBM\),format=NV12,width=1920,height=1080,framerate=30/1 ! queue ! tee name=split ! queue ! qtivcomposer name=mixer sink_1::dimensions="<1920,1080>" ! queue ! qtic2venc target-bitrate=6000000 ! h264parse ! queue ! mp4mux ! queue ! filesink location=/data/video.mp4 split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! video/x-raw,format=BGRA,width=640,height=360 ! queue ! mixer.Copy to clipboard
        - Offline case:

                gst-launch-1.0 -e --gst-debug=2 filesrc location=/data/office.mp4 ! qtdemux ! queue ! h264parse ! qtic2vdec ! queue ! tee name=split ! queue ! qtivcomposer name=mixer sink_1::dimensions="<1920,1080>" ! queue ! qtic2venc target-bitrate=6000000 ! h264parse ! queue ! mp4mux ! queue ! filesink location=/data/video.mp4 split. ! queue ! qtimlvconverter ! queue ! qtimltflite delegate=hexagon model=/data/posenet_mobilenet_v1_075_481_641_quant.tflite ! queue ! qtimlvpose threshold=51.0 results=2 module=posenet labels=/data/posenet.labels ! video/x-raw,format=BGRA,width=640,height=360 ! queue ! mixer.Copy to clipboard
- Validation method
    - The application saves .mp4 files to storage when it receives
                                    CTRL+ C and
                            terminates the command-line tool successfully.
    - To verify the AI processing, check the video stream running on the
                            display. There should be keypoints and skeleton mask visible over
                            objects such as a person.

**Parent Topic:** [Configure AI/ML modules](https://docs.qualcomm.com/doc/80-88500-3/topic/66_Configure_AI_ML_modules.html)

Last Published: Sep 26, 2023

[Previous Topic
Image segmentation use case](https://docs.qualcomm.com/bundle/publicresource/80-88500-3/topics/image_segmentation_use_case.md) [Next Topic
Image classification use case](https://docs.qualcomm.com/bundle/publicresource/80-88500-3/topics/image_classification_use_case.md)