# GenieDialog\_tokenQuery

See [Genie Dialog JSON configuration string](https://docs.qualcomm.com/doc/80-63442-100/topic/json.html#genie-dialog-json-config-string) for details on the fields and what
they mean. An example model\_config can be found at
`${QNN_SDK_ROOT}/examples/Genie/configs/llama2-7b-genaitransformer.json`.

Note

Use LLaMA-2-7b notebook’s for generating AR-N models.

adb shell mkdir -p /data/local/tmp/
    adb push <path to llama2-7b-genaitransformer.json> /data/local/tmp/
    adb push <path to token file(.txt)> /data/local/tmp/
    
    # open adb shell
    adb shell
    export LD_LIBRARY_PATH=/data/local/tmp/
    export PATH=$LD_LIBRARY_PATH:$PATH
    export ADSP_LIBRARY_PATH=$LD_LIBRARY_PATH
    
    cd $LD_LIBRARY_PATH
    ./genie-t2t-run -c <path to llama2-7b-genaitransformer-htp-kv-share.json>
                    -tok <path to token file(.txt)>
    Copy to clipboard

# Example tokenfile.txt
    24948 592 1048 15146 2055
    Copy to clipboard

## Model inference using token to token feature on Windows

Open `Developer PowerShell for VS2022` on Windows on Snapdragon host and run:

# Make sure environment is setup as per instructions, or can cd into bin folder on Windows host
    cd <QNN_SDK_ROOT>\bin\aarch64-windows-msvc
    .\genie-t2t-run.exe -c <path to cpu-model-config.json>
                        -tok <path to token file(.txt)>
    Copy to clipboard

# Example tokenfile.txt
    24948 592 1048 15146 2055
    Copy to clipboard

Last Published: Oct 02, 2025

[Previous Topic
Example on how to update stop sequences in between queries](https://docs.qualcomm.com/bundle/publicresource/80-63442-100/topics/stopseq.md) [Next Topic
Updating the Sampler Parameters](https://docs.qualcomm.com/bundle/publicresource/80-63442-100/topics/update_sampler.md)