Specifies backend selection (CPU or NPU).
Configures model paths, tokenizer settings, and memory allocation.
Manages dialogue session parameters for multi-turn conversations.
backend: “CPU” or “NPU”
model_bundle_path: Path to Genie model binaries
max_tokens: Token generation limit
genie-t2t-run: Text-to-text inference.
genie-profile: Performance profiling
Dialogue API: Supports multi-turn conversational workflows.
Token generation API: Handles incremental token streaming for LLMs.
Enables custom application logic.
Offers fine-grained control over inference sessions.
Works with QAIRT SDK for backend execution.
Supports both CPU and NPU targets
QNN HTP backend: QnnHtp
QNN AI transformer backend: QnnGenAiTransformer
QNN GPU backend: QnnGpu