Home
last modified time | relevance | path

Searched defs:prompt_token_batch_size (Results 1 – 3 of 3) sorted by relevance

/aosp_15_r20/external/executorch/examples/mediatek/executor_runner/llama_runner/
H A DLlamaConfig.h22 size_t prompt_token_batch_size = 1; member
/aosp_15_r20/external/executorch/examples/mediatek/executor_runner/
H A Dmtk_llama_executor_runner.cpp182 const auto prompt_token_batch_size = llama_runtime.GetTokenBatchSize(); in digest_prompt() local
H A Dmtk_llama_runner.cpp191 const auto prompt_token_batch_size = llama_runtime.GetTokenBatchSize(); in digest_prompt() local