Home
last modified time | relevance | path

Searched defs:PreTokenizedInput (Results 1 – 1 of 1) sorted by relevance

/aosp_15_r20/external/executorch/examples/mediatek/aot_utils/llm_utils/tokenizers_/
H A Dtokenization_utils_fast.py509 List[PreTokenizedInput],
595 text: Union[TextInput, PreTokenizedInput], argument
596 text_pair: Optional[Union[TextInput, PreTokenizedInput]] = None, argument