Searched refs:tokenize_dataset (Results 1 – 1 of 1) sorted by relevance
153 def tokenize_dataset(inp, tokenizer): function449 tokenize_dataset, fn_kwargs={"tokenizer": tokenizer}