5 ms·Does this do the tokenization? Could it be expanded to parse the whole structure of the language?by hyperhello 8d agoDoes this do the tokenization? Could it be expanded to parse the whole structure of the language?