a2rl.AutoTokenizer.gpt_tokenize#

AutoTokenizer.gpt_tokenize(seq)[source]#

Convert input sequence from dataframe token to GPT token.

Return type:

ndarray