a2rl.Tokenizer.valid_tokens#

Tokenizer.valid_tokens(col)[source]#

Get the valid tokens for column col.

Parameters:

col (str | int) – Column name (str) or column index (int).

Return type:

list[int | integer]

Returns:

Valid tokens for column col.