The tokenizer_function cannot differentiate between different model classes: BERT vs T5. The same procedure is applied to both. However, T5 requires [EOS] token while BERT lacks such token.

When a System.Data.DataTable object is instantiated within a PowerShell function and then returned to the calling scope, the returned value incorrectly becomes $null ...