Looks like the correct piece of code to me. So it pads to the longest input sequence (so without batching that’s no padding altogether):
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("sentence-transformers/all-MiniLM-L6-v2")
tokenizer(["hey", "hello world"], padding=True, truncation='longest_first', return_tensors="pt", max_length=100)
#=> {'input_ids': tensor([[ 101, 4931, 102, 0], [ 101, 7592, 2088, 102]]), ...}
On the contrary we always pad do the maximum sequence length, so that we only compile once.
