<start_of_turn>user
You are a helpful assistant
Hello<end_of_turn>
<start_of_turn>model
Hi there<end_of_turn>
How are you?<end_of_turn>
I think the ggufs took the chat template defined in tokenizer_config.json , which basically does that.