I don't understand this at all. What this post suggests seems illogical to me:
- The most obvious way to adjust the behavior of a LLM is fine-tuning. You prepare a carefully-curated dataset, and perform training on it for a few epoch.
- This is far more reliable than appending some wishy-washy text to every request. It's far more economical too.
- Even when you want some "toggle" to adjust the model behavior, there is no reason to use a verbose human-readable text. All you need is a special token such as `<humorous>` or `<image-support>`.
So I don't think this post is genuine. People are just fooling themselves.
Note that these are only used for chat. As far as I understand there are no built-in system prompts when you use their APIs (or maybe they have different, smaller system prompts).
I guess the rationale is that the end users of chat are not trusted to get their prompts right, thus the system prompt.
- The most obvious way to adjust the behavior of a LLM is fine-tuning. You prepare a carefully-curated dataset, and perform training on it for a few epoch.
- This is far more reliable than appending some wishy-washy text to every request. It's far more economical too.
- Even when you want some "toggle" to adjust the model behavior, there is no reason to use a verbose human-readable text. All you need is a special token such as `<humorous>` or `<image-support>`.
So I don't think this post is genuine. People are just fooling themselves.