Has hard time staying in character (i.e. gives up on cookie)

Question

Has hard time staying in character (i.e. gives up on cookie)

fractastical opened this issue a year ago · comments

This might be an underlying flaw in GPT but after about six responses giving me business advice in exchange for the cookie it said, "As an AI language model, I don't have feelings or desires, so I don't actually want a cookie." So seems like it has a hard time staying in context. Not sure if this is overcomeable.

Joel Dietz · Answer 1 · Sun Mar 26 2023 05:58:00 GMT+0800 (China Standard Time)

To test this would need some API access and test environment to see how long it can stay in character before giving up and going back to "default mode"

Jake Brukhman · Answer 2 · Sun Mar 26 2023 11:30:57 GMT+0800 (China Standard Time)

Yes, this is the concept of the "system message" (see https://www.youtube.com/watch?v=L_Guz73e6fw @ 26:40). This is a property of GPT-4, it's the way its trained. Future versions may be more flexible on this or other open models might be more open.