17 ms·
Glad you liked it! Currently, context size is an issue. The user must clear the conversation when the context limit is reached. Knowing that I added basic memor
by mzitelli 3y ago
Glad you liked it! Currently, context size is an issue. The user must clear the conversation when the context limit is reached. Knowing that I added basic memory access commands so GPT-4 may store some context between sessions. To reduce the context usage I also defined a system prompt that incentivizes selecting code ranges, not entire files. With this, GPT-4 is able to solve medium-complexity tasks, including implementing commands in this extension itself.
For the future I expect GPT-4 with 32k tokens will greatly improve this extension capabilities. Also, I am looking into LangChain to reduce conversation length, define goals and employ a better memory solution.