8 ms·
Code reviews - Shines Review code - Shines Finding bugs - Shines Suggesting coding patterns you want and suggest to LLM - Shines Explaining error messages -
by gaz 3y ago
Code reviews - Shines
Review code - Shines
Finding bugs - Shines
Suggesting coding patterns you want and suggest to LLM - Shines
Explaining error messages - Shines
Writing code from scratch - Mediocre
Architecting a solution - Mediocre/Poor
Understanding code or solutions it has no clue about - Poor
Contextual multi-file or multi-domain code understanding - poor
- sgbeal 3y agoThere's a contradiction in that list: proper code reviews require knowledge of the problem the code professes to solve. If AI is poor at context-dependent details, it can't shine at reviewing code.
- famouswaffles 3y agoIt doesn't say the AI is poor at context dependent details. Specifically it says multi-file context or context dependent on knowledge of multiple domains. There's not necessarily any contradiction here.
- sgbeal 3y ago> Specifically it says multi-file context Only the most trivial of projects have only a single code file.
- famouswaffles 3y agoIt's not about one code file vs 2. It's about the amount of code that can fit into the context at any time.