johnhenning

6 ms·

1. 1.▲
   by johnhenning 3y ago

   Do you foresee any compatibility or integration issues with higher level frameworks, i.e. lightning, transformers, etc?
2. 2.▲
   by johnhenning 3y ago

   If this is trained on user sessions, how would the model learn to generate tests for edge cases that wouldn’t necessarily show up in the training data?
3. 3.▲
   by johnhenning 4y ago

   I definitely agree with your point about it being used as a crutch. My criticism was more towards how the authors evaluated AI’s effect on writing secure code. I’m not saying they shouldn’t have student participants, but they should be full
4. 4.▲
   by johnhenning 4y ago

   Looking at the demographics of the study, they only had 47 total participants, 15% of which were professionals and 62% reporting less than 5 years experience coding (which I would imagine is an underestimate assuming some people exaggerated