unable

Blog

‘Frontier models are still unable to solve the majority of tasks’: The death of the software engineer may not happen as soon as you think – OpenAI researchers found AI models still lag behind humans on coding tasks

AI might not replace software engineers just yet as new research from OpenAI reveals ongoing weaknesses in the technology. Having created a benchmark dubbed ‘SWE-Lancer’ to evaluate AI’s effectiveness at completing software engineering and managerial tasks, researchers concluded that the technology is lacking. “We evaluate model performance and find that frontier models are still unable to solve the majority of…