Tag / Benchmarks

6 posts
News

OpenAI says its new models finally get COBOL, Fortran and Visual Basic

OpenAI says its latest models are far better at writing and migrating code in low resource languages such as COBOL, Fortran, OCaml and Visual Basic. On its own COBOL migration test, GPT-6.1 Sol jumped from 5.4 to 86.6 percent at low reasoning effort, and GPT-6 Astra passed 87.4 percent of tests on a new open benchmark that asks models to rebuild SQLite in 20 languages.

News

GPT-6 Astra solves 49 of 50 unpublished theoretical physics problems

A new benchmark called TheoPhysEval gave five AI agents 50 unpublished, research-level theoretical physics problems. GPT-6 Astra running in OpenAI Codex solved 49 of them at an average cost under 3 dollars per problem, and along the way it showed that several of the expert answer keys were wrong.