In a chaotic few months, OpenAI has demonstrated it can do two things with remarkable consistency: make impressive breakthroughs in mathematics, then colossally screw up announcing them. OpenAI is now trying to do better. Somehow, it has botched that too.<\/p>\n<\/div>\n
OpenAI\u2019s latest attempt to repair fractured relations with a mathematical community it has repeatedly<\/a> alienated<\/a> is to consult<\/a> a new independent advisory group of elite practitioners. But mathematicians speaking to The Verge<\/em>, including one of the group\u2019s members, describe a messy and confusing affair bearing many of the hallmarks of OpenAI\u2019s previous rushed forays into mathematics, suggesting the company has learned little from its mistakes. And then there\u2019s the daunting task the group has been handed first: helping coordinate the release of scores more results OpenAI says its unreleased model has produced, the prospect of which is already stirring dread among researchers over what this looming tidal wave of breakthroughs could do to their field.<\/p>\n<\/div>\n \u201cThe way they phrased their announcement didn\u2019t really help.\u201d<\/p>\n<\/div>\n<\/div>\n On September 21st, an assortment of eminent mathematicians announced the formation of the Advisory Group on Mathematics and Artificial Intelligence (AGMAI<\/a>) in a guest post<\/a> on the blog of UCLA mathematics professor Terence Tao, a Fields Medalist and outspoken critic of AI companies\u2019 conduct in mathematics. The group was to be an independent body of nine elite mathematicians at the very top of their field. The post said the group will operate independently from OpenAI and advise it and other frontier AI labs \u201con the review and communication of emerging results.\u201d In its own announcement<\/a>, OpenAI repeatedly stressed the group\u2019s independence, saying members would be free to challenge the company publicly, publish their advice, and offer guidance it had not requested. It also stressed the limits of the group\u2019s influence, noting that it \u201cwill not be responsible for advising us on how to pace our internal progress on mathematics.\u201d<\/p>\n<\/div>\n But many mathematicians, and certainly most people outside of that community, learned about that group only through OpenAI\u2019s much louder rollout.<\/p>\n<\/div>\n The result was widespread confusion over whether AGMAI was truly independent or if it was, as several mathematicians The Verge<\/em> spoke to in the days after the announcement assumed, some kind of OpenAI-appointed body. That impression wasn\u2019t entirely unreasonable, given AGMAI\u2019s website says it formed after OpenAI approached some of its eventual members about establishing an advisory board, before they decided to strike out independently and invite others to join. It remains unclear which of the nine members OpenAI initially approached.<\/p>\n<\/div>\n Speaking to The Verge<\/em> on a video call from a lecture theater, Martin Hairer, an AGMAI member and mathematics professor at Imperial College London and the Swiss Federal Institute of Technology in Lausanne (EPFL), was keen to stress the group\u2019s independence from OpenAI. While acknowledging that OpenAI approaching some mathematicians was the original impetus for its formation, he said the group receives no financial, technical, or other support from the company, and that none of its members have signed agreements restricting what they can say or do beyond standard confidentiality requirements needed to give them advanced access to research.<\/p>\n<\/div>\n It\u2019s clearly been a hectic time for Hairer, who described the preceding few days as a \u201cvery frustrating\u201d and \u201cintense\u201d experience. \u201cWe don\u2019t work for OpenAI, are not paid by them, and it\u2019s totally independent,\u201d he said. Hairer said the group is equally open to working with other frontier AI labs and had already begun conversations with some, though he declined to say which.<\/p>\n<\/div>\n Solutions are often less important than the understanding that comes with them. In human mathematics, the two have traditionally gone hand in hand, and AI seems to be changing that.<\/p>\n<\/div>\n<\/div>\n Nevertheless, Hairer seemed exasperated by the way OpenAI had announced the relationship. In a blog post<\/a> published amid the ensuing uproar, Hairer acknowledged it would be naive to think AI companies wouldn\u2019t try to spin the group\u2019s involvement to their advantage. Given the group had emerged partly in light of OpenAI\u2019s atrocious handling<\/a> of previous mathematical breakthroughs<\/a>, that risk was front and center. OpenAI\u2019s solution<\/a> to a prestigious Millennium Prize problem rapidly descended into fights over credit, scooping, and its treatment of mathematicians, so the community was naturally suspicious.<\/p>\n<\/div>\n Hairer acknowledged that OpenAI\u2019s announcement had done little to help the fledgling group establish its independence. AGMAI needs to win the trust of mathematicians in order to help them navigate an increasingly fraught relationship with AI companies. \u201cThe way they phrased their announcement didn\u2019t really help,\u201d Hairer said. \u201cIf you read it exactly in detail, there\u2019s nothing wrong in what they say,\u201d he said, noting that the company is \u201ccareful\u201d in its wording. \u201cThey obviously are very good PR people,\u201d he said, laughing.<\/p>\n<\/div>\n The whole endeavor \u2014 the announcement, the group\u2019s formation, its communications with the mathematical community \u2014 feels as if it came together in a hurry. Asked last Wednesday about AGMAI\u2019s plans, Hairer laughed and said, \u201cSo we, well, you know, started two days ago. So it\u2019s not like we have a big master plan.\u201d<\/p>\n<\/div>\n That urgency might be down to the fact that OpenAI is sitting on a tranche of results it is clearly eager to release as soon as possible. Since solving the Navier-Stokes Millennium Prize problem, OpenAI says its unreleased internal \u201cmodel has now resolved more than 100 long-standing open problems across most areas of mathematics.\u201d<\/p>\n<\/div>\n Avoiding another PR disaster is why OpenAI went to the trouble of trying to assemble a team of some of the world\u2019s best mathematicians to consult. But trumpeting the sheer number of results it has waiting in the wings while promising to handle them responsibly only underscores how much of a mathematical outsider OpenAI is.<\/p>\n<\/div>\n \u201cThis is not how any academic behaves,\u201d said \u00c1lvaro Lozano-Robledo, a professor of mathematics at University of Connecticut. \u201cI don\u2019t go around saying, like, \u2018Oh, I\u2019ve proved all these things, but I don\u2019t know what to do with them.\u2019\u201d<\/p>\n<\/div>\n He sees a similar disconnect in other OpenAI pronouncements, such as when OpenAI\u2019s Laurance Fauconnet told The Verge<\/em> the company had \u201cmade substantial progress\u201d on another Millennium Prize problem. \u201cNo mathematician would go out and say that,\u201d Lozano-Robledo said. \u201cYou either have solved it, or you\u2019re still trying.\u201d<\/p>\n<\/div>\n Lozano-Robledo said he hopes engaging with AGMAI is a serious attempt by OpenAI to address mathematicians\u2019 concerns, but stressed that doing so means it should be a responsible member of the research community. That requires more than simply dropping results into the world and moving on, as many mathematicians believe it has done with its most recent findings. Researchers The Verge<\/em> spoke to complained of poorly written manuscripts and scant engagement with the literature surrounding a finding, all of which makes it difficult to understand a result\u2019s significance and leaves key work without the appropriate credit. At times, the company had quietly changed documents to shore up shortcomings after they were released, but didn\u2019t announce changes or leave a clear record of what was altered. The Verge<\/em> noticed<\/a> this when the company announced \u201cTen advances in mathematics and theoretical computer science\u201d in early August, and Hairer separately described times when it felt like the company altered manuscripts \u201csneakily\u201d in response to criticism. \u201cThat also makes people paranoid, right?\u201d Hairer said, describing it as \u201cshoddy\u201d and \u201creally bad and sloppy scholarship.\u201d<\/p>\n<\/div>\n As with AI slop elsewhere, the people creating it are rarely the ones paying the costs for dealing with it. Lozano-Robledo described the deluge of AI-generated math solutions as a \u201cburden\u201d on the community \u2014 one he thinks AI companies fundamentally misunderstand. \u201cThe burden is that they are producing a solution,\u201d he said, but solutions are often less important than the understanding that comes with them. In human mathematics, the two have traditionally gone hand in hand, and AI seems to be changing that.<\/p>\n<\/div>\n \u201cSo we, well, you know, started two days ago. So it\u2019s not like we have a big master plan.\u201d <\/p>\n<\/div>\n<\/div>\n AI companies may be producing impressive results, but they still need human mathematicians to work out how important a result actually is. \u201cThey need our expertise,\u201d Lozano-Robledo said. \u201cThey need us to celebrate that solution.\u201d<\/p>\n<\/div>\n For other mathematicians The Verge<\/em> spoke to, that burden is much more personal. For weeks now, OpenAI has been hinting at another Millennium Prize problem and says it has more than 100 results to apparently major problems ready to go, while revealing little about what any of these actually are. After the upheaval surrounding past announcements, Navier-Stokes in particular<\/a>, that uncertainty has created a tense atmosphere. Many researchers expressed fear that a problem or area of work to which they have devoted years, even decades, of their professional lives could be next on the chopping block, abruptly dispatched by a company they suspect is doing it as a publicity stunt on the way to an IPO.<\/p>\n<\/div>\n \u201cThey are just feeding the paranoia of what they could possibly have proved,\u201d said Lozano-Robledo, accusing the company of \u201cfeeding the frenzy\u201d and increasing dread among many mathematicians that their area of work could be disrupted next. \u201cLike, what other Millennium problem are they talking about when they say \u2018We have almost solved another Millennium problem\u2019? That sentence makes no sense in mathematics.\u201d The researcher stressed that such grandstanding is simply not how mathematics is usually done.<\/p>\n<\/div>\n For Colva Roney-Dougal, a mathematics professor at the University of St Andrews in Scotland, the uncertainty surrounding OpenAI is already having a profound effect on how she thinks about her work. \u201cIt\u2019s somewhat agonizing to know that a \u2018large number\u2019 of results are likely to be announced soon,\u201d she said. \u201cThe more there are, the more likely it becomes that my ongoing work, or that of my students, suddenly becomes irrelevant.\u201d<\/p>\n<\/div>\n The rapid pace of development has left Roney-Dougal at a peculiar sort of scholarly crossroads: \u201cI am therefore unclear whether I should be trying to rush out as many papers as possible, or passively waiting to see what these results are, or carrying on as normal,\u201d she said.<\/p>\n<\/div>\n Hairer is well aware of this kind of anxiety. He said the potential disruption to researchers was one of the reasons why he added his name to a roster of Fields Medalists<\/a> trying to address what they described as the \u201cseverely misaligned\u201d goals of AI companies and the mathematical community. He is also aware that OpenAI may spin the involvement of him and other prominent AGMAI members to its advantage, particularly with the general public.<\/p>\n<\/div>\n Let them, he said. \u201cThey\u2019re not going to sort of damage me within the math community,\u201d Hairer said. \u201cIn some sense, I don\u2019t really care about what they say. But what I do worry about is the math community as a whole.\u201d<\/span><\/p>\n<\/div>\n\n