Just a gentle reminder of what “the square of” means; that green line to the left is the square of the input cost of N items. Cost is the vertical axis. Linear scale shown.
What’s worse, that appears to be just the runtime cost. The training cost is N5 or worse, according to my colleagues who use these models.
I don’t care how many NVidea GPU’s you have running beside your newly refurbished 1950’s nuclear plant, it sure as hell ain’t N2.
Ha. As a quantum guy phrased it to me at lunch, at a conference where he was desperately trying to get another job: “quantum is an application waiting for the hardware to catch up.”
A Nature paper from Google with revolutionary claims in AI-enabled chip design was heralded as a breakthrough in the popular press, but it was met with skepticism from domain experts for being too good to be true and for lacking reproducible evidence.
Now, crosschecked data indicate that the integrity of the Nature paper is substantially undermined owing to errors in conduct, analysis, and reporting. Independently, detailed allegations of fraud and research misconduct in the Google Nature paper have been filed under oath in California.
Nature has been slow to enforce its own policies. Delaying retractions of problematic publications is distorting the scientific process. Swift and decisive action is necessary to maintain the integrity and credibility of scientific research.
Can we talk for a minute (slightly off-topically) about how Nature is an absolute garbage journal more interested with publishing papers with attention-grabbing headlines than it is with publishing papers that meet the barest standards of research integrity or scientific validity?