I contacted a professor from a university in the UK and he responded since he was working on similar work, then asked me if I wanted to meet with him. We talked for about an hour since we had overlapping results and different methods, specifically different assumptions.
I say all that to say, as a physics student getting my undergrad, simply doing independent research and speaking to experts about it enabled me to network with someone I otherwise likely wouldn’t know. For young people getting into any business, research is a great way to meet new people.
This is what happens to every field as it turns from a science into an industry. Chemists published freely until dyes started being worth money, and then the interesting work moved into company labs and stopped coming out.
Your RPL wouldn't be enforceable. Copyright doesn't deal with abstract ideas passing through people's minds. Even the GPL is kind of in a gray area because the virality feature and its definition of "derivative work" have never been tested in court, to my knowledge. Maybe under contract law, no idea. If nothing else, I'd love to hear a verdict.
I don't believe the GPL is in a grey area. When you license a work all sorts of strings are commonly attached. Rather IIUC no one has gone out of the way to test the GPL largely because it is clearly within bounds, plus any violation has the potential to be a PR disaster since violations are quite literally examples of looting the commons.
Meaning what? Claw back the ideas from people's minds? You can terminate the agreement in the sense that you revoke access to the paper, but presumably the person you find in breach has already used the research for something that you find them in breach for. You're kind of closing the gate after the horse has bolted.
>sue for damages
I honestly have no idea what damages you could claim from not publishing research. I think you would need to set a value ahead of time on the agreement.
>If I can agree to pay you not to talk about something (ie an NDA) or not to work in a field (ie a non-compete clause) then why can't I pay you to be required to publish all future work you do in a given area?
Not sure why you added the word "pay" to your clauses, but anyway. The reason is that the existing contracts have well-defined boundaries. An NDA stops you from divulging a very specific set of information. A non-compete clause stops you from working in a very specific field. Your proposal has an undefined reach. What counts as research? What counts as "related"? It would seem that if I agree to such a contract, my entire life, both private and professional, after reading the paper is covered by the contract, and anything I do might come under scrutiny. There's never a point when I can go off-duty. "What's that? You read my paper on compression and were working on a side-project that uses compression? Gonna have to see some publication on it."
>Rather IIUC no one has gone out of the way to test the GPL largely because it is clearly within bounds
No, it's because the status quo is convenient and no one wants to be the first guinea pig. It's definitely not obvious that the terms are legally valid, but it's ambiguous enough that people don't want to test it.
If something is so obviously wrong then perhaps take a minute to consider that your interpretation isn't what the other party intended?
If I pay you not to do something and then you breach the contract I can terminate the agreement and seek damages. Ditto if I pay you to repeatedly do something and then at some point you fail to do it. So if I pay you a recurring fee to publish all your research on a given topic and then you fail to make good on that I can seek damages, right? Now what if I paid you a lump sum up front? Now what if I licensed a patent to you in place of that lump sum? What if instead of a patent it was the right to make use of a piece of software?
> I honestly have no idea what damages you could claim from not publishing research.
Aside from whatever was stipulated for breach of contract I expect it would be extremely situational. I agree that you'd probably want to stipulate a penalty ahead of time. The original idea was a two sentence joke after all ...
> Not sure why you added the word "pay" to your clauses
Because contracts involve consideration and payment is easy to understand and reason about. FOSS software licenses obviously substitute "right to use the code" for "payment".
> A non-compete clause stops you from working in a very specific field. Your proposal has an undefined reach. What counts as research? What counts as "related"? It would seem that if I agree to such a contract, my entire life, both private and professional, after reading the paper is covered by the contract, and anything I do might come under scrutiny.
This is incredibly contrived. You could ask the equivalent about a non-compete. The reach is whatever is defined in the contract that both parties agreed to. If the contract stipulates something overly broad then possibly a judge would invalidate it. This is business 101.
> It's definitely not obvious that the terms are legally valid, but it's ambiguous enough that people don't want to test it.
An assertion entirely without evidence from my perspective. I'm going to assume that all the lawyers who have sure left me with the impression that it would be a bad idea to violate it know what they're talking about.
Uh-huh... This doesn't answer my question of what terminating the agreement of access to the paper does, besides what I've already said. You've licensed to me access to a paper under certain conditions. I've breached the conditions, therefore you terminate the agreement, therefore you revoke access. Am I missing anything?
>FOSS software licenses obviously substitute "right to use the code" for "payment".
Hence my question. The hypothetical license/contract under discussion is about access to research results, not about a monetary transaction.
>This is incredibly contrived.
Well, the idea of viral abstract ideas is stupid, so it forces me to give contrived examples.
>I'm going to assume that all the lawyers who have sure left me with the impression that it would be a bad idea to violate it know what they're talking about.
What point do you think you're making? Something can be ambiguously (but not certainly) risky and a bad idea to do. I have two coins, one with two tails and the other a fair one, and I offer you to gamble everything you own on one of these coins of your choosing, or walk away. I assume you wouldn't pick the unfair one. Therefore if you would rather walk away than gamble everything you own on the normal coin, the toss actually has a 100% chance of you losing?
You're missing the part where I seek punitive and actual damages under the terms of the contract. No different than violating an NDA - I paid you a lump sum up front, after a while you breached the contract, the agreement is null and void, what's the consequence?
> Well, the idea of viral abstract ideas is stupid, so it forces me to give contrived examples.
On the contrary, presumably it was because you lacked the ability to roundly refute anything I had put forward. Otherwise I assume you would have done so.
> Therefore if you would rather walk away than gamble everything you own on the normal coin, the toss actually has a 100% chance of you losing?
But in this analogy it is you baselessly making that claim. There's every expectation that it's a fair coin, many experts have carefully inspected it and authored opinions on it, and some have put forward theories that it slightly deviates in one direction or another. Then you show up and confidently assert without any evidence that there's some wild deviation from fair, hand waving that you would have proof if only someone wanted to bother testing it.
Out of curiosity, what is it that has you so bothered about the idea of viral licenses? What do you find so objectionable about attaching arbitrary terms to contracts?
Right, so you're agreeing with my original interpretation of "termination".
>You can terminate the agreement in the sense that you revoke access to the paper
The termination and the lawsuit for damages are separate events. Why did you accuse me of being purposefully dense if you're agreeing with me?
>But in this analogy it is you baselessly making that claim.
We're both making baseless claims. I said A, and then you said ¬A, and neither one has backed anything up. I don't even necessarily believe you talked to any lawyers, I just granted it for the sake of argument because the statement you made was so weak that I didn't need to cast doubt on it.
Also, in case you missed it, the fair coin in the analogy represents the case where the GPL might not be fully valid, not the other way around. If the coin is unfair then the GPL is fully and obviously valid, and if you get sued and you did infringe it then you're certain to lose.
>Out of curiosity, what is it that has you so bothered about the idea of viral licenses? What do you find so objectionable about attaching arbitrary terms to contracts?
Since I'm not the topic of discussion, I won't answer these questions beyond saying that I didn't opine on viral licenses.
To paraphrase your last paragraph, an idea that hasn’t been tested is either perfect, or just bad enough that no one wants to test it, as, as you say, testing it is would be at least somewhat inconvenient.
Chances are nothing is perfect.
https://www.gnu.org/graphics/copyleft-sticker.html
From: rms@prep.ai.mit.edu (Richard M. Stallman)
Date: 25 June 1986 at 18:45:28 GMT+2
To: a2deh@ai
I figured out what a copyleft is.
It's the sort of thing that I put on GNU software and manuals.
The left-wing version of the copyright that rightists useBut copyrights are not patents, and the opposite of "patent" is "latent", so we need a Latent Office that protects inventions from the people who claim to have invented them, and issues warnings to patent trolls:
LATENT (L)
All rights unreserved.
This invention may already exist, but hasn’t become obvious yet.
Latentleft — publish the invention, conceal the monopoly.
Latent Pending — the idea is out there somewhere.
Latent Troll — remains dormant until an industry becomes profitable.But they’re not dependent on my research in particular.
If I don’t publish, what, as a result of my not publishing, happens to the companies dependent on data & research?
Nothing.
This would be a pointless endeavour. One of the most basic mantras of science is "absence of evidence is not evidence of absence". So just because something didn't worked out for you that doesn't mean it doesn't work out for others, or even yourself in the future.
In 'searching a path from A to B in a maze' language:
The original statement was: (1) The branch to the left from A is a dead end. Your interpretation: (2) There is no path from A to B.
(1) is still very useful (reducing the wasted effort) for those trying to find a path from A to B. The OP's point is that in the current environment only positive results are rewarded (I found the path from A to B!), not the negative ones like (1).
Notably this is exactly what patents are intended to combat. And while US IP law is clearly very broken it does at least largely accomplish this stated goal. Much (but certainly not all) industrial chemistry has made it into the academic literature.
Not that the same logic necessarily applies to AI research (ie algorithms aka math and their implementations). And I'm actually happy about that because the cost of doing the research is so much lower. There's a long list of reasons that the average person living in a residential area can't do industrial chemistry as a hobby.
To your dye example, yttrium indium manganese blue was the first commercially viable inorganic blue pigment discovered in ~200 years, is the only known environmentally safe one, and was openly published in the literature. It's also under an exclusive license. (TBF though unless the chemical is unusually difficult to synthesize not publishing would be rather pointless in this day and age given the utterly absurd capabilities of modern analytical techniques.)
Gee, I wonder what was wrong with the previous blue pigments and why it was so important to have this one under an exclusive license.
Cobalt blue is a blue pigment made by sintering cobalt(II) oxide with aluminium(III) oxide (alumina) at 1200 °C. Chemically, cobalt blue pigment is cobalt(II) oxide-aluminium oxide, or cobalt(II) aluminate, CoAl2O4. Cobalt blue is lighter and less intense than the (iron-cyanide based) pigment Prussian blue.
https://en.wikipedia.org/wiki/Cobalt_blue
Oh right.
P.S. Don't lick your brushes.
Cobalt poisoning sounds scary, but I see nothing on the linked Wikipedia page that would present a risk of accidental consumption of medically relevant amounts of cobalt, whether in one sitting or through prolonged exposure.
I mean, I assume Canada stopped adding it to their beer (https://en.wikipedia.org/wiki/Cobalt#Toxicity).
Though the mention of Bolesławiec makes me worried a little; my wife loves their designs and we have a bunch of plates and bowls and such from them, and we serve food on/in them regularly...
I jest, no tinder. But still, be ready for a lot of non-responses if you're not actively in college. It can feel like a lonely world out there despite theoretically being hundreds of potential people you'd be able to talk to for hours.
Or so I was told.
I personally wanted an AI that was able to reach out to me about my life before I had to reach out to it. An example, a friend just emailed me asking to meet for at 1pm but I have class at 1:30, so a proactive AI would see that conflict and send me a notification about it, asking if the proposed email it drafted works, then I press send.
My personal setup tracks my mouse movement, keyboard, what’s on my screen, and keeps track of what I’m working on through files on my PC. It can update the backend and then restart it on it’s own, meaning I can develop the thing itself while being away from my PC.
The capabilities are more than what I’ve listed, but I want to avoid being too preachy about something I made. Here’s the repo if you wanted to take a look, it’s open-source and connects to the iPhone app:
I don't mean to downplay your work, but I think you should come up with a better example use case. Automating away interactions with friends is pretty much the last thing I want AI to do.
The run stalled mid-step around 80M parameters, Orb notified me that it stalled, asked if I wanted to resume at the last checkpoint and kill the stalled version. I simply press “yes” and continue doing whatever I was doing.
For non-technical users and non-antisocial people, remembering things you forgot so you don’t let people down. You told your sister you’d send her some pictures two hours ago but it can see you’re scrolling on reddit and the photos are on your desktop, so it assumes you forgot and reminds you.
The idea was that the biggest issue with the usefulness of an agent is that it has too little context about who I am, it needs more data. So I run all of my data through a smart router, then the local database, then the LLM reviews it and uses reasoning on what’s been collected.
Hmm, so your harness is processing my activity and personal data, uploading all that to AI vendors? That sounds like a privacy and security nightmare, if I understand correctly
Personally I don't think I'm ready to hand over total access to my digital life until I can self-host the model capable enough to act on it, but either way there is definitely some cool work to be done in the model harnesses for this.
I assumed that's what openclaw basically was, but is Orb different from that? And is it fundamentally a different model from the request/response, or is it just request/response in an autonomous loop?
On a fundamental level the backend was designed to do as little LLM calls as possible, for instance it’ll do scans of my screen every 15 seconds, log what’s on it and what’s going on, and store it in a local database, then Orb reviews the entire database every 6 hours for me. Then it’ll schedule wakeups for itself throughout the day, up to 4 so it doesn’t waste my tokens, and schedule notifications based on the last database dump it made.
I have my Claude Code, Codex, and Grok Build all useable by using the “claude -p; codex -p…etc” so you can also use multiple CLI’s in conjunction at the same time on different projects or the same project.
So your question about a loop is kind of right, but it really just collects your data all day and stores it locally on your PC then calls the LLM of your choice and it reviews all the data and makes those proactive moves we’ve discussed. You could theoretically get it to always be scanning by an LLM but that would be a drastic waste of money from what I’ve seen since most things don’t require a call.
It doesn't look like you're building directly on openclaw, so is that coming from a place of different goals or philosophy, or what?
It’s built as it’s own backend and philosophy wise, I want my personal AI to connect to everything in my life and have complete context over all data that I own, be compiled into a neat stack of data accumulating, then when it thinks it’s appropriate to do/say something, it’ll do it without my involvement.
Nice card btw, I got my RTX 5070 a couple months ago and it runs like a dream.
> Happily, current AI is interacted with in a reactive loop. I open the Claude app, CLI, whatever, say my prompt, get an output.
"Current AI" is not limited to LLM offerings. There are many AI algorithms which can assist in what you specify thusly:
> I personally wanted an AI that was able to reach out to me about my life before I had to reach out to it.
Consider a forward chaining inference engine ("expert system") provided with relevant asynchronous percepts from the deployed environment to reason about. This could serve as an initiator of a "proactive AI".
OR
“Event x happened at y time”
The first tried to publish novel results for 3 years in tier 1 journals before finally doing a preprint and telling the tier one publishers to jump in a fire.
The second, and ongoing, isn't publishing anything because of my experience with the first.
That and avoiding openAI and Anthropic copying our results and leaving us with nothing to show for six months of work. The papers only come with the pitch deck.
https://jmlr.org/editorial-board.html
Scroll down where it says "JMLR Editorial board of reviewers" and where you can find the names of reviewers and their areas of expetise.
The advice you get from such reviewers, even if your paper is rejected, is an invaluable tool to help you improve your work and its presentation. You eventually learn to not be sore about it and iterate until your work gets accepted.
Of course nobody's forcing you to publish, especially in a journal (in AI and CS conference proceedings tend to have much quicker turn around times and you naturally get more feedback if you get to present at a conference) but the alternative is to sit alone in your room hacking away at your code until you discover the perpetual motion machine.
Cool for Google. Problematic if you are a startup.
Isn't the POINT of publishing research because you want others to copy it?
Also 20 years is a crazy long time in some industries (like most software).
There is not an obvious path to making this research public again. That's the reality. For open source to be competitive it needs to be approximately as efficient as the best systems we design.
I thought "recursive self improvement" would bring an effective abundance for everybody, any minute now, Musk said so himself. Seems the researchers in the field are lying to us about it while they clutch their pearls and dream about other people's money as if the future is a dog-eats-dog world of death-inducing scarcity.
They shouldn't be lying like that, or at least, their lying shouldn't be so obvious.
Recursive self improvement is a blue skies longer term thing. No one technical is saying that it's live right now.
The most common attitude is something closer to "I want to be well known and respected by smart and influential people". In short, prestige.
People using your work is a side effect of success, but simultaneously threatens your ownership of your "brand". If they significantly improve upon the thing you did, your work could be made irrelevant, your prestige ruined.
That would clearly demonstrate it had real substance beyond hot air or puffery.
Better to silo yourself and move in to the penthouse.
For startups, no, because the point of that is to make money.
Once the business is making money it’s not really a startup any more, it’s a going concern.
OP is an undergrad student. Attracting attention is what will make them stand out. And sharing research at this stage will probably expose them to research others don’t want to publish but do want to share with other researchers.
Investors with money.
To rephrase it more bluntly: the difference between normal business and a startup is that between a cow bred for milking vs. a pig bred for slaughter.
What are investors who don’t have money?
Perhaps I should have said investors and speculators, but this doesn’t help you here.
Moreso if your current employer is a stealth AI startup which hasn't yet produced much notable.
It also can encourage employees to work for fewer wages... 'If you do great work you can publish and then get a $$$$$$ job offer at OpenAI, or you can stay here and get equity in a fast growing startup. If however your work doesn't do well, you walk away from a bankrupt startup with worthless shares and minimum wage'
To answer your question, sharing the research isn't the important part. These are researchers in the private sector, in a highly competitive field. Arguably, doing the research isn't the important part either. The important part is making money, and the research is a means to that end. Publishing the research doesn't further that goal, and, according to GP, it's so difficult that it may not be worthwhile trying.
Are journals just too slow, hidebound, and predatory to be useful to this industry any more?
LLMs are pretty good at this, hilariously. This means a genuinely good paper by an outsider has significantly less chance of getting good reviews than AI slop.
We already arrived at that destination a decade ago.
Probably even further back tbh.
There's just a lot more people playing the game now, without the social indoctrination that made it more tolerable in some circles.
It's not that bad, though. September is annoying but you kind of miss the eternal renewal once you're out.
Traditional research publications are no angels. They gatekeep research, and also allow financial incentives to drive them to publish junk with their stamp on it.
But a flood of papers doesn’t actually mean more knowledge. In bypassing this route entirely, AI has swiftly lost the ability to engage with itself as a field. And the cost of that is only beginning to be felt.
The main difference is reproducibility and peer review process.
On the first, I mostly don’t care.
On the second, that’s mostly unavoidable if they want to keep their IP.
They are not perfect, but institutions like peer review or universities do provide a framework and incentives for quality.
If you are spending time, money, and risk based on a claim, verification still helps to cull info that is deceptive or done with methods so shoddy it might as well be lying.
Sure, you can verify through your failures, but that isnt great. You company goes belly up and you can confidently say the blog was bullshit.
This is also in line with my subjective experience as someone reading quite a few papers in the field: """The preprint also found that firms based in China consistently published more papers than their counterparts based in the United States."""
In the paper, OpenAI is at the top of the chart for cumulative citations. MEGVII, Hugging Face, Waymo, Momenta, Preferred Netowkrs, Anthropic, Owkin, and Databricks, and Aibee follow (in that order). Yes, that is citations, not publications, but they explain that they're trying to use that as a proxy for significance, albeit an imperfect one.
Companies like Google aren't included because they aren't unicorn startups.
so unless those companies (openai, anthropic) gave the researchers some fortune big enough to make them give up their research careers, they will keep publish research papers. aka it is not the good will of those companies.
what makes them a top ai startup
Anyway, there’s a repo link https://github.com/q5loisel/unicorn-AI-startup-publications so someone more determined at getting a better answer can poke at it.
50% of startups contributing to public research is actually a crazy good outcome. That’s far more than I had expected.
https://research.google/pubs/distilling-the-knowledge-in-a-n...
# LLM generated summary of the implied irony
Google may consider the standalone frontier-model arms race economically irrational, while still considering frontier-model capability strategically indispensable. Its longer game is probably not to avoid building the biggest models, but to build only enough of them to serve as capability factories—then turn that intelligence into a much larger population of cheap, purpose-built models.
(Human again) If Google knew what they were on to, why wouldn’t they make it their secret weapon from the start? I suspect it’s because they predicted there would be an arms race, and knew how to profit from it. They had a distillation paper published before “Attention is all you need”. In hindsight, is it ironic at all? Or is it obvious?
It was kind of like radiation science before WWII, it would be freely published because it wasn't potentially world changing yet. After it became a government interest, even people doing things unrelated to weapons would be much more apt to hold their work close.
> Relatively flat US output growth versus rising numbers of US researchers is often interpreted as evidence that ideas are getting harder to find. We build a new 45-year panel tracking the universe of US firms’ patenting to investigate the micro underpinnings of this claim, separately examining the relationships between research inputs and ideas (patents) versus ideas and growth. We find that average patents per R&D input are increasing, the elasticity of patents to R&D inputs is flat or rising, and there is no systematic evidence of a secular decline in patenting after controlling for research inputs. We then document a positive, significant, and fairly steady relationship between firms’ growth in ideas (patents) and labor productivity. Average firm growth after controlling for idea growth, however, declines. Together, these results suggest that innovative efforts play a key role in sustaining growth that has not diminished over the last four decades.
https://faculty.tuck.dartmouth.edu/uploads/teresaFort/files/...
There should be a new ESG (Environmental, Social, and Governance) policy being pushed recognizing the important role this plays. Although ESG and all norms have been set aside in this grim new world it seems.
You are not. A disproportionate amount of value in the computing industry was created by <strike>geniuses</strike> decently smart people who worked together and who decided to just tell people how to do things instead of trying to capture the value of being the first person to figure out how to do those things.
This observation pre-dates the current wave of AI hype by a half century or so.
> driven by greed
I can only speak for myself.
For me it's exactly the opposite. If I want to explain how something works, I can just... do that. If I want to share an artifact demonstrating how to solve a particular type of problem, I can just... do that. If I want to mentor/teach, I can just... do that.
Doing those things within the confines of Academia Approved Institutions is exhausting and distracting.
To wit, and the actual point of this post: the term "Publishing Research" in this article doesn't mean "post it on a .html page and share the source code". It means engaging in a very specific and peculiar and extremely political modality of communication.
And it really only makes sense to do that specific and peculiar and political thing you're at a stage in your professional/personal development where you need to play that particular prestige game. (Which there's nothing wrong with, but it is a deeply cargo culted version of the actual scientific process.)
* A disproportionate amount of value in the computing industry was created by g̶e̶n̶i̶u̶s̶e̶s̶ decently smart people who worked together to do things that seemed impossible and who decided to just tell people how to do things instead of trying to capture the value of being the first person to figure out how to do those things.*
There is some excellent publicly-funded research in there, but pivotal papers like Attention Is All You Need and the numerous pivotal OpenAI publications were privately funded.
OpenAI is at the top of the chart in the study.
I think you're bringing some assumptions into this conversation that aren't supported by the evidence.
A distinction should be made between the old nonprofit OpenAI and the current organization. They don't publish technical research anymore.
Example: https://arxiv.org/abs/2607.24653
Exceptions to some like Deepmind, Nvidia, and Thinking Machines
[1] https://arstechnica.com/ai/2025/06/anthropic-destroyed-milli...
The discussion has been around, but it's flared significantly recently. Not sure if that's what the person you're responding to is specifically inflamed about.
Regardless, old/rare books are certainly being acquired and destroyed.
Elon tweeted "I’ve asked the SpaceXAI team to preserve any rare books in a library and scan them the hard way vs just cutting off the spine and scanning"
which is no sense a credible source for what he actually asked SpaceXAI team to do, or if they are doing it, or what they were doing before yesterday. Elon has an extremely long and thorough track record of lying.
The problem remains either way. Small operations around the globe are debinding rare/unique books. I'm involved with an organization considering (not strongly) that exactly.
The scanning process destroys the book.
Internet Archive scans their books one page at a time keeping the book intact and stored in a warehouse.
> "The print original was destroyed. One replaced the other."
(I believe the reasoning is that the author is not being financially disadvantaged by more copies of their book existing).
So the current law prefers them to destroy.
I usually hear that it's extremely hard to track down the copyright owners for many older things. That's the reason the film/video industry often gives for not digitising the backlog online, and I would expect their volume to be much easier to handle than the book industry.
The process and standards of peer-reviewed publication are tedious. If the objective is efficient communication of knowledge, this is not the process that maximizes that outcome. This process is about credentials and imprimatur, not communication.
Academic publication is largely chasing prestige. The value of prestige accrues more to the individual than the company employing the individual. Incentives for companies reflect this.
Many blogified publications are unqualified slop. This sounds like an indictment but a lot of academic peer-reviewed research is also low-quality slop. In many domains, slop is rewarded, devaluing the contributions of people publishing more serious research, which affects incentives. The signal-to-noise ratio has been poor for decades no matter where you get your knowledge.
Any good research you publish will be exploited against you in myriad ways. It is effectively impossible to assert any IP rights. Research turns into a pure cost center if you treat it this way. Companies recognize this and have adapted to reflect it. In some computer science domains the state-of-the-art has been buried in trade secrets for decades such that the academic literature is embarrassingly obsolete.
Publication costs time and money. Given all of the above, why would you invest productive capacity in public communication of research results? The researchers want to work on interesting problems, the companies want to maximize the leverage from their research. Publishing delivers neither.
A lot of fundamental research is done for the purpose of solving a problem, not publishing a paper. Their motivation and personal reward is solving the problem, not publishing it. Once they've solved it, it is no longer interesting and they are on to the next interesting problem.
Some research is coupled with national security considerations. If you do frontier research this is always sitting in the background.
All of this is a consequence of incentives. A large percentage of all basic research no longer happens in academia. I've greatly enjoyed participating in non-publishing research programs. I also understand why they don't publish. I've done a significant amount of interesting foundational research under my own auspices where it was not worth the effort to publish. I'm not chasing prestige, I had a problem I needed to solve.
No one should be surprised by any of this.
eg https://news.ycombinator.com/item?id=49088205
On the other hand, I have a custom harness agent running an ecommerce business 100% autonomously at this point, but have very little to benefit from trying to “publish” anything about it - and without a Stanford or YC stamp, I doubt anyone would care much anyway
Think Renaissance Technologies or similar.
Also, there are simply too many AI papers that make peer-review publishing quite meaningless these days (e.g., AAAI this year got more than 50K submissions).
------------
If everyone holds back their publications, the whole sector moves slower. Yes, it's moving alarmingly fast according to many, but is it moving fast enough that the massive investments in data centres will actually pay off?
It's more game theory. Things may go well for one selfish company not publishing in a sea of altruists who publish, but perhaps not if everyone else is selfish too.
It may be moving so fast that they do not pay off, i.e. they get commoditized too fast. This all depends on Ai demand in the end. If you can keep the GPUs saturated (at a profitable rate), then it really shouldn't matter how much a token costs. If you bought too many GPUs, or paid to much for them in a hype cycle, you may need higher token prices to ROI than the market wants to pay given alternatives.
Companies can’t be expected to publish their confidential and proprietary information about their feature development, and academics should consider projects that would have higher impact.
If you’re taking up a seat in a PhD program tinkering with would-be feature ideas for an existing major tech company, you should really just get hired by that tech company, where the resources are abundant and the degree is not required.
Of course they can. Simply eliminate trade secret protections and NDAs, which have literally zero purpose for society and in fact undermine patents' incentive to publish. Give a one year grace period to apply for a patent. Patent protection should be designed to be only as long as needed to try to maximize the development/spread of technology, e.g. maybe 2-3 years for rapidly developing areas like ML.
We should all be expected to contribute whatever knowledge we find to the commons. It makes us all richer.
I don’t think Dario wants to be a monopolist. But history is full of brilliant people who focused on the social good as priority #1 and lost the game early.
Once you lose the game and go bankrupt you can’t do anything. Same as politics, if you’re not elected you can’t change anything. Of course there are many lines not worth crossing.
How do we fix this.
It's like we know things are destined to go down in a flaming pile, and we're just watching so we can change it AFTER that happens.
Soz. Kinda a "dear diary" response, but am frustrated.
How we wish to consider public funding and required sharing of gains is an open debate.
...today? (emphasis is mine) And the author was so excited that decided to write up a paper and submit it to Science all in one day? Yeah, right. That's all you need to know who is moonshooting behind this paper.
Even at work, I have come to realize if I simply horde my accumulated custom AI built tools and productivity boosting tricks for myself, I can make myself more competitive as an employee.
I think this is how you get hired now, not by having a good resume, but by making claims of having special processes and personal tooling design that gets massive productivity ROI.
https://arxiv.org/search/?searchtype=author&query=Magarshak%...
So I know that smart people in those companies can definitely publish. In fact, a whole team should probably be publishing like no tomorrow!
More to the point, without determining how much work is “worthy” of a paper it is unclear how much this matters.
Most AI companies are either a product and marketing layer over a model or not meaningfully moving any dimension to be worthy of a paper.
Also, formal papers and blogs and “cards” are all being intertwined.
We're not racing towards anything. We've been going in circles for years.
We reached the NASCAR-racing equivalent of scientific research.
(Not saying that's how it should be, but that's how it has been.)