ArXiv Declares Independence from Cornell
391 points
7 hours ago
| 19 comments
| science.org
| HN
frankling_
4 hours ago
[-]
The recent announcement to reject review articles and position papers already smelled like a shift towards a more "opinionated" stance, and this move smells worse.

The vacuum that arXiv originally filled was one of a glorified PDF hosting service with just enough of a reputation to allow some preprints to be cited in a formally published paper, and with just enough moderation to not devolve into spam and chaos. It has also been instrumental in pushing publishers towards open access (i.e., to finally give up).

Unfortunately, over the years, arXiv has become something like a "venue" in its own right, particularly in ML, with some decently cited papers never formally published and "preprints" being cited left and right. Consider the impression you get when seeing a reference to an arXiv preprint vs. a link to an author's institutional website.

In my view, arXiv fulfills its function better the less power it has as an institution, and I thus have exactly zero trust that the split from Cornell is driven by that function. We've seen the kind of appeasement prose from their statement and FAQ [1] countless times before, and it's now time for the usual routine of snapshotting the site to watch the inevitable amendments to the mission statement.

"What positive changes should users expect to see?" - I guess the negative ones we'll have to see for ourselves.

[1] https://tech.cornell.edu/arxiv/

reply
hijodelsol
3 hours ago
[-]
I came here to say something similar. As someone who works in a field that applies machine learning but is not purely focused on it, I interact with people who think that arXiv is the only relevant platform and that they don't need to submit their work to any journal, as well as people who still think that preprints don't count at all and that data isn't published until it's printed in an academic journal. It can feel like a clash of worlds.

I think both sides could learn from the other. In the case of ML, I understand the desire to move fast and that average time to publication of 250-300 days in some of the top-tier journals can feel like an unnecessary burden. But having been on both sides of peer review, there is value to the system and it has made for better work.

Not doing any of it follows the same spirit as not benchmarking your approach against more than maybe one alternative and that already as an after-thought. Or benchmaxxing but not exploring the actual real-world consequences, time and cost trade offs, etc.

Now, is academic publishing perfect? Of course not, very very far from it. It desperately needs to be reformed to keep it economically accessible, time efficient for both authors, editors and peer reviewers and to prevent the "hot topic of the day" from dominating journals and making sure that peer review aligns with the needs of the community and actually improves the quality of the work, rather than having "malicious peer review" to get some citations or pet peeves in.

Given the power that the ML field holds and the interesting experiments with open review, I would wish for the field to engage more with the scientific system at large and perhaps try to drive reforms and improve it, rather than completely abandoning it and treating a PDF hosting service as a journal (ofc, preprints would still be desirable and are important, but they can not carry the entire field alone).

reply
bonoboTP
2 hours ago
[-]
Simply anticipating basic push backs from reviewers makes sure that you do a somewhat thorough job. Not 100% thorough and the reviews are sometimes frivolous and lazy and stupid. But just knowing that what you put out there has to pass the admittedly noisily gatekept gate of peer review overall improves papers in my estimation. There is also a negative side because people try to hide limitations and honest assessments and cherry pick and curate their tables more in anticipation of knee jerk reviewers but overall I think without any peer review, author culture would become much more lax and bombastic and generally trend toward engagement bait and social media attention optimized stuff.

The current balance where people wrote a paper with reviers in mind, upload it to Arxiv before the review concludes and keep it on Arxiv even if rejected is a nice balance. People get to form their own opinion on it but there is also enough self-imposed quality control on it just due to wanting it to pass peer review, that even if it doesn't pass peer review, it is still better than if people write it in a way that doesn't care or anticipate peer review. And this works because people are somewhat incentivized to get peer reviewed official publications too. But being rejected is not the end of the world either because people can already read it and build on it based on Arxiv.

reply
bjourne
9 minutes ago
[-]
I really am not sure about that: https://biologue.plos.org/wp-content/uploads/sites/7/2020/05...

The problem is that "optimizing for peer-review" is not the same thing as optimizing for quality. E.g., I like to add a few tongue-in-cheeks to entertain the reader. But then I have to worry endlessly about anal-retentive reviewers who refuse to see the big picture.

reply
stared
2 hours ago
[-]
> arXiv fulfills its function better the less power it has as an institution

It is an interesting instance of the rule of least power, https://en.wikipedia.org/wiki/Rule_of_least_power.

reply
fidotron
47 minutes ago
[-]
The irony of the TBL quotes there being the entire problem with the semantic web is the ontological tarpit that results due to the excessive expressive power of a general triple store.
reply
PaulHoule
13 minutes ago
[-]
Well, I’d argue that many things in the semweb are not expressive enough pand lead to the misunderstandings we have.

People think, for instance, that RDFS and OWL are meant to SHACL people into bad an over engineered ontologies. The problem is these standards add facts and don’t subtract facts. At risk of sounding like ChatGPT: it’s a data transformation system not a validation system.

That is, you’re supposed to use RDFS to say something like

  ?s :myTermForLength ?o -> ?s :yourTermForLength ?o .
The point of the namespace system is not to harass you, it is to be able to suck in data from unlimited sources and transform it. Trouble is it can’t do the simple math required to do that for real, like

  ?s :lengthInFeet ?o -> ?s :lengthInInches 12*?o .
Because if you were trying OWL-style reasoning over arithmetic you would run into Kurt Gödel kinds of problems. Meanwhile you can’t subtract facts that fail validation, you can’t subtract facts that you just don’t need in the next round of processing. It would have made sense to promote SHACL first instead of OWL because garbage-in-garbage out, you are not going to reason successfully unless you have clean data… but what the hell do I know, I’m just an applications programmer who models business processes enough to automate them.

Similarly the problem of ordered collections has never been dealt with properly in that world. PostgreSQL, N1QL and other post-relational and document DB languages can write queries involving ordered collections easily. I can write rather unobvious queries by hand to handle a lot of cases (wrote a paper about it) but I can’t cover all the cases and I know back in the day I could write SPAQL queries much better than the average RDF postdoc or professor.

As for underengineering, Dublin Core came out when I worked at a research library and it just doesn’t come close in capability to MARC from 1970. Larry Masinter over at Adobe had to hack the standard to handle ordered collections because… the authors of a paper sure as hell care what order you write their names in. And it is all like that: RDF standards neglect basic requirements that they need to be useful and then all the complex/complicated stuff really stands out. If you could get the basics done maybe people would use them but they don’t.

reply
light_hue_1
1 hour ago
[-]
> Unfortunately, over the years, arXiv has become something like a "venue" in its own right, particularly in ML, with some decently cited papers never formally published and "preprints" being cited left and right. Consider the impression you get when seeing a reference to an arXiv preprint vs. a link to an author's institutional website.

This just isn't true. arXiv is not a venue. There's no place that gives you credit for arXiv papers. No one cares if you cite an arXiv paper or some random website. The vast vast majority of papers that have any kind of attention or citations are published in another venue.

reply
contubernio
57 minutes ago
[-]
A Fields medal was awarded based mainly on this paper never published elsewhere: https://arxiv.org/abs/math/0211159
reply
ph4rsikal
3 hours ago
[-]
My observation is that research, especially in AI has left universities, which are now focusing their research to a lesser degree on STEM. It appears research is now done by companies like Meta, OpenAI, Anthropic, Tencent, Alibaba, among many others.
reply
bonoboTP
2 hours ago
[-]
Universities (outside a few) just have much weaker PR machines so you never hear what they do. Also their work is not user facing products so regular people, even tech power users won't see them.
reply
0x3f
57 minutes ago
[-]
Not sure about that. How would a university test scaling hypotheses in AI, for example? The level of funding required is just not there, as far as I know.
reply
oscaracso
10 minutes ago
[-]
Universities are also not suited to test which race car is the fastest, but that does not obviate the need for academic research in mechanical engineering.
reply
0x3f
3 minutes ago
[-]
Perhaps but the fastest race car is not possibly marshalling in the end of human involvement in science, so you might consider these of considerably different levels of meriting the funding.
reply
rsfern
28 minutes ago
[-]
This issue of accessibility is widely acknowledged in the academic literature, but it doesn’t mean that only large companies are doing good research.

Personally I think this resource mismatch can help drive creative choice of research problems that don’t require massive resources. To misquote Feynman, there’s plenty of room at the bottom

reply
swiftcoder
2 hours ago
[-]
> raised concerns about the proposed $300,000 salary for arXiv’s new CEO, saying it seemed high

Is a mid-to-high engineering salary outlandish for a CEO of what is likely to be a fairly major non-profit? Even non-profits have to be somewhat competitive when it comes to salary, and the ideal candidate is likely someone who would be balancing this against a tenured position at a major university

reply
mort96
1 hour ago
[-]
Salaries in the US are so bonkers. Everywhere else outside of the US, $300,000 is an outlandish high salary. To call it "mid to high" is insane.
reply
swiftcoder
1 hour ago
[-]
Even in the states, it’s more a distortion caused by the big tech centres. A software engineer in Ohio doesn’t command that kind of salary, but in San Francisco or Seattle that’ll buy you a moderately-senior engineer.

And while academic salaries are generally not great, tenured professors at big universities tend to make a fair bit (plus a lot more vacation time and perks than is normal in the US)

reply
0x3f
1 hour ago
[-]
Not everywhere. Switzerland exists. Also cost of living is a thing so if anything US/CH just ramp up to match that. The rest of Europe has high CoL but terrible salaries. Asia has bad salaries but low CoL (on average).
reply
mort96
56 minutes ago
[-]
According to swissdevjobs.ch[1], the top 10% salary for a senior software developer in Switzerland is 135,000 swiss franc; that's roughly $170,000 per year.

So if this is correct, then even in Switzerland, it seems like $300,000 per year would be an obscenely high salary for a senior developer.

[1]: https://swissdevjobs.ch/salaries/all/all/Senior

reply
0x3f
52 minutes ago
[-]
Well first of all it's a CEO position, not an SWE :)

Even if we scope it to SWE, I don't think that's far off the US percentiles.

In London I imagine the top 10% SWE is not even 100k GBP. In Germany even worse.

reply
mort96
49 minutes ago
[-]
I responded to the idea that $300,000/year is a "mid-to-high engineering salary". CEO salaries are absurdly high everywhere.
reply
0x3f
43 minutes ago
[-]
Oh right, well it depends on CoL doesn't it? You can reframe European salaries as 'obscene' by world standards too. Both the US and Europe have totally broken and unaffordable housing markets, for example, but at least the Bay Area compensates with salary. I would say that relative to costs it's more that other salaries are obscenely low, if anything. People in Europe should be rioting, but unfortunately only the home owners are politically active.
reply
mort96
36 minutes ago
[-]
Does cities like San Francisco not have janitors? Waiters? Food delivery drivers? Or do those jobs command a six-figure salary too? If they can live comfortably in the city on a five-figure salary, maybe the argument that "cost of living is so high in SF that you can't live without a $300,000/year salary" is just a little bit overblown?

I can not imagine what one could possibly need $300,000 per year for unless an apartment costs like $200,000 per year.

reply
0x3f
27 minutes ago
[-]
You get by on a low salary by living with multiple people in the same apartment. Or you live far away and commute. Or both.

Not really a tenable long-term situation for a senior employee with plans to start a family. Family homes of decent size and area are literally millions of dollars.

reply
mort96
25 minutes ago
[-]
I guess I don't understand why programmers somehow deserve a better life than other people. Janitors deserve to start families too, don't they?
reply
0x3f
20 minutes ago
[-]
It's not about deserving, programmers just have enough market power to be able to choose to go elsewhere. Janitors and other more fungible employees do not.

Besides, I did already say that everyone else was underpaid relative to costs. But that's not unique to the Bay Area. Cost of housing relative to income is terrible in almost all of the major European cities too.

Once cities become wealthy enough to develop a home owning class, they seem to cease being able to provision adequate housing supply in general.

reply
dev_l1x_be
1 hour ago
[-]
So is the living cost. Insurance, housing, etc. A better comparison is PPP.
reply
HappyPanacea
1 hour ago
[-]
Yes the obvious play is to move human labor to cheaper countries like France (including CEO of course).
reply
0x3f
1 hour ago
[-]
The net salary in France might be low but the overall cost of hiring is quite high. Besides, why go to the middle when you can just find even cheaper places, if that's your prime metric?
reply
renewiltord
1 hour ago
[-]
The reason the French can’t build these things is the same reason they shouldn’t be allowed to be in charge. It’s a preprint PDF host. Just make your own if you can run this one.
reply
magnio
1 hour ago
[-]
They do have their own: https://hal.science/

It is actually quite common to come across HAL in subfields of mathematics in my experience.

reply
bjourne
3 minutes ago
[-]
HAL is decidedly second-tier. Given the option, everyone would pick arXiv over HAL. Hence, HAL hosts lots of stuff that didn't (even) make it to arXiv => lots of subpar dredge.
reply
Hendrikto
1 hour ago
[-]
For anybody outside the SV, and especially outside the US, this seems high, yes.

arXiv does not need to and should not optimize for “shareholder value”, which is at least nominally the justification for outlandish CEO pay packages.

reply
HappyPanacea
1 hour ago
[-]
arXiv's CEO doesn't need to be a tenured professor equivalent it is a preprint repository ffs.
reply
0x3f
1 hour ago
[-]
It's a bit more complex than an S3 bucket though because the value comes from the reputation network, which can't really be replicated easily.

Though, saying that, I suppose all the reputation data is kind of public. Apart from emails/accounts.

reply
halperter
6 hours ago
[-]
reply
reed1234
6 hours ago
[-]
Should be the main link. The original article is based on the CEO job posting.
reply
psalminen
6 hours ago
[-]
I might be missing something, but I still don't get the why. I don't see any "problem" that needs to be solved.
reply
kolinko
5 hours ago
[-]
The article lists the reasons quite clearly.
reply
binsquare
4 hours ago
[-]
For everyone else,

The reason is because arxiv is growing significantly leading to 297,000 deficit in operating costs for 2025 alone. Corenell has helped with donation a long with other organizations that pay membership fees.

As a result, donors + leaders of arxiv think it's best to spin off to increase funding.

reply
vl
3 hours ago
[-]
What is unclear why they need stuff of 27 and 6.7 million to operate essentially static hosting website in 2026.
reply
swiftcoder
2 hours ago
[-]
The "essentially static hosting" isn't the cost centre (although with 5 million MAU, it's nothing to sneeze at). The real costs are on the input side - they have an ingestion pipeline that ensures standardised paper formatting and so on, plus at least some degree of human review.
reply
bonoboTP
2 hours ago
[-]
Do you mean that the CPU compute cost of turning latex into pdf/HTML is the main cost?
reply
swiftcoder
2 hours ago
[-]
No, I mean that the pipeline requires software engineers to build/maintain, and salaries are (as in basically every tech organisation) the dominant cost
reply
bonoboTP
2 hours ago
[-]
Then drop it and make people upload a pdf and a zip of the latex sources.

Most people I talk to hate that pipeline and spend a lot of debug hours on it when Arxiv can't compile what overleaf and your local latex install can.

reply
domoritz
56 minutes ago
[-]
Arxiv can recompile latex to support accessibility and html. Going to pdf submissions would be a major step backward.
reply
bonoboTP
12 minutes ago
[-]
Make it an external service then, and leave the thing that's already working great to just be.

The reason authors like and use arxiv is that it gives 1) a timestamp, 2) a standardized citable ID, and 3) stable hosting of the pdf. And readers like the no-nonsense single click download of the pdf and a barebones consistent website look.

All else is a side show.

reply
lou1306
2 hours ago
[-]
The PDF formatting is all but standardised. They ingest LaTeX sources, which is formatted according to the authors' whims (most likely, according to whatever journal or conference they just submitted the manuscript to). I'll concede that the (relatively novel) HTML formatter gives paper a more uniform appearance. They also integrate a bunch of external services for e.g., citation metrics and cross-references. Still hard to justify such a high cost to operate, but eh.

Also, the "human review" is a simple moderation process [1]. It usually does not dig into the submission's scientific merits.

[1] https://info.arxiv.org/help/moderation/index.html

reply
OtherShrezzing
1 hour ago
[-]
I don't see it as an especially exuberant structure or budget. I've seen larger teams with bigger budgets struggle to maintain smaller applications.

I've contracted into some consultancy teams which you could uncharitably describe as "15 people and $4mn/yr to create one PDF per month".

reply
u1hcw9nx
5 hours ago
[-]
I think the problem described in 6th paragraph needs to be solved.
reply
juped
24 minutes ago
[-]
>Cornell, for example, had a limited capacity to pay software developers to maintain and upgrade the site, which still has a very no-frills look and feel.

arXiv is doomed. It was nice while it lasted.

reply
contubernio
49 minutes ago
[-]
What is worrisome about this development, and corollary actions like the hiring of a CEO with a $300,000/year salary, is that the essentially independent and community based platform will disappear. The ArXiv exists because mathematicians and physicists, and later computer scientists and engineers, posted there, freely, their work, with minimal attention to licensing and other commercial aspects. It has thrived because it required no peer review and made interesting things accessible quickly to whomever cared to read them.

A setup as a US-based "non-profit" is worrisome, if only because 300K is an obscene salary even in a for-profit setting. That the US-based posters can't see this is evidence of the basic problem which is that the US, both left and right, has been taken over by a neoliberal feudal antidemocratic nativist mindset that is anathema to the sort of free interchange of ideas that underlay the ArXiv's development in the hands of mathematicians and physicists now swept aside and ignored by machine learning grifters and technicians who program computers.

reply
asimpleusecase
4 hours ago
[-]
I wonder if there are plans to licence the content for AI training
reply
mkl
2 hours ago
[-]
It's been available all along: https://info.arxiv.org/help/bulk_data.html
reply
KellyCriterion
4 hours ago
[-]
Id guess OAI & co have already copied without asking?
reply
mkl
2 hours ago
[-]
No need to ask - the whole point is open access. https://info.arxiv.org/help/bulk_data.html
reply
dataflow
6 hours ago
[-]
This sounds terrible. Of course there's a huge risk of it becoming made for-profit. It almost makes you wonder if the academic publishers are behind this push somehow.

Could they not have made it into some legal structure that puts universities at the top? Say, with a bunch of universities owning shares that comprise the entirety of the ownership of arXiv, but that would allow arXiv to independently raise funds?

reply
gucci-on-fleek
6 hours ago
[-]
> Of course there's a huge risk of it becoming made for-profit.

The article says that "it will become an independent nonprofit corporation", and as OpenAI's failed attempt showed, converting a non-profit to a for-profit organization is either really hard or impossible.

> Could they not have made it into some legal structure that puts universities at the top?

As a corporation (even a non-profit one), it will have a board of directors. I have no idea what their charter will look like, but I would be surprised if at least one seat wasn't reserved for a university representative, and more than that seems quite likely as well.

reply
MostlyStable
6 hours ago
[-]
OpenAI didn't get everything that they wanted, but I very much disagree with calling it a "failed attempt". The non-profit went from owning the entirety of OpenAI to having ~25% stake.
reply
ronsor
6 hours ago
[-]
Sam Altman is a special kind of person; not many could pull off the schemes he does.
reply
gentleman11
5 hours ago
[-]
I doubt it was him who architected it. A team of lawful evil lawyers more likely
reply
cbolton
3 hours ago
[-]
The non-profit still controls the board doesn't it?
reply
weedhopper
3 hours ago
[-]
As shown by Altman, not really.
reply
gucci-on-fleek
6 hours ago
[-]
Ah, thanks for the correction.
reply
mort96
1 hour ago
[-]
Is your argument really that "OpenAI was an independent nonprofit corporation and it worked out great, Arxiv will remain just as non-profit as OpenAI"?
reply
gucci-on-fleek
1 hour ago
[-]
No, my argument is that OpenAI could make billions of dollars if they converted from a non-profit to a for-profit, and they only succeeded after years of effort and because they had already structured the company into separate for-profit and non-profit entities. And even after all this, the non-profit still controls the majority of the for-profit entity.

So if OpenAI with billions of dollars only partially succeeded at converting to a for-profit business, then that suggests that organizations with fewer resources (like arXiv) have much worse odds.

reply
bonoboTP
2 hours ago
[-]
I fear their Mozilla-ification and Wikipedia-ification. Scope creep, various outreach feel-good programs, ballooning costs, lost focus etc. And other types of enshittification.

Any change to the basic premise will be a negative step.

They should just be boring quiet unopininionated neutral background infrastructure.

reply
Hendrikto
1 hour ago
[-]
> Mozilla-ification

All the Mozilla executives have done for the last 15+ years is

* lay off developers

* spend lots of money on stupid side projects nobody asked for or wants

* increase their own salaries

and all that with the backdrop of falling quality, market share, and relevance.

I would happily donate to Firefox, but this fucked up organization will never see a single cent from me. They will spend it on anything but Firefox, which is the only thing anybody wants them to spend it on.

It might already be too late, and we will be left with a browser monopoly.

reply
bonoboTP
3 minutes ago
[-]
And it is a risk for Arxiv too that once they start to drink the koolaid and start going to the same cocktail parties that these kinds of nonprofit board members and execs go to and will feel the need to prance around with some fancy stuff.

"oh no, you see we are not a preprint server host anymore, our mission is a values driven blablabla to make a meaningful change in the blablabla, we have spent X dollars to promote the blablabla, take me seriously please I'm also fancy like you! "

reply
kergonath
1 hour ago
[-]
> They should just be quiet unopininionated neutral background infrastructure.

Exactly. It should be a utility. Not quite dumb pipe, but not too far either.

reply
tornikeo
6 hours ago
[-]
Now the question is, will arxiv wage a decade long bloody war with Cornell, using heavy infantry (PhD students), archers (reviewers) and field artillery (AI slop papers), or will the independence be mostly peaceful? Only time can tell.
reply
alansaber
6 hours ago
[-]
PhD students are levy infantry at best with Postdocs being the armoured levies.
reply
dmos62
4 hours ago
[-]
Is this Gondor or Mordor?
reply
Aerolfos
3 hours ago
[-]
And they hired a LinkedIn business idiot to run the new organization - so the aim is for an infinite growth tech startup in terms of governance, despite the technical legal status of non-profit. It shows in the language they use in the announcement, too ("improved financial viability in the long run")

OpenAI shows exactly how well that works and what that kind of governance does to a company and to its support of science and the commons.

TL;DR, it's fucked.

reply
vedantxn
1 hour ago
[-]
we got this before gta 6
reply
Garlef
4 hours ago
[-]
Maybe they should implement a graph based trust system:

You need your favourite academic gatekeeper (= thesis advisor) to vouch for you in order to be allowed to upload.

Then AI slop gets flagged and the shame spreads through the graph. And flaggings need to have evidence attached that can again be flagged.

reply
justinnk
4 hours ago
[-]
They already had a basic form of this for a while [1]

> arXiv requires that users be endorsed before submitting their first paper to arXiv or a new category.

[1] https://info.arxiv.org/help/endorsement.html

reply
pred_
4 hours ago
[-]
The endorsement system already works along that line: https://info.arxiv.org/help/endorsement.html

It's probably not perfect but in practice, it seems to have been enough to get rid of the worst crackpotty spam.

reply
ryangibb
4 hours ago
[-]
reply
dmos62
4 hours ago
[-]
I've often thought that similar trust systems would work well in social media, web search, etc., but I've never seen it implemented in a meaningful way. I wonder what I'm missing.
reply
IshKebab
4 hours ago
[-]
Lobsters has this I think. But it also means I've never posted there.
reply
ChrisGreenHeur
3 hours ago
[-]
Science reduced to people with a phd?
reply
OutOfHere
5 hours ago
[-]
With 300K for the CEO, its enshittification will commence imminently. It will now serve to maximize revenue. Just wait and watch while they issue a premium membership, payment requirements for authors, and other revenue generators to please their investors.
reply
exe34
5 hours ago
[-]
they'll just turn into a shitty journal at this point, they just need to introduce peer review and they can start competing with the real journals on price point.

another will need to rise to take its place.

reply
OutOfHere
5 hours ago
[-]
> they'll just turn into a shitty journal at this point

To this end, they added an endorsement requirement this year: https://blog.arxiv.org/2026/01/21/attention-authors-updated-...

reply
adamnemecek
6 hours ago
[-]
Good call, ArXiv seems like one of the most important institutions out there right now.
reply
kergonath
1 hour ago
[-]
The French government put a bit of money on the table to help researchers fulfil their open science requirements for government and EU grants, and funded the HAL repository ( https://hal.science/ ). It’s much smaller than arXiv, but it exists. In other countries like the UK there are clusters of smaller repositories as well, but it’s not as well centralised.
reply
p-e-w
6 hours ago
[-]
It’s so important, in fact, that there should be more than one such institution.

People keep falling into the same trap. They love monopolies, then are shocked when those monopolies jerk them around.

reply
auggierose
6 hours ago
[-]
I am using Zenodo for a while now instead. It is more user friendly, as well.
reply
Al-Khwarizmi
3 hours ago
[-]
I like it as well, it works great. But I wonder if it would scale if at some point there were a massive exodus from arXiv.
reply
auggierose
2 hours ago
[-]
I think it already hosts much more data than arXiv, given that they also host large datasets.
reply
mastermage
5 hours ago
[-]
Zenodo is more for IT Papers and also datasets isn't it?
reply
auggierose
4 hours ago
[-]
It can host large datasets as well, yes. It is hosted by CERN, so it is not specifically IT in any way. It also allows you to restrict access to the files of your submission. It has no requirements to submit your LaTeX sources, any PDF will be fine. There are also no restrictions on who can publish. You'll get a DOI, of course.

Everything published on arXiv could also be published on Zenodo, but not the other way around.

reply
freehorse
4 hours ago
[-]
It is just a preprint repository. It is pretty open (the stories where a preprint was rejected or delayed unreasonably are extremely rare). It offers the basic services for a math/compsci/physics themed preprint repository.

I don't see much of a monopoly, nor any "moat" apart from it being recognised. You can already post preprints on a personal website or on github, and there are "alternatives" such as researchgate that can also host preprints, or zenodo. There are also some lesser known alternatives even. I do not see anything special in hosting preprints online apart from the convenience of being able to have a centralised place to place them and search for them (which you call "monopoly"). If anything, the recognisability and centrality of arxiv helped a lot the old, darker days to establish open access to papers. There was a time when many journals would not let you publish a preprint, or have all kinds of weird rules when you can and when you can't. Probably still to some degree.

reply
andbberger
6 hours ago
[-]
there is. bioarxiv.
reply
koakuma-chan
5 hours ago
[-]
it just hosts pdfs, no?
reply
aragilar
4 hours ago
[-]
It does do a fair amount of filtering of submissions, and it's a long term archive (e.g. for the next 100+ years). I suspect both (but with the former dominating) are the issue.
reply
bonoboTP
2 hours ago
[-]
Just put out a torrent and people of the sort at r/DataHoarder will keep it alive for longer than bureaucrats.
reply
freehorse
4 hours ago
[-]
Well, technically, it can also compile your tex file if you upload the tex file instead of the pdf directly, which helps a lot in standardizing the stylistic structure between preprints. Most other repositories are wild west and inconsistent. I really appreciate the similarity in style applied to most preprints there. Moreover, this means you can also download not just the pdf, but the source tex file to, which can be very useful.
reply
bonoboTP
2 hours ago
[-]
The similarity in style comes from conference and journal templates, not from Arxiv. You can style your paper with latex in any style, Arxiv doesn't care. On Arxiv you mostly see preprints that people submit to conferences and journals and they enforce the style.
reply
pfortuny
4 hours ago
[-]
Also the sources and has a very tame but useful pre-acceptance process.
reply
IshKebab
4 hours ago
[-]
Technically yes, socially no.
reply
Peteragain
5 hours ago
[-]
.. and soon to be dependent on US military funding? Controlled by someone who has run-ins with universities? This'll end in tears.
reply
shevy-java
3 hours ago
[-]
"Recently arXiv’s growth has accelerated. Since 2022, it has expanded its staff to 27, in large part to deal with a 50% increase in submitted manuscripts."

I am wary of that. IMO the business model is damaged therein. You can say in 2022 we had 27; bankrupt in 2030.

reply
ACCount37
1 hour ago
[-]
Frankly, the only beef I have with arXiv as is: its insistence on blocking AI access.

I had to tell my AI to set up an MCP for "fetch while bypassing arXiv's rate limit" so that it doesn't burn 40k tokens looking for workarounds every time it wants to look at a paper and gets hit with a "sorry, meatbags only" wall.

Very annoying, given how relevant arXiv papers are for ML specifically, and how many of papers there are. Can't "human flesh search" through all of them to pick the relevant ones for your work, and they just had to insist on making it harder for AIs to do it too.

reply
davnicwil
5 hours ago
[-]
Very unrelated to the article, but I think 'arXiv' as a brand is bad, and really detrimental to what the institution aims to accomplish.

That is, it's not readily parseable, it really gives an insider term vibe - like this isn't for you if you don't already know what it means or how you should read or say it. It sort of reminds me of the overuse of latin and latinate terms generally in the old professions and, well, the academy.

Just always struck me as being somewhat at odds with the goal.

reply
john-titor
5 hours ago
[-]
I wonder what makes you feel that. I've been publishing preprints close to a decade on arxiv now and never had any particular feelings about it.

To me it's just a way to get out your work fast, so that there is already a trace of it on the Internets - nothing more and nothing less.

> That is, it's not readily parseable, it really gives an insider term vibe...

Isn't that normal with highly specialized research fields? I agree many papers could benefit from clearer wording, but working in a niche means you sometimes don't reach a broader audience

reply
davnicwil
5 hours ago
[-]
It's an opinion, and you feeling no particular way about it is equally valid.

But I did justify and maybe to reword slightly, surely if one of the main drivers is opening up research, the brand name should be something that's less obscure and more accessible / understandable as to what it is on first sight?

Maybe arXiv evoking the word 'archive' with an ancient Greek twist does that for some, but it's clearly a bit cryptic for many, and if the point is to open up probably the brand should just be something much plainer.

reply
aragilar
4 hours ago
[-]
No, it's to be a pre-print server. If someone doesn't know what that means, then they shouldn't be using arXiv.
reply
davnicwil
4 hours ago
[-]
everyone has a first time they see a thing and don't yet know what it is.

Using a brand as a filter where you have to already know what it means to get it is exactly the opposite of what it's supposed to achieve.

Consider the most exclusive (successful) brands that exist. Even there, where exclusivity is a brand goal, none of them have this property of being obscure on first contact.

reply
bonoboTP
1 hour ago
[-]
You usually get introduced to it by your academic supervisor or collaborators as a masters or PhD student. If you're a solo researcher who has made a significant contribution on the frontier of science, I'm sure you'll be able to understand how Arxiv works as well. Because I assume you have had some conversations with other experts in the field. If you're a full on autodidact with no contact to any other researchers in the field, well, maybe it's better if you chat with some other people in that field.

Its reasonable to have a tradeoff here to avoid cranks and now AI psychosis slop. You can still post on research gate and academia.edu or you own github page or webhosting.

reply
Cordiali
1 hour ago
[-]
I've never even connected the 'X' to the Greek letter chi. I just kinda accepted it as one of many groovy web 2.0 misspellings in search of a domain and trademark.
reply
jltsiren
5 hours ago
[-]
It's a classic story of someone having to pick a name quickly, which then gets established long before anyone who cares about branding is aware of its existence.

The original service didn't even have a name, only a description, and it was amusingly hosted at xxx.lanl.gov. But LANL wasn't really interested in it, and the founder eventually left for Cornell. At that point, the service needed a domain name, but archive.org was already taken.

And besides, the name has Ancient Greek influences. A similar Latinate term might be something like "archive".

reply
bonoboTP
1 hour ago
[-]
I thought the X was an allusion to LaTeX.
reply
davnicwil
4 hours ago
[-]
Interesting, thanks for the context! Makes it more understandable as a choice.
reply
nixon_why69
5 hours ago
[-]
> like this isn't for you if you don't already know what it means

Isn't that actually kindof a good brand signal for a repo of very specialized papers? "Fun with learning" in comic sans wouldn't help credibility.

reply
vasco
5 hours ago
[-]
This the type of guy that will suggest paper.ly as a better name with a straight face and then we wonder why the internet is turning to shit
reply