Google Books (or similar) all book scans – $200k bounty (2025)
137 points
2 hours ago
| 13 comments
| software.annas-archive.gl
| HN
ahmedfromtunis
1 hour ago
[-]
I live in a country where the selection of available books, especially in English, is very limited. Buying online from foreign markets comes with a long list of administrative hurdles and limits.

If it were not for Anna's Archive and Z-Library, I would've never been able to read the books that shaped who I am today, or keep my passion for learning alive.

Thanks, AA and ZLib! (Also, thank you to the authors whose books and knowledge I consumed without being able to pay them back.)

reply
jvm___
13 minutes ago
[-]
https://send.djazz.se/

This is key for getting epubs to your Kobo.

reply
christofosho
8 minutes ago
[-]
reply
dr_dshiv
24 minutes ago
[-]
https://SourceLibrary.org has about 16,000 rare books translated — most for the first time. 50,000 books archived (will be translated when we have $$ for it). More tokens than English Wikipedia and about .75 petabytes.

Come check it out! You can get an API key or MCP in Claude.

reply
hereme888
4 minutes ago
[-]
The link sort of reads like people who have very easy access to the requested material. Almost like they're Google employees.
reply
trilogic
1 hour ago
[-]
Who is behind Annas archive, there is a lot of english speakers involved in the team and forums! Anyway as long as buying isn´t owning no issues here.
reply
DeepYogurt
50 minutes ago
[-]
Anyone afraid of being laid off at google right now? Perhaps this is a backup :)
reply
Cthulhu_
35 minutes ago
[-]
I think if you get caught exfiltrating data they'll sue you for much more than $200K.
reply
imhoguy
11 minutes ago
[-]
I don't think anybody would do it purely for money. I would rather see someone who is terminally ill and decides to do some "good".
reply
merpkz
24 minutes ago
[-]
Copy data into extra large capacity micro sdcard and hide it in your rubiks cube, nobody will suspect a thing
reply
diab0lic
7 minutes ago
[-]
It’s the “ Copy data into extra large capacity micro sdcard” step that gets you caught. Nobody is stopping you from leaving with an SD card or USB stick at Google.
reply
takipsizad
7 minutes ago
[-]
I wish an extra capacity SD card was enough, google books holds (probably) an insane numbers of books
reply
the_real_cher
29 minutes ago
[-]
If your money is in private crypto or offshore you have nothing to worry about.
reply
zuzululu
7 minutes ago
[-]
i'd strongly caution anybody foolish enough to go down this path

financial watchdogs and international treaties make it impossible unless you are perhaps a multi billionaire who can afford to buy people at the political level

reply
mock-possum
25 minutes ago
[-]
Except perhaps jail time.

Lying about your assets to avoid paying a lawful fine is criminal. Just because they can’t see your money doesn’t mean they can’t prove that you have it, and can’t jail you for hiding it to get out paying a fine.

reply
LastTrain
5 minutes ago
[-]
So is stealing
reply
LearnYouALisp
11 minutes ago
[-]
Google, Amazon, and FB: It's not me, right
reply
delichon
26 minutes ago
[-]
It seems like bounties for new sources of training data would be useful to the big model builders. I follow a guy who hoards vast quantities of old analog media of all kinds, a lot of it local. Bounties could be a way for him to cash in. But I'm not sure if it's an appreciating asset or if they'll find it anyway and it'll lose its value.
reply
neilv
1 hour ago
[-]
The US should just find a way to quietly share literature access with the Russians, rather than letting piracy be promoted and facilitated for US consumers as freedom-fighter "archiving".

Between all the piracy, and all the AI training and the purchase/visitor-circumventing AI services, the practice of writing and publishing genuinely good work is being wiped out.

We're killing the goose that lays the eggs, for selfish gain.

reply
TFNA
31 minutes ago
[-]
This ship has sailed for academic publications, and academics define that term very liberally because we want to read everything, fiction included. The shadow libraries started off as a way for scholars in ex-Soviet countries in particular (but also India, SE Asia, etc.) to access literature that simply wasn’t available in their country. But the shadow libraries proved so successful and convenient that researchers in all countries are using them now, even if they have access to official subscription services. I use AA several times a day and so do the researchers around me in my office; at conferences, if the presenter mentions an interesting publication, the whole room immediately opens AA on their laptops, etc.

Even if projects like AA didn’t have nation-state-level support, academics would find a way to keep as much of it as possible going. After all, we’re the ones who do all the hard work of scanning from our institutional libraries stuff that doesn’t exist anywhere in digital form.

reply
mjburgess
35 minutes ago
[-]
Possibly but this act of governmental self-harm is useful to The People. We live in a world where if your valuation is ~1T you can more or less just do what you like. And the work of The People is stolen from you and launderd.

In such a world, isnt it useful that governments are stupid enough to give adversaries reasons to undermine it? When the government props up a corporate tyranny domestically, and racketeering, should we make a temporary alliance with all its enemies?

(Eg., the provision to AI companies of all corporate secretes and competitive practices via prompts, eventually to be used against their capital interests and their labour interests).

reply
LearnYouALisp
8 minutes ago
[-]
So when will the American people form an "Incorporation" to lobby against business for them?
reply
bix6
1 hour ago
[-]
Piracy / copyright predictions?

The current situation feels untenable with renting. So many regular people I know have learned about VPN, NAS, etc.

reply
codemog
1 hour ago
[-]
Hopefully the guillotines. Look up how much the authors and artists who create the actual work get paid.
reply
0x3f
13 minutes ago
[-]
Quite a few textbook authors I know are paid well to be part of the whole scheme (kickbacks, forced yearly repurchase for the 'online' component of books, etc). So I think it varies a lot.
reply
specproc
1 hour ago
[-]
It was never sustainable, just regulatory capture by large IP owners.

Spotify, Netflix, Amazon etc provided OK value for a while, but now enshitification is biting, this is due a massive comeback.

reply
hedora
1 hour ago
[-]
I wonder how long it will be before they offer bounties for internet scrapes.

Cloudflare captchas have made the internet unusable for me, and I'm sure it will only get worse over time. I'd much rather just browse (or even torrent) a copy of archive.is or similar. The latter would be much better for privacy, and hey, I run ad blockers anyway.

reply
rvnx
1 hour ago
[-]
https://x.com/CloudflareDev/status/2031488099725754821

Well, there is this little conflict of interest

reply
aspect0545
1 hour ago
[-]
reply
wxw
1 hour ago
[-]
Some more interesting bounties they offer: https://software.annas-archive.gl/AnnaArchivist/annas-archiv...

> Purchase all Library of Congress MARC datasets — $3,000 bounty

> English Wikipedia pages about relevant institutions — up to $100 per new page

> Internet Archive Digital Lending — $5000 per 1 million pdf files

> Text version of our full library — $20,000

...

reply
FerritMans
1 hour ago
[-]
So AA is a front for openai?
reply
650REDHAIR
44 minutes ago
[-]
How did you come to that conclusion?
reply
awakeasleep
56 minutes ago
[-]
the bounty would be a bit higher with openAI money behind it
reply
OrangeDelonge
1 hour ago
[-]
Curious as to how you would approach this. I have no experience in this area, anyone on this forum willing to share their expertise?
reply
0x3f
17 minutes ago
[-]
If it works as AA seems to theorize, you'd need to:

  (a) work out how Google books exposes fragments of books, and see if there's a systematic way of using this to get whole books.  For example, a naive approach might be to find any fragment of the book by searching some exact phrase.  Then, you can search for an exact phrase from the start or end of the fragment it gave you, hoping it will show you the previous or next part of the book.  You can then just loop that to get the whole book.

  (b) once you have (a), you need a way of bypassing Google's bot detection/rate limiting.  I don't know what current state of the art is, but there may be a solution for sale out there.  E.g. you pay to receive a cookie or browser state, and use that to fetch the URLs from (a).  Or if you're good/already in the scene, you could do this part yourself.
reply
ThrowawayTestr
1 hour ago
[-]
One of my hopes is that when the AI bubble bursts, some brave person will sneak out a copy of the last frontier model.
reply
Aboutplants
1 hour ago
[-]
Not worried about that, you will only have to wait 3-6 months and get a Chinese model just as good.
reply
sulam
37 minutes ago
[-]
That’s misunderstanding why these models are behind. A large part of why they’re behind is they aren’t able to do the reinforcement learning post-training steps that takes a pre-trained model and turns it into a frontier model like GPT 5 or Opus. Instead they do their best to recreate these models using distillation.

Fundamentally, you can never distill your way to being the teacher, so these approaches will not advance the frontier.

[edit, after thinking about it I think my phrasing is unfair. It's not necessarily that aren't able to do it, but they haven't yet shown that they are willing to do it.]

reply
computerex
16 minutes ago
[-]
That’s not remotely true. They did distillation as a cheap solution to the cold start problem. You need data/trajectories to hill climb to higher capabilities. All large Chinese labs do RLAIF.
reply
sulam
10 minutes ago
[-]
Oh yes, not remotely true. Which is why the frontier labs all have invested heavily in trying to identify and thwart distillers, using known company names / domains to drive their exclusion lists.

/s

reply
FpUser
16 minutes ago
[-]
>"they aren’t able to do the reinforcement learning post-training steps"

Not yet.

If there is a need someone will come and fulfill. Personally for me now I do not even want to use top models. Professionally I use AI to help with the coding using Junie agent that comes with IDEs from JetBrains. Junie is told to use Gemini Flash and works fine for what I ("I" being an emphasis here) ask it to do. I tried more advanced models and different vendors only to discover credits going down the toilet without any extra benefit.

reply
sulam
9 minutes ago
[-]
I'll agree I guess and clarify that the better phrasing is probably something like "haven't yet shown the capability to."
reply
yorwba
1 hour ago
[-]
Chinese companies giving away expensive models for free is a symptom of the AI bubble, too. It's not a law of nature that they'll always be able to scrounge up the money for yet another training run.
reply
gpm
1 hour ago
[-]
Shaping the tool that does the thinking is quite valuable when you're in the business of changing how people think - I think we can expect propaganda agencies to be subsidizing model creation forever.

This doesn't strike me as a symptom of a bubble - except in so far as the bubble pushes the competitors models forwards and thus they need to invest more to stay competitive.

reply
rvnx
51 minutes ago
[-]
All the models, have to respect their local laws, and most of all, pressure from users and the employees.

They all carry political weights, because humans behind defend their interests, and are promoting some social values.

https://pastebin.com/hjhvsBFg

This answer from Claude is so biased that it is ridiculous

reply
nextos
1 hour ago
[-]
I think it's a deliberate business strategy of commoditization of their complement.

China acts like an entire bloc, not as single companies, and they want to monetize hardware.

reply
zuzululu
5 minutes ago
[-]
which will be very difficult to run unless you have a large budget to operate your own mini datacenter
reply
fastball
37 minutes ago
[-]
If it's a bubble, why do you care about frontier models?
reply
FpUser
13 minutes ago
[-]
Internet was a bubble, so was telecom etc. at some point. Being bubble does not mean that when 90% of investments go down the drain the remains are not useful.
reply
thx67
41 minutes ago
[-]
Prediction markets can solve this.
reply