What if there is no "super intelligence"???
What if what we have already (our human intellect in its most perfect/refined form) is already the pinnacle?
What if you can't be "smarter" than that? Just faster/more focused/etc.
What if "super intelligence" is not about something smarter than us...but simply, about, finally the primacy of intelligence as some kind of moral sorter/divider?
The restoration/establishment of "raw intelligence" as a moral virtue or north star? The primacy of true intellect?
No more woolly thinking, no more fake hand-wavey ideas. What if "AI super intelligence" is really about fading out all the bs "intelligence" and surfacing/primarying true intellect?
Idk. Just an idea.
For instance the problem with high energy physics is not that people don't have ideas but rather we have limited experimental and observational results that would let us tell one theory from another.
Similarly I don't think more intelligence would help in solving the Collatz conjecture.