LookingGlass: Generative Anamorphoses via Laplacian Pyramid Warping
98 points
14 hours ago
| 9 comments
| studios.disneyresearch.com
| HN
https://www.youtube.com/watch?v=B3AZay43688
quitit
1 minute ago
[-]
If this interests you, you might also like the below:

https://diffusionillusions.com

https://dangeng.github.io/visual_anagrams/

There are also videos with the process explained

reply
mg
7 hours ago
[-]
This reminds me a bit of a project I am currently doing where I swap adjacent pixels in the last image of short video sequences until it resembles the first image:

https://www.instagram.com/marekgibney/reel/DILksFYNSkE/

reply
vintagedave
3 hours ago
[-]
That's quite an extraordinary effect. There's a point where enough pixels have been swapped that you can see the original, and it jumps out, and thereafter the image is quite surreal before eventually being 'tinted'.

(Also shows the video compression in the final frame well, because it doesn't match the first frame. Just found that interesting.)

reply
mg
1 hour ago
[-]
Thanks. Yes compression arteficts always become very visible. Especially in low-detail areas like the sky.
reply
cornstalks
13 hours ago
[-]
This reminds me of Stand-up Maths and Steve Mould creating a puzzle that has two solutions with two different images: https://www.youtube.com/watch?v=b5nElEbbnfU
reply
ygritte
7 hours ago
[-]
It looks like this could be used for some form of steganography. You need the right mirror form for decoding.
reply
serf
3 hours ago
[-]
laplacian pyramid warping or just anamorphosis?

'anamorphic encryption' schemes have been used for hundreds of years.

reply
jkhdigital
36 minutes ago
[-]
Can you give a specific example? The term “anamorphic encryption” was used in a paper from EUROCRYPT 2022 and I don’t see any prior formal study of the subject. A follow-up paper from PoPETS 2023 establishes that most of the widely-used cryptosystems introduced over the past few decades are indeed capable of anamorphism but nobody used the term “anamorphic encryption” until the last few years.

To say that they have been used for “hundreds” of years seems like a sweeping generalization in need of better context.

reply
fudged71
13 hours ago
[-]
I love how many optical illusions have been revisited with new generative techniques
reply
low_tech_punk
8 hours ago
[-]
Are there other examples? Definitely curious to see more.
reply
cdcox
5 hours ago
[-]
Visual anagrams popped up last year using similar, though simpler methods to those in the posted. Flips, internal rotations, rearrangements, color negatives etc. [0]

Diffusion illusions did something similar at about the same time but with puzzles and multi-image color layer mixing. Some of the double puzzles they made are a lot of fun. They have great explainer videos [1] on that site including with Steve Mould.

Also there are diffusion double/hidden images using qrmonster, illusion diffusion, control net, or img2img that have been making the rounds. [2] for a random example. These work by using a fine-tuned diffusion model[3] to take an image and use it as a structuring element at various levels of following to a generated image. To see these illusions, squint or move the screen away. These are quite a bit more popular and easy to make than the other methods so many more examples show up around the internet.

[0] https://dangeng.github.io/visual_anagrams/

[1] https://diffusionillusions.com/

[2] https://www.reddit.com/r/StableDiffusion/s/nm9QMV6roD

[3] or a base model in the case of img2img

reply
agumonkey
3 hours ago
[-]
Happy to see that Disney is still as active as always in research
reply
krick
10 hours ago
[-]
Oh great. Now I suddenly feel the urge to acquire a physical oddly shaped lens or mirror.
reply
echelon
13 hours ago
[-]
Disney invited me to talk about my GenAI startup and research in front of a bunch of their execs across ABC, ESPN, Pixar, Streaming, etc. All of their folks were super nice and gracious to our small startup except for one.

Steve May basically scoffed at how little my small team could accomplish. Mind you we were using mocapped skeletal animation and object animation curves to fully steer video diffusion over a year and a half ago. Before image to video modalities. He picked apart our training and engineering and gloated that they could do better.

The incident is seared into my brain.

I can't help but think of Disney as the Empire and Pixar as the Death Star.

reply
w_for_wumbo
10 hours ago
[-]
If he was upset - it wasn't how little your team could accomplish. That would bring the feeling of admiration. It's most likely projection of their inability to deliver results.
reply
dmos62
6 hours ago
[-]
Sounds like the guy felt threatened by your business and insecure about his.
reply
oidar
11 hours ago
[-]
> gloated that they could do better.

did they? Anything good come from that meeting?

reply
spuz
12 hours ago
[-]
So the classic Silicon Valley brain rape is actually real?
reply
ziofill
10 hours ago
[-]
Don’t get me wrong, this is very neat. But why?
reply
yard2010
6 hours ago
[-]
For science. Many many small and unrelated breakthroughs can amount to something you wouldn't think of, just like what happened with "AI"
reply