Unimaginable AI footage imagines Harry Potter was shot vertically By Daniel Piper printed 14 July 23 Harry Potter and the Format of TikTok

We have seen loads of bizarre examples of AI generated imagery, together with Photoshop’s gorgeous Generative Fill, able to, because the title suggests, filling a picture with an AI-generated background. Fewer examples of AI video have finished the rounds (save for Will Smith consuming spaghetti – hyperlink on the backside if you happen to’re so inclined), however this model of generative fill for video is fairly unbelievable.
A Reddit person has shared a video exhibiting how AI mannequin StableDiffusion has been used to fill within the tops and bottoms of pictures from the Harry Potter movie sequence, creating the impact that they have been filmed in a vertical orientation – and it’s miles extra authentic-looking than you’d anticipate. (Searching for extra AI strangeness? Take a look at the weirdest artwork created with AI.)
utilizing AI to fill the scenes vertically from r/StableDiffusion
The video exhibits how solely a small fraction of the picture is from the precise film – the remainder is AI generated. And from hospital rooms to the Hogwarts college corridor, it appears StableDiffusion has no hassle producing plausible units from the movie franchise.
Reddit customers are impressed with the footage, however many have additionally identified potential limitations. “One of the vital elegant implementations of AI I’ve seen in terms of content material. It really works superbly on these clips,” one feedback, “however I’m wondering what number of varieties of scenes it would not work nicely with. I believe there is a excessive variance between varieties of pictures it aces or completely botches.” “Yeah it’ll solely work nicely on pictures which might be static/locked digicam, or that may be tracked and stabilized, outpainted, then re-matchmoved,” provides one other. “And if individuals cross the sides of what is being outpainted, you will have all the standard flickering and inconsistency issues.”
Nonetheless, it is clear that when it really works, it actually works. And even in only a few quick months, we have come a great distance from that Will Smith spaghetti video. Not that we must be stunned – simply look how a lot MidJourney has improved in a single 12 months.