Common readers right here at DIYP will recognise the identify Nick Sherlock. Extra generally identified for his adventures with 3D printing, he’s turned his hand in the direction of coding. This time, he’s produced an app for Sony mirrorless cameras known as Quantum Mirror that submits the images you shoot to the DALL-E 2 AI to generate variants of them for some attention-grabbing and typically surreal outcomes.
Nick stresses that he’s not affiliated with both Sony or OpenAI and this isn’t an official app. The truth is, it’s so unofficial that he additionally offered a disclaimer stating that its use will get your account banned – they thought of it a “net scraping instrument”, apparently. So, he says to not set up it, however to verify again as soon as the beta is over and there’s a public API out there. However, for now, its precept is fairly cool.
There are just a few hoops to leap by way of to be able to get it engaged on the digital camera, which Nick particulars over on GitHub with full set up directions for each Home windows and Mac in addition to the configuration on the digital camera itself. However as soon as it’s put in, pictures you shoot can be uploaded to DALL-E and the AI variants it generates are downloaded and saved to the SD card contained in the digital camera. You’ll be able to even view them on the digital camera’s LCD from throughout the Quantum Mirror app.
Not less than, you can in case your account wouldn’t get robotically banned from the DALL-E 2 service. Once more, Nick stresses that this app is a violation of the OpenAI phrases of service and your account can be banned for utilizing it. So, don’t use it. Proper now, whereas DALL-E 2 remains to be in beta, it primarily simply acts as a fairly cool proof of idea. As soon as DALL-E 2 leaves beta and there’s a public API out there, it must be a lot safer to make use of.
To see some samples of the form of variants Quantum Mirror creates, Nick has created an enormous web page of samples on the Quantum Mirror web site displaying each the unique picture alongside 5 variants for every shot – or ten variants within the case of “The Dumpling Woman” and the girders. It’s fairly attention-grabbing to see simply how properly it interprets among the scenes in addition to the way it reimagines them whereas protecting an analogous aesthetic.