OpenAI has released a rejigged version of its original DALL-E program from 2021.

AI research group OpenAI has launched a revamped version of its DALL-E program that generates images from text commands. The all-new DALL-E 2 program is described as an AI system that can create realistic images and art from a description in natural language. For example, the image of the bears on the right is created from the command “Teddy bears mixing sparkling chemicals as mad scientists as a 1990s Saturday morning cartoon.” (OpenAI)

“DALL-E 2 has learned the relationship between images and the text used to describe them.” explains OpenAI. It uses a process called ‘diffusion,’ which starts with a pattern of random dots and gradually alters that pattern towards an image when it recognizes specific aspects of that image.”

Version 2 is more advanced than its predecessor

This new version can generate more realistic and accurate images with four times higher resolution. Evaluators of the new avatar of the program said it was superior for its caption matching and photorealism.

Additonal new capabilities include making realistic edits to existing images from a natural language caption. It can add and remove elements while taking shadows, reflections, and textures into account. In the example below, a sofa has been very realistically added to an empty room.

DALL-E 2 can also take an image and create different variations of it inspired by the original.

OpenAI makes it clear that the program is not yet available to the public via its API. The firm is studying the program’s limitations and capabilities with a select group of users to ensure that its AI developed and deployed responsibly.

“Our hope is that DALL-E 2 will empower people to express themselves creatively. DALL-E 2 also helps us understand how advanced AI systems see and understand our world, which is critical to our mission of creating AI that benefits humanity,” writes OpenAI in its blog.

Related Story: Ai-Da, Humanoid And Ultra-Realistic Artist, Detained By Egyptian Security