Home » today » Technology » Text-to-Video Technology Revealed by Runway Company

Text-to-Video Technology Revealed by Runway Company

Runway, a company specialized in artificial intelligence technologies, revealed that it has launched a service that relies on generative artificial intelligence technology to convert texts into video clips.

The new service relies on a technology similar to that used in image generation services from texts such as DALL-E or MidJourny, with the difference that instead of generating images, it converts written text into video.

In addition to converting the text into a video, users can provide the service with a photograph to convert it into an animated video clip, with the ability to write text describing how to animate the image or the effects they wish to add to the video, such as lights, rain, or any other moving elements that are not present in the original image.

It is noteworthy that this is not the first time that the technology for converting text into video clips has been announced, as Meta has previously announced a similar technology called Make-A-Video, and Alphabet has announced Imagen technology. However, the two technologies mentioned are still research papers, unlike Runway’s technology, which will soon be available as an open service to all users after a short period of testing. Users can register on a private waiting list to get an invitation to try the service as soon as it becomes available.

Related topics to what you are reading now:

The company posted on its website videos showing the capabilities of the technology. She said that the user can describe the main scene in the desired video, the camera angle and the way it moves, and various other things such as the degree of lighting, color style, and any additional effects that the user wants to see in the final video.

Although the resulting videos appear to be low-resolution and have a high degree of noise, this technology is considered a new quantum leap in the field of generative AI that has gone beyond text and image generation to video generation, which is more sophisticated and complex in comparison. With the development of this technology over the next few years, experts believe that it will reach a stage that will allow publishers and video makers to produce video clips on demand and in high quality without the need to purchase or film them themselves.

Related news:

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.