OpenAI Introduces Sora:now anyone can be a filmmaker!

Do you remember this video of The Rock eating rocks generated using AI a few months ago? We all thought that AI generated videos will never reach the realism shot from a DSLR or smartphones camera but we were wrong and just after a few months, here we are with the sora model by OpenAI and it can generate unbelievably hyper-realistic AI videos, first check what even the best AI video generators were capable of a few months ago-

versus what they are capable of now-

  • Sora is OpenAI’s text-to-video generative AI model capable of creating realistic scenes from textual prompts.
  • Sora’s capabilities of simulating complex physics and accurately maintaining spatial details are better than other text to video generators like pika, midjourney.

Yes!!! this video of a man reading a book and sitting on a cloud are generated by AI! AI have very far very fast and the above video was created by OpenAI’s sora model. Let’s learn more about it.

what is openai sora?

We’re teaching AI to understand and simulate the physical world in motion, with the goal of training models that help people solve problems that require real-world interaction.

– openai sora team

The sora(means sky in Japanese) model was launched by OpenAI’s SORA marks the beginning of a new era in film making and video production.Sora will change everything, I mean look at videos below generated using sora, they don’t look like they were created using AI on computers!Unbelievable. However, Sora is not yet available to the public but after analysing the demo video samples produced using Sora, it is huge improvement over the other text-to-video generation models like midjourney, pika etc. The overall details, physics, motion, reflections and model composition are extremely accurate and unbelievable hyperrealistic. However, when there are more than on subjects in the output, either one of the subjects will have a bit of deformed composition, for example in the below video there are 2 subjects, one is cat and additionally, there is a women sleeping next to the cat, the model generates the cat perfectly but the appearance of the women is deformed but overall the video generation quality is.

In another video shared by OpenAI Sora, we can witness a close-up shot of a Victoria crowned pigeon that showcases its striking blue plumage and red chest. Notice how well the Sora model handles the composition and accuracy of proportions as the pigeon breathes and it’s feathers adjust to the breathing motion.

In my personal opinion on openai sora, it is extremely good at generating buildings, environmental objects, birds and animals(Maybe Openai loves birds and animals too much). Sora can generate people perfectly well so much so that they are indistinguishable from the real ones but the motion is still far from perfect and needs drastic improvement. Sora can handle proportions and aspect ratios very well and it can generate one of the best time lapses ever generated by an AI model. Look at the video of a litter of golden retrievers playing in snow –

As you can see in the above video it is completely indistinguishable from a real life video shot on a professional camera. Sora changes everything in the field of video production.

Here are some more videos generated using openai sora –

openai sora review.

how openai sora and other ttv models works?

Text-to-video AI generators use natural language processing and machine learning algorithms to generate videos from text instructions. The AI model analyzes the input text, starts generating each frame of video pixel by pixel based upon the given input and generates individual scenes for the video, determining the visual elements, characters, backgrounds, and other contextual information required for each scene. The AI then animates and renders the scenes, producing a video that matches the user’s prompt. Some text-to-video generators use autoregressive transformers in natural language modeling, while others learn from image and video datasets with already given descriptions. The generators can vary according to the company, but they all aim to create dynamic and lifelike videos based on written input. However, text-to-video conversion is more demanding and complicated than text-to-image generators, as the AI has to work harder to predict how well the image shifts in time and has to produce numerous images in sequence to maintain subject consistency.

How sora compares to other models like lumiere by Google and more

OpenAI’s SoRA outperforms other AI video generators in creating high-quality, detailed videos up to 1 minute long. Sora uses a diffusion transformer architecture, similar to GPT models, to generate complex scenes with multiple characters and specific types of motion. OpenAI Sora also stands out among its peers due to its advanced capabilities, high-quality output, and safety considerations. Overall, the performance of OpenAI’s SoRA is exceptional and ahead of the curve. Additionally, we can expect it to improve exponentially as we have witnessed the improvement of these models in just a few months.

Impact of sora like text to video(ttv) ai models

Overall, I can tell you that future of movie making is here and it will improve drastically as more resources and funds are drawn into AI research and development. However, the impact of such advancement in text to video generation AI models will be very profound on content creators like Mr. Beast tweeted to Sam Altman this -“Please don’t make me homeless”

twitter Sam Altman and Mr beast conversation

and to this Sam Altman replied with this video generation using Sora

Pros and cons of text-to-video AI models like Sora for content creators –

what lies ahead?

To conclude, Future for the AI based text to video generators seems bright but I personally don’t think OpenAI will make sora available for public use due to the high probability of misuse that can happen. However, if they do decide to make it available to the public, we will see some dramatic changes to the video content creation, both good and bad. Additionally, we don’t know if the internet is ready for this or not But for filmmakers and verified content creators, it will be of a great assistance and help in cutting costs and risks drastically.


MORE FROM THIS AUTHOR


Share this story


Discover more from BaseQube

Subscribe now to keep reading and get access to the full archive.

Continue reading