Descriptions:
AI VIDEO CONTEST – ALMA MATER FEST 2024
cat. MADE BY AI
di Sandeepan Bora
A young man falls deeply in love with a girl. They go on numerous dates, enjoying each other’s company and building a strong connection. Their relationship progresses naturally, culminating in a joyous wedding day. However, the story takes an unexpected turn—revealing that all of these
experiences were part of an immersive virtual reality game. The perfect romance was entirely simulated.
Tools used:
Script: ChatGPT, Claude.ai
Video: domoai.app, StableDiffusion
Audio: iLoveSong.ai, udio.com,
Editing: Adobe Premiere Pro, Microsoft Clipchamp
The Process:
ChatGPT created the sketch of the video.
For the song, first I wrote the lyrics using Claude AI, and then for the vocals and music I used iLoveSong.ai. The song was entirely created with AI without any intervention.
For the other music, I used Udio.
Making the video clips was the most challenging and time-consuming part. I decided to go with the anime style because it is easier to create consistent characters and facial expressions and more cost-effective.
Different approaches were used to create different scenes in the video.
For this project, I used the Anime v6 model.
For the majority of the video, DomoAI was used, where I would train the model on photos and videos of real-life clips.
For some of the scenes, I used StableDiffusion, which is an open-source AI that runs on the local server. I used ComfyUI for the User Interface. Some of the scenes were first created as images from text-to-image and then the images were converted into video using DomoAI or ToonCrafter(A StableDiffusion model).
Samples used for training the models include actors Kiara Advani & Siddharth Malhotra, scenes from Cyberpunk, and copyright-free clips from YouTube.
Stable Diffusion was also helpful in upscaling the images. All the video clips were upscaled using DomoAI.
In the end, all the clips were assembled and arranged in Adobe Premiere Pro.Subtitles were generated by Google Translate.
