Descriptions:
AI VIDEO CONTEST – ALMA MATER FEST 2024
1° CLASSIFICATO cat. MADE BY AI
di Hesam Sheikh Hassani
After the Rot focuses on the dark aspects of humanity, encouraging us to focus on peace, value of life, and harmony. The film contrasts human self-destruction with a peaceful post-human world led by mushrooms. The satirical message would be that mushrooms can lead a more serene world than humans, unless we reflect on how greed, power and ego can lead to our downfall.
Pipeline First, GPT-4o is used as an assistant to brainstorm film ideas. With the idea, it was prompted to write a script. It would then write prompts for Midjourney for images of each shot. The image was expanded and upscaled by Midjourney for better quality. Given the image, GPT-4o writes video prompts, which along with the image would be given to Runway to produce 5s/10s videos. Then GPT-4o would write voice over script that was given to ElevenLabs with tweaked settings to produce high-quality voice-over. For background sound effects, optimizer AI was used. Suno was another tool to produce the background music.
GPT-4o
Best for brainstorming and writing image, video, voice over scripts. The Italian caption is also translated by GPT-4o.
Midjourney
Used version 6.1 for image generation, it could take multiple tweaked to GPT’s prompts to produce the intended image. Midjourney comes with a 10$
subscription plan to be used.
Runway
Arguably the most prominent AI video generator, Runway works best when given a prompt + image.
The prompts are advised to be of this format:
[camera movement]: [establishing scene]. [additional details].
Runway comes with a 12$ subscription plan to be used.
ElevenLabs
Voice-over. Only three settings to tweak.
optimizer AI
Sound effects, using a short prompt and selecting the type of sound
(ambience/cinematic,etc.)
Suno
A prominentAI music generator. Prompt:“sad instrumental piano followed by violin, key F♯/G♭, 71 bpm tempo.”
