Visual Generative AI as Support in Concept and Pre-Visualization Phases

During a time when AI creates uncertainty and divides opinions among creatives, exploring its vast potential in film production becomes essential. Our research aims to facilitate a collaborative dialogue with filmmakers to establish productive, efficient, and fulfilling partnerships with AI, thereby unlocking new avenues for creativity.

Our primary focus is to ensure filmmakers retain extensive creative control and customization over the AI-generated content, enhancing and streamlining their workflows. In our workshop, we will concentrate on leveraging visual generative AI across different complexity levels for various film production stages. This includes the use of tools for generating images, videos, and 3D environments to aid in concept development, set design, pitch preparation, storyboard creation, previsualization, and even virtual productions. Prioritizing creative freedom and data security, we advocate for the use of Stable Diffusion, an open-source and offline-capable AI tool. Through its web interface extensions, we aim to refine outcomes and facilitate multimodal input, ensuring tailored and nuanced results that cater to specific creative needs.