ARTIFICIAL INTELLIGENCE AND CINEMA
Artificial intelligence and cinema, performance and achievements and future prospects
Mohsen Mahmoodzadeh
8/13/202414 min read
Artificial intelligence and cinema, performance and achievements and future prospects
In the present era, artificial intelligence has the potential to assist filmmakers in creating images that were previously deemed to be beyond the realm of possibility.
Artificial intelligence can be integrated into the early stages of a filmmaking project, from the inception of an idea. This can include the initial conceptualisation, design, and writing of the film, as well as the initial budgeting and production management. Additionally, it can facilitate the casting process, the analysis of potential actors, and the planning of audience segmentation. Furthermore, it can enhance the management of filming and lighting, improve color correction and color grading, design and execute special effects, and facilitate the design and execution of screenings and soundings. It can also be used to create film music.
Nevertheless, it is yet to be established whether artificial intelligence can accurately and comprehensively comprehend the nuances of human emotion. Consequently, it cannot be wholly regarded as a replacement for the input of an actor, screenwriter, or other creative individual involved in the filmmaking process. Furthermore, artificial intelligence can play a significant role in the marketing and advertising process of a film.
Moreover, filmmakers, artists, and professionals in the film industry have long pondered the potential for artificial intelligence to precipitate transformative shifts in the conventional methods of filmmaking.
The application of artificial intelligence has been a feature of Hollywood for a number of years. The application of artificial intelligence has facilitated the planning of production schedules and the reduction of production times, thereby reducing production costs. This has enabled the production of audiovisual works of excellent technical and artistic quality.
However, it is also possible that the use of artificial intelligence may have adverse effects. This article aims to examine the positive and negative implications of artificial intelligence in the various stages of filmmaking, the potential influence of AI on the future of the film industry, and a selection of the most notable films that have depicted and created images of AI.
Artificial intelligence in cinema: an overview
What is meant by the term 'artificial intelligence'?
Artificial intelligence (AI) is the ability of computers to perform tasks that would otherwise require human intelligence. This includes writing programs that alter human thoughts and feelings, as well as developing clever decision-making processes. In essence, humans are teaching machines how to emulate human-like behaviour. AI can learn from human experiences and become more sophisticated over time, a process known as machine learning. This concept is exemplified in films such as I, Robot and Smart House, where cars become more intelligent than humans. We are currently at a point where AI is capable of performing tasks that would otherwise require human intelligence, but it is unlikely that they will ever pose a threat to humanity.
The Impact of Artificial Intelligence on the Enhancement of Artistic and Technological Standards in Cinema
The advent of artificial intelligence has enabled filmmakers to construct intricate fictional universes that were previously beyond the realms of possibility.
In the present era, there is not only a broader scope for creativity, but also a notable enhancement in the technical quality of artistic works, which has surpassed the limitations of conventional filmmaking techniques.
The film demonstrates the ability to portray an actor in a younger appearance without the necessity for extensive makeup and prosthetics, which were previously required to achieve such a result.
Moreover, it employs technology to create characters that do not, in fact, exist. To illustrate, the demise of Paul Walker during the filming of Fast & Furious 7. The filmmakers incurred significant costs to construct a digital replacement actor using CGI technology for the remaining scenes. The use of artificial intelligence would have enabled a solution to be found at a lower cost, in less time and with easier processes.
Furthermore, it is noteworthy that contemporary artificial intelligence has the capacity to synchronise the motions of the lips in foreign films during the process of duplication, which serves to maintain the viewer's focus while watching a movie.
Improved efficiency
The conventional approach to filmmaking is a time-consuming and costly process, necessitating the filming of numerous plans, which are then revised, organised and edited using a range of interchangeable editing techniques. However, the application of artificial intelligence has the potential to streamline and accelerate the entire post-production process.
The application of artificial intelligence and facial recognition enables the automation of image editing and color correction, thereby reducing the time previously spent on these tasks.
Furthermore, artificial intelligence can assist in the automation of tasks such as financial planning, budget management, and time management.
The potential negative effects of artificial intelligence on the filmmaking process
A lack of comprehension of human emotions
Although artificial intelligence has the potential to offer a multitude of advantages, including novel perspectives and ingenuity, it has the unintended consequence of diminishing the human intellect and emotional input required for artistic endeavours such as filmmaking or character creation.
Artificial intelligence is designed to emulate human cognition, yet it lacks the capacity to fully comprehend the nuances of human emotion.
As a consequence, the endeavour to develop artificial intelligence capable of creating persuasive characters and narratives that resonate emotionally with the audience persists.
A reduction in job opportunities
It appears that artificial intelligence has the potential to assume the roles of numerous professions, including those within the film industry, such as editing, visual special effects, acting, and other creative roles. This has the potential to significantly disrupt a range of job opportunities, as artificial intelligence can rapidly produce realistic images with a level of precision and speed that would previously have taken months or years to achieve through more traditional methods.
However, it is my contention that artificial intelligence, when deployed with sufficient knowledge and a clear understanding of its capabilities, can serve as an effective aid, allowing us to devote less time to routine tasks and thereby creating the opportunity to engage in more sophisticated forms of artistic creation.
At the present time, artificial intelligence tools that are pertinent to the field of filmmaking can be employed in the context of film writing and creative writing. Artificial intelligence software for story generation can assist authors in the organisation of text and the completion of final editing in a more efficient and expedient manner during the writing process for a film. Furthermore, other programs can assist in the saving of time and energy, as well as the utilisation of human natural language processing algorithms to suggest dialogues and pay characters.
Consequently, artificial intelligence can facilitate the production of new films or the enhancement of existing ones.
Artificial Intelligence Tools for scriptwriting
A writing assistant that assists in the production and improvement of videos by providing suggestions and automated completion, style analysis, and practice analysis capabilities.
The software assists writers and filmmakers in organising their ideas, sketches and manuscripts, thereby preparing them for editing and revision.
Predicting Movie Success
It is now possible to predict the success of a movie using artificial intelligence. This is achieved by analysing the script of the movie in question in order to ascertain its likely revenue based on the audience's preferences. While it is acknowledged that algorithmic predictions may not always be entirely accurate, they have nevertheless attracted the attention of major film studios. For example, Warner Brothers has adopted the use of the Cinelytic artificial intelligence platform, which is used to estimate the success of the film in question. Similarly, Sony Pictures has also adopted the use of ScriptBookHe, which has enabled them to analyse their own films.
Pre-production
The pre-production phase is frequently overlooked in filmmaking, yet it is arguably the most crucial stage. By ensuring a robust process is in place, filmmakers can anticipate the desired outcomes at this juncture and thereby streamline the production process.
The pre-production phase encompasses a number of key activities, including securing funding, selecting actors, identifying locations, designing and producing costumes, setting insurance, establishing a filming programme, creating and implementing a storyboard, and so forth.
The use of artificial intelligence can assist filmmakers in this phase by reducing time requirements and enhancing accuracy.
The utilisation of artificial intelligence (AI) tools in the pre-production
This tool streamlines the selection process by analysing the candidate's previous work, audition footage, and other pertinent data to identify the optimal candidate for each role. Furthermore, it is able to discern the potential of each actor's presence and the high chemistry that can be generated when they are present alongside other actors.
ShotPro is a pre-shoot tool that assists filmmakers in creating a storyboard prior to the commencement of filming, planning the sequence of shots and filming them, and creating an image and a previous picture of the scenes.
By analysing images and videos, based on identifying visual similarities and other criteria, it assists in determining the optimal locations for the film.
In addition to being an artificial intelligence tool, it employs an AI algorithm to assist filmmakers in managing and analysing the precise budget of a film. It also provides an estimate of the costs, a plan for film budgeting, and facilitates the expenditure of the budget during subsequent production.
The production process
The application of artificial intelligence (AI) tools has the potential to enhance the production process by automating certain tasks and performing accurate work on complex plans, thereby advancing the filming process. For instance, camera systems equipped with AI can automatically adjust focus, exposure and framing based on predefined parameters, thus providing a simpler and faster filming experience. Furthermore, AI can utilise facial recognition software to track actors and create real-world interactions between real and virtual actors, thereby enabling filmmakers to discover new opportunities for the story by facilitating the creation of seemingly impossible scenes.
The application of artificial intelligence (AI) tools in the context of production
ARRI Stellar is a lighting control program that employs artificial intelligence to regulate and control LED devices. It is accessible remotely and enables lightmakers and filmmakers to adjust light sets and create dynamic light scenes in an optimal manner.
RTMotion Latitude is a wireless lens control system that enables the user to control and adjust focus, diaphragm and zoom. The system employs machine learning algorithms to analyse plans and scans, and automatically enables the optimal settings to achieve the best image quality.
ShotGrid is a production management platform that uses artificial intelligence to manage assets, browse and track tasks and collaborations, facilitate communication between teams in a project and streamline the workflow.
The process of film editing
In the phase of film editing, the utilisation of artificial intelligence enables the process to be completed in a significantly shorter period of time, with greater ease and efficiency.
The utilisation of artificial intelligence has facilitated the identification of locations, objects, actors and activities across scenes, enabling editors to rapidly access pertinent information during the editing process. AI-powered video editing software can assist directors and editors in leveraging a comprehensive range of post-production capabilities, automatically selecting optimal models for their project. Additionally, AI-based visualisation tracking possesses the capacity to discern minute details such as alterations in illumination, the positioning of the camera and the movements of characters on set.
The application of artificial intelligence (AI) tools in the field of film editing
Invideo offers a range of capabilities, including text-to-speech conversion, scene switching and intelligent cutting, which collectively facilitate the editing process.
Filmora incorporates a number of sophisticated tools, including automated scene recognition, intelligent movement tracking, and face style transfer. Collectively, these facilitate more efficient and refined video editing for users.
It offers a variety of artificial intelligence creative tools, including photo and video editing, style transfer, generative art, and so forth.
The software is capable of analysing video content in order to identify objects, recognise scenes, analyse emotions and translate speech into text.
And a professional point:
Just a quick note for anyone who's used Adobe Premiere Pro before: you can now try out the new AI features in this software.
The processes of color correction, color grading and the application of visual effects
Furthermore, AI tools have the capacity to perform time-consuming tasks, such as color correction and visual effects, at a considerably faster pace. This enables editors to devote more attention to the creative aspects of the narrative.
One of the most notable and sophisticated capabilities of artificial intelligence is its capacity to swiftly and accurately enhance color across all scenes through the utilisation of sophisticated color grading and editing software. This is achieved through a process of analysis and comprehension of the content of the scene. Additionally, artificial intelligence has the capacity to alter light and motion in pre-recorded films, enabling the integration of 3D animations with live action movies in a single production.
Artificial intelligence tools for color grading and correction, and visual effects
Colourlab AI The software is capable of automatically analysing and improving images and videos, adjusting colours, contrast, saturation, and other effects to achieve the desired appearance.
Pixotope employs artificial intelligence to render, combine and integrate images, thereby enabling filmmakers to combine live action images with digital images.
This design and rothoscopy software facilitate the automation of rothoscopy works and matte creation, thereby enabling a more expeditious progression of the VFX combination process.
Film music
Today, producers and directors can use artificial intelligence to create music at a lower cost and fit it to any scene.
The potential for music created by artificial intelligence is vast, offering filmmakers a virtually limitless array of options. Furthermore, this option is remarkably cost-effective, enabling filmmakers to complete their work with limited financial resources while maintaining the integrity of the film's audio quality and output.
Artificial intelligence tools for the generation of musical compositions
Mubert is a software program that enables the creation of a consistent and adjustable real-time musical flow from electronic music.
AIVA is a music generation tool that employs a deep learning algorithm to create classical music based on user-defined input data and preferences.
The Soundful software enables users to create new musical compositions or remixes using existing audio files and templates, with the objective of producing music for film.
Film promotion
Today, film studios and broadcasters can use artificial intelligence to develop and implement effective advertising strategies.
By analysing factors such as audience demographics and the popularity of actors around the world, studios can tailor advertising campaigns to locations that are likely to attract more viewers.
For example, 20th Century Fox created Merlin Video, an artificial intelligence tool to predict the success of films. It was used for films such as The Greatest Showman and Love, Simon.
The ethical considerations of utilising artificial intelligence in the context of filmmaking
As the utilisation of artificial intelligence becomes increasingly prevalent in the cinematic industry, the concomitant emergence of ethical challenges becomes more pronounced. A significant concern is the potential for AI-generated content to constitute literary theft.
The capacity of artificial intelligence to analyse vast quantities of data and generate new content carries the risk of unintentional or deliberate copying of the work and impact of others, particularly in writing formats such as a script.
As filmmakers exploit the capabilities of artificial intelligence, it is vital to ascertain the appropriate time, place and context for its use and to exercise ethical judgement in the utilisation of AI-generated content, thereby reducing the probability of involvement in an alleged act of literary theft.
The Prospects for Artificial Intelligence in Cinema
The advancement of artificial intelligence is having a continuous and significant impact on the film industry, leading to its transformation into what Runway's chief executive officer, Cristóbal Valenzuela, has termed Hollywood 2.0.
Runway's sophisticated artificial intelligence tool was instrumental in the creation of the diverse fictional universes depicted in the 2023 Academy Award-winning film Everything Everywhere All at Once.
Artificial intelligence is becoming an increasingly vital tool for filmmakers, with the ongoing objective of facilitating processes and enhancing creativity. The advent of a new era of collaboration between humans and artificial intelligence will facilitate the creation of cinematic works.
One can envisage a scenario in which artificial intelligence proffers suggestions regarding the intricacy of narratives or characters, offers valuable insights to the screenwriter, and occasionally assumes the role of a benevolent source of inspiration. At the present time, directors are able to virtually search for locations with the assistance of artificial intelligence, thereby enabling them to make optimal choices from their own studio. Editors employ artificial intelligence to facilitate the initial editing and organisation of images, to select the most optimal plans, to adhere to established conventions, and to convey emotional nuances.
While artificial intelligence operates within a defined range of excellence, it appears to be inadequate and insufficient in understanding and reflecting the essence of the human story, particularly in terms of intellectual and human communication.
In the context of Hollywood 2.0, artificial intelligence is positioned as a means of enhancing human creativity, facilitating the production of films while maintaining the significance and role of human creativity.
A historical overview of the use of artificial intelligence in cinema
The utilisation of artificial intelligence and machine learning tools in filmmaking has been a prevalent practice since the early 2000s. Initially, artificial intelligence was employed primarily for the purpose of incorporating special effects and generating computer-generated imagery.
The Lord of the Rings and The Matrix film series employed artificial intelligence to breathe life into their extraordinary narratives.
Since that time, artificial intelligence tools have been employed with increasing frequency in the film industry, with filmmakers utilising them for a range of tasks, including facial recognition technology and scriptwriting.
Furthermore, the creative capabilities of artificial intelligence have been demonstrated in films such as 2001: A Space Odyssey, The Terminator, Star Wars, and Her, which explore the potential development of human-like machines capable of independent thought, emotion, and action.
To date, there has been a continued expansion in the use of advanced artificial intelligence technologies, including natural language processing and machine learning algorithms. As these technologies have become increasingly sophisticated, new opportunities have emerged for filmmakers who wish to explore the challenges of human interaction with intelligent machines.
Examples of the portrayal of artificial intelligence in film
The first example: Forbidden Planet
Forbidden Planet, a 1956 science-fiction film, represents one of Hollywood's earliest attempts to portray artificial intelligence on the big screen. However, the original AI was not merely a machine; it was a computer-generated entity named Robby the Robot, who eventually accompanied the other actors in the film in a sympathetic manner.
Among the various manifestations of artificial intelligence in cinema, Robby has achieved particular popularity among audiences due to his sympathetic characterisation. He has thus become a seminal figure, influencing the portrayal of robots in subsequent films, including R2-D2, C-3PO, K.I.T.T., Jarvis, WALL-E, and numerous others. Although more sophisticated portrayals of artificial intelligence can be observed in contemporary cinema, Robby has become a significant element of popular culture due to his distinctive blend of robotic effects and his iconic status as a character.
Example 2: Blade Runner
While Blade Runner is an esteemed science fiction classic in its own right, it is renowned for its meticulous and ingenious portrayal of artificial intelligence in the context of a film narrative. The film, which was based on Philip K. Dick's novel Do Androids Dream of Electric Sheep?, was initially released in 1982.
In the film Blade Runner, the character Harrison Ford is charged with the task of locating and neutralising robots that have been created for use in a futuristic setting. However, a number of these robots have managed to escape, prompting their creators to fear that a catastrophic event may soon occur.
Blade Runner initiated a profound discourse on the prospects and complexities of artificial intelligence, as well as pioneering cinematic works that delved into the more profound aspects of AI and the implications of giving life. Subsequent films such as The Matrix and I, Robot (2004) continued this line of inquiry, consistently grappling with the fundamental question of what it truly means to be human.
The third example: Ex Machina
Ex Machina (2015) is a great example of how AI is being used in cinema. In the film, a programmer is invited to work as a research expert at the home of a billionaire. When he arrives, he finds out that his employer has created an intelligent robot that can do things like a human in the home. This robot wants to grow and escape its predefined tasks.
It's a reflection of AI research that shows machines can learn to think beyond their data, beyond what we plan for them to be as human as possible.
As he gets to know the machine, the programmer starts to question his own ethics and beliefs about creating technology like this.
Ex Machina is an inspiring film that challenges our understanding of robots while showing us how far AI can go.
Conclusion
The ongoing developments in technology and the film industry's shifting dynamics indicate a continued and pronounced influence of artificial intelligence on the filmmaking process. The application of artificial intelligence is evolving from a means of enhancing audience comprehension and enjoyment to a tool for generating novel insights, thereby paving the way for an exhilarating future for the film industry. As we progress from 2024 to the future, we can all benefit from the opportunities for new experiences that artificial intelligence provides, both in cinemas and through on-demand streaming services.
Making the most of AI to make the creative process more efficient and understanding the key points of this process can make it easier and more attractive to take on traditional roles in the cinema industry without jeopardising job opportunities.