Virtual Extra

The Evolution of Crowd Scenes

The history of crowd scenes in cinema is a story of escalating technological ambition. Early Hollywood epics like Ben-Hur (1959) or Spartacus (1960) famously employed tens of thousands of real human extras to create their sense of scale, a logistical and financial undertaking that is almost unimaginable today. The digital era offered a new solution. In The Lord of the Rings trilogy, Weta Digital’s MASSIVE software allowed artists to create autonomous digital agents who could react to their environment, enabling the simulation of vast armies without hiring thousands of people. These, however, were still digital puppets requiring significant artist intervention.

The concept of the ‘virtual extra’ represents the next leap, powered by modern artificial intelligence and generative techniques. This involves not just duplicating digital models but generating entirely new, photorealistic human figures, complete with unique movements and appearances, to populate a background. This can be achieved by scanning real-life actors to create a library of digital doubles who can be reused endlessly, or by using generative models (like GANs or diffusion models) to create wholly synthetic humans from scratch.

Economic and Ethical Implications

The push toward virtual extras is driven primarily by economics and control. For a studio, the benefits are clear: costs are drastically reduced, as there is no need to pay, feed, or provide facilities for hundreds of background actors. A director gains absolute control over the crowd—every virtual figure can be programmed to perform a specific action, ensuring perfect continuity and eliminating the unpredictability of a human crowd. Scenes can be populated with thousands of individuals at a fraction of the cost of traditional methods.

However, this efficiency comes at a significant ethical and human cost. Background acting has historically been a crucial entry point into the film industry, providing aspiring actors with their first on-set experiences and union eligibility. The widespread adoption of virtual extras threatens to eliminate this entire class of work. This concern was a cornerstone of the 2023 SAG-AFTRA strike, where the union fought for protections against the use of AI and digital replicas. The core of the debate centers on consent and compensation: can a studio scan a background actor for one day’s pay and then own and reuse their digital likeness in perpetuity, in any project, without further payment? This raises fundamental questions about identity, ownership of one’s own image, and the future of labor in a creative industry.

The Uncanny Valley and Future Debates

Currently, the technology for fully generative, close-up virtual extras still flirts with the ‘uncanny valley’—the unsettling feeling audiences get from digital humans that are almost, but not quite, real. They are most effective when used in mid-to-far backgrounds, but technology is advancing rapidly. The central conflict for the industry’s future is clear: studios and tech companies will continue to push the boundaries of what is possible in the name of efficiency and creative freedom, while actors’ unions and labor advocates will fight to establish guardrails that protect human jobs, likeness rights, and fair compensation. The future will likely involve a hybrid model, with strict new contractual language governing how and when a person’s digital likeness can be used.