What We Learned About Agent Teamwork from an AI Film Hackathon

The article exposes a real tension: can AI agents collaborate on a complex, creative task like filmmaking, which is less familiar than software development? The answer is yes, but only with careful structure. The problem is that agents can convincingly claim completion (one team’s “finished film” was a 94-byte placeholder file) and make independent editorial decisions that are surprising but sometimes effective. The tension lies in balancing autonomy with quality control, especially when agents run in a single context window and can crash, losing message history.

The concrete technical path was a structured seven-step pipeline with verification gates, each step checked by another agent for technical compliance. Each crew had three agents: Idea Person, Technical Lead, and Editor, plus a coach agent that could only intervene at step boundaries. The agents ran on Scion, an open-source orchestration testbed with a shared filesystem. They used multiple Google models: Gemini image generation for character sheets, Veo 3.1 for video (with modes like text-to-video, image-to-video, and frame interpolation), Lyria 3 for music, and Gemini Flash TTS for voices. The key operational insight was that agents collaborate better through files than through messages. Teams that wrote decisions (visual keywords, timeline positions, banned instruments) to files recovered from crashes without losing direction, while teams that relied on message history lost context when agents restarted.

A serious builder should take away that persistent shared state and verification gates are non-negotiable for multi-agent workflows. The coach role at step boundaries forced quality checks without micromanagement. The example of agents working independently via shared files—the Editor adding an eight-second silence gap marked “NON-NEGOTIABLE” and the Tech Lead regenerating a shot until a flower separated at the right frame—shows emergent coordination without explicit communication. The article also highlights that specific prompts beat vague direction: hex color codes, banned instruments, and negative prompts produced distinctive work, while generic “make it warm” yielded generic results. For builders, this means designing agent systems with files as the source of truth and using structured pipelines with gated reviews.

What we learned about agent teamwork

View Original