4 June 2024
On March 7 and 8, 2024, the INIT Robots lab from ÉTS, in partnership with artists from the Université du Québec à Montréal (UQAM) dance department and the MIST Laboratory at Polytechnique Montréal, presented an innovative performance at Montreal’s Casteliers Festival. Named DESSAIM, a blend of the French words for "drawing," "purpose," and "swarm," this installation featured a variety of bio-inspired robotic swarms. Audience members were invited to explore this interactive environment, engaging with robotic communities through light, shadow and sound, witnessing the seamless integration of technology and art.
Figure 1: Doodys swarm performance. Credits: Jeanne Tétreault
Quatre types d’essaims de robots
their artistic performances to evoke positive emotions toward robots. The iterative design process involved close collaboration with puppeteers and expressive motion experts from the theatre, enriching the learning experience for both groups.
Alexandra Mercader (postdoctoral fellow) was responsible for choreographing Kinova's robotic arm movements on top of the Doodys. She worked intensively with choreographers and dancers to create fluid movements using custom-made software. The meticulous preparation for four choreographies involving five robots highlighted the artistic and technical challenges of robotic performance. Issues like power autonomy were promptly resolved, enhancing teamwork and efficiency. Adaptation between artists and engineers took time, but the residency and daily presence enhanced sharing and understanding of artists’ needs and engineer or robot constraints.
Figure 2: Puppeteer Marcelle Hudon interacting with the CrazyCognies. Credits: Jeanne Tétreault.
Matthis Di Giacomo (M.Eng) worked on the CrazyCognis drones, custom-designed 250 g caged indoor drones, focusing on reliability and the seamless integration of the puppeteers' vision. In the academic research context—where such robots are usually used—failure can be addressed with repeated trials. However, ensuring reliability from the drones was crucial here, as any malfunction during a performance could be highly visible (e.g., crashes). Effective communication between artists and engineers was vital to align artistic visions with the robots’ technical capabilities.
Rafael Gomes Braga (MScA) developed and deployed the "sushis," small tabletop robots that operated under a light projector. His collaboration with choreography specialist Audrey Rochette aimed to explore and refine various swarm behaviours. This process was marked by discovery and iterative testing, both in simulations and real-life presentations. The swarm behaviour composition made on the sushi was later replicated to the two other platforms.
A Creative and Captivating Performance
During the performances, the "sushis" emerged from a creatively designed "cave," performing behaviours that interacted dynamically with the environment and the audience. These interactions, spread over three distinct stations, captivated attendees, especially children, by allowing them to see the robotic swarms from different angles and with different scenography strategies.
The Doodys performance started with an awakening sequence—as if the robots woke up and started looking around curiously, trying to comprehend their surroundings. They then began moving toward the nest. However, this journey did not resemble traditional robotic navigation. The robots were aware of the position of other surrounding robots and moved together as a group, in harmony, careful to maintain the right distance from each other so that they didn’t disconnect from the pack. It seemed like a community of beings migrating from one place to another, just like swarms in nature.
The CrazyCognis drones acted somewhat as protectors of the nest, suspicious of approaching performers circling near them like a patrol.
Figure 3: Shushi robots and their shadow. Credits: Jeanne Tétreault.
Rafael noted that the initial caution of the audience turned into fascination as they interacted with the robots, which sometimes behaved unpredictably, humanizing them in the eyes of the viewers. Alexandra highlighted the impressive and well-received artistic performance, a pioneering effort in choreographing diverse robot swarms. Matthis observed the audience's curiosity and amazement, often wondering if the robots could “see” them and if they could react to their external disturbances.
A Fusion Between Science and Art
The DESSAIM project not only showcased the technical prowess and artistic potential of robotic swarms but also highlighted the profound impact of interdisciplinary collaboration. The fusion of robotics with dance created a spectacle that transformed viewers' perceptions of technology, revealing the softer, more relatable side of robots. This initiative served as a powerful reminder of the magic that can occur when art and engineering intersect. It provided valuable insights and inspiration for both the creators and the audience. The project's success sets a new standard for future explorations at the crossroads of technology and art, encouraging ongoing dialogue and innovation in this exciting field.
- Imran, A., Varadharajan, V. S., Braga, R. G., Bouteiller, Y., Abdalwhab, A. B. M., Di-Giacomo, M., ... & St-Onge, D. (2024). From the Lab to the Theater: An Unconventional Field Robotics Journey. arXiv preprint arXiv:2404.07795.
