VOJEXT Madeline Gannon
Madeline Gannon ©
VOJEXT S+T+ARTS Residencies

Collaborations in Artistic Experiments with Robotics

At the intersection of art and robotics, the VOJEXT S+T+ARTS Residencies facilitate innovative collaborations that explore the boundaries of human-robot interaction, sustainable material utilisation, and traditional craftsmanship. This article investigates the projects of three artists participating in these residencies, examining their methodologies and their impact on artistic and technological fields. From designing a soft membrane for safe robot-human collisions to repurposing ceramic debris and wood waste into art, these projects exemplify creative and technological synergy. 

The innovative projects developed during the VOJEXT residencies have pushed the boundaries of art and robotics and garnered significant recognition, including nominations for the prestigious S+T+ARTS Prize. Read more about the S+T+ARTS Prize nominations and the achievements of Anna Schaeffner and Marielena Papandreou.

By analysing their distinct approaches, we aim to demonstrate how their work engages with broader art, technology, and sustainability discourses. By examining their projects in detail, we seek to highlight the potential of interdisciplinary collaboration within contemporary digital and cognitive technologies.

"Soft Collision" by Anna Schaeffner

In her project, Anna Schaeffner explores how robots and humans can safely collide through her work with a collaborative robot (cobot). In the exhibition, a universal robot arm (UR5) covered by a green membrane with a sensor pad performs a dance. Schaeffner, inspired by the shape and movement of caterpillars, designed a soft membrane for the robot arm. She collaborated with dancer Michela Filzi to analyse and design safe interaction zones. Through this partnership, they conducted a contact zone analysis to determine which zones were frequently touched and which were not, ensuring the flex sensors were strategically placed.

This collaboration enabled an intimate and safe dance, highlighting new ways of robot-human interaction. Schaeffner experimented with various materials such as gel, air, and silicon to create the membrane. She worked with engineers from the University of Nebrija to ensure safety. They discovered that "silicon pockets" in a pneumatic system provided the best safe and dynamic interaction solution. This innovative approach allows the robot to adapt to human touch, fostering a sense of safety and cooperation.

“Ornate Equations” by Calin Segal

Calin Segal’s Project repurposes ceramic debris for mosaic making, blending traditional crafts with robotic manufacturing. Segal’s project bridges the gap between historical craftsmanship and modern technology. He created a dynamic nesting algorithm for unique mosaic pieces. Segal engaged local communities in Barcelona to collect debris, turning them into intricate murals. Inspired by the detailed ceramic tilework of Spanish "azulejos," Segal and his collaborators designed a program that digitally replicates traditional designs using mathematical equations.

This program allows the robot to interpret these equations and produce gradient geometrical patterns. His interactive "People I Meet" installation invited visitors to contribute their photos and voices. This created a collective mosaic and ambient sound inspired by his robotic mosaic project. Segal made the software open-sourced on GitHub, encouraging further development by robotic researchers and other stakeholders. This open-source approach democratises access to the technology, allowing a broader audience to engage with the project and contribute to its evolution.

"GR-AI-N" by Marielena Papandreou

Marielena Papandreou’s "GR-AI-N" project reduces wood waste by using AI and robotics to create harmonious designs from discarded wood. She emphasises the grain of wood as a storyteller, seeing each piece as a unique record of the tree’s life and the environment. Collaborating with a robot, she scans and matches the grain patterns of different wood pieces. The robot picks and scans the wood waste for its shape, dimension, and grain and stores this information in a material library. She uses AI-powered tools to create designs that harmonise each piece's grain patterns and textures, making them flow as if crafted from the same tree.

Her project combines digital fabrication and handicrafts, showcasing environmental commitment and the journey of each piece of wood. Papandreou’s work challenges the traditional view of wood as a mere material. Instead, she presents it as a living organism that captures the essence of its environment. Her innovative use of technology honours wood's natural beauty and history, encouraging more sustainable and mindful production practices.

“Countertransference” by Amir Bastan

In his talk, Amir Bastan, a new media artist and researcher, connected psychoanalysis theories with human-robot interaction. He discussed "countertransference," where people project feelings onto robots, highlighting safety concerns in human-robot interaction. Bastan shared a psychological phenomenon where visitors to a robotic art exhibition expressed feeling unsafe when left alone with robots, saying, "I don’t feel safe." This insight resonates with Schaeffner’s exploration of safety in her project. Bastan’s talk emphasised the importance of understanding human emotions in designing safe and effective human-robot interactions, advocating for a more empathetic approach to technology development.

Looking back on the Vojext Exhibition in Waag

The exhibition opened at Waag Futurelab on April 16, 2024. Dr. Maria Eugenia Beltrán, Senior R&D Project Manager and Head of Big Data in LifeSTech at Universidad Politécnica de Madrid, introduced the event. She emphasised the value of artist-robot collaborations in fostering creativity and innovative technical solutions. Beltrán highlighted how artists can explore cutting-edge technologies and the social and cultural dimensions of technology development. She stressed that the collaborative nature of the residencies helped build creative capacities and develop skills for transdisciplinary research and co-creation. Beltrán’s introduction underscored the potential for unorthodox approaches to human-robot interactions. It showcased how art can significantly contribute to research and technical innovation.

The Vojext Project: Information and Background

VOJEXT (Value Of Joint EXperimentation in Digital Technologies for Manufacturing and Construction) is an EU Horizon 2020 project launched in July 2020 to digitise European industries. It covers traditional and non-traditional areas for AI-robotics and cognitive ICT developments. The project aims to integrate SMEs through open calls and extend to 15 experimental pilots. The VOJEXT S+T+ARTS Residencies, coordinated by Waag Futurelab, support artists and SMEs in creating innovative products and technologies focused on human-robot interaction. Each of the three selected projects received €30,000 and support from March to December 2023.

The residencies aim to encourage artists to stimulate the creation of new products and technologies in different contexts. They focus on alternative uses and critical thinking around social relevance and situated practices of cognitive autonomous systems. This initiative fosters deeper, critical engagement with robotics's social implications and practical applications in everyday life.

Integrating Robotics and Art through Interdisciplinary Efforts

The collaborations in the Vojext project have opened new perspectives for the robotic industry, highlighting the interplay between robotics and art. The residencies have encouraged the industry to explore new functions and envision future scenarios for robotics, while providing artists with access to advanced technologies. Waag Futurelab has served as a mediator between art, science, and technology, demonstrating the value of interdisciplinary collaboration. The mentors from Waag Futurelab supported communication and understanding between artists and the industry, ensuring a mutually beneficial partnership.

This initiative demonstrates the potential of combining diverse fields to tackle contemporary challenges, breaking down silos and fostering innovative solutions through collective creativity.

Published

Author

Project

EU official flag

Vojext has received funding from the European Commission under the H2020-DT-ICT-03-2020 call under Grant Agreement number 952197.