png
26/08/2019 - Events, News
ROBOT RODYMAN Conducts the Orchestra of the Ravello Festival 2019
Reading time: 1.5 minutesA quite extraordinary experiment in human robot interaction. Guided learning of the RoDyMan robot who conducts an orchestra at Ravello Festival 2019.
"Robot Controls Zero Lesson: What does it mean to control a robot in interactive mode and not in autonomous mode?" Bruno Siciliano in Ravello, 23 July 2019
ROBOT RODYMAN CONDUCTS THE ORCHESTRA OF THE RAVELLO FESTIVAL 2019
THE PROTAGONISTS:
RoDyMan, acronym for Robotic Dynamic Manipulation, is a research project funded by the European Research Council at the CREATE Consortium and conducted at the PRISMA Lab of the Department of Electrical Engineering and Information Technologies of the University of Naples Federico II;
RoDyMan, the robot
Professor Bruno Siciliano of the University of Naples Federico II and coordinator of the project RoDyMan and PRISMA Lab;
the Instrumental Ensemble of the Conservatory "Giuseppe Martucci" of Salerno directed by the Director Massimiliano Carlini;
Ravello, the event "Burattino senza fili - Automi, Robot, Intelligenze artificiali: la nuova overvolgente rivoluzione industriale".
THE EXPERIMENT
On July 23, 2019, the robot Rodyman conducted the Ravello Orchestra Festival 2019 for the "Puppet without wires": Automata, Robots, Artificial Intelligence. The event was attended by Professor Bruno Siciliano, who described the experimentation, the Instrumental Ensemble of the Conservatory "G. Martucci" in Salerno and maestro Massimiliano Carlini.
Neither the movements of the robot nor the trajectories of the baton have been programmed on the computer. "Not this time" - says professor Siciliano. "Convinced that a machine is not enough to conduct an orchestra, in a cold way and always in the same way, we customized the movements of our humanoid". Maestro Carlini collaborated on the project: for a few days he went to Prisma Lab and, with sensors on his torso, wrists and head, he "directed" an imaginary orchestra.
"We had [maestro Carlini] wear a sensorized jacket - explains Bruno Siciliano - and sensors on his wrists and head. Then the maestro acted as if he conducted his ensemble, music by Bach. With our own software we acquired all the data of his movement and a virtual robot, on a computer screen, replicated it. Then the movements were passed on to the phisical robot which "learned" them and is now able to replicate them".
At PRISMA Lab they then made various corrections, because although the kinematics of RoDyMan, which has shoulders, elbows, and wrists, are very similar to those of humans, the movement of the mechanical structure still needed to be adapted to the gestures of the conductor.
Links: the backstage and the performance in Ravello
Links: the backstage and the performance in Ravello
https://www.youtube.com/watch?v=v0zdR6wQ8mE&t=3s
https://www.youtube.com/watch?v=38RIn-1gPgQ
More information about the RoDyMan project: http://prisma.dieti.unina.it/index.php/projects/rodyman
Photo gallery
png
png
png