SRS - Multi-Role Shadow Robotic System for Independent Living

Czech title

Type

grant

Keywords

assistive robotics, computer vision

Abstract

SRS (Multi-Role Shadow Robotic System for Independent Living) focuses on the development and prototyping of remotely-controlled, semi-autonomous robotic solutions in domestic environments to support elderly people. SRS solutions are designed to enable a robot to act as a shadow of its controller. For example, elderly parents can have a robot as a shadow of their children or carers. In this case, adult children or carers can help them remotely and physically with daily living tasks as if the children or carers were resident in the house. Remote presence via robotics is the key to achieve targeted SRS goal. Based on the study of user requirements, the usability of the system can be improved by real-time 3D display on the client side. However, network communication poses serious problems due to limited and potentially unreliable communication channels. The proposed extension of the SRS project focuses on context-aware multimodal HRI support aimed at usability, safety and situation awareness for remote users. The new Context-Aware Virtual 3D Display will be able to cope with the project visualisation needs resulting from the existing requirement specifications. It will work on the client side based on predefined 3D maps. The Virtual map will be updated online employing a combination of real-time 3D robot perception, real-time 2D video processing and remote operator perception. The technical outcome will employ context detection based on visual clues, trajectory verification by means of video processing and object detection in images. Advanced fusion mechanisms will also be explored too. The addition of BUT to the consortium will allow optimizing the SRS HRI design and developing multimodal interfaces that are more appropriate for and attractive to the targeted user group. This will improve the end-user experience with the SRS robot and hence make the project more effective and more efficient. The extension will enable building better robots for personalized health care.

Team members

Smrž Pavel, doc. RNDr., Ph.D. (UPGM FIT VUT) , research leader
Španěl Michal, Ing., Ph.D. (UPGM FIT VUT) , team leader

Publications

2017

MATERNA Zdeněk, ŠPANĚL Michal, MAST Marcus, BERAN Vítězslav, WEISSHARDT Florian, BURMESTER Michael and SMRŽ Pavel. Teleoperating Assistive Robots: A Novel User Interface for Remote Manipulation and Navigation Relying on Semi-Autonomy and Global 3D Environment Mapping. Journal of Robotics and Mechatronics, vol. 29, no. 2, 2017, pp. 381-394. ISSN 0915-3942. Detail

2015

MAST Marcus, BURMESTER Michael, GRAF Brigit, WEISSHARDT Florian, ARBEITER Georg, ŠPANĚL Michal, MATERNA Zdeněk, SMRŽ Pavel and KRONREIF Gernot. Design of the human-robot interaction for a semi-autonomous service robot to assist elderly people. Ambient Assisted Living. Advanced Technologies and Societal Change. Berlin: Springer International Publishing, 2015, pp. 15-29. ISBN 978-3-319-11865-9. Detail
MAST Marcus, MATERNA Zdeněk, ŠPANĚL Michal, WEISSHARDT Florian, ARBEITER Georg, BURMESTER Michael and SMRŽ Pavel. Semi-Autonomous Domestic Service Robots: Evaluation of a User Interface for Remote Manipulation and Navigation With Focus on Effects of Stereoscopic Display. International Journal of Social Robotics, vol. 2015, no. 7, pp. 183-202. ISSN 1875-4791. Detail

2013

POLOK Lukáš, ILA Viorela S., ŠOLONY Marek, ZEMČÍK Pavel and SMRŽ Pavel. Efficient Implementation for Block Matrix Operations Nonlinear Least Squares Problems for Robotic Applications. In: Proceedings of 2013 IEEE International Conference on Robotics and Automation. Karlsruhe: IEEE Computer Society, 2013, pp. 123-131. ISBN 978-1-4673-5642-8. Detail
ILA Viorela S., POLOK Lukáš, SMRŽ Pavel, ŠOLONY Marek and ZEMČÍK Pavel. Incremental Cholesky Factorization for Least Squares Problems in Robotics. In: Proceedings of The 2013 IFAC Intelligent Autonomous Vehicles Symposium. Gold Coast: IEEE Computer Society, 2013, pp. 1-8. ISBN 978-3-902823-36-6. Detail
MAST Marcus, ŠPANĚL Michal, ARBEITER Georg, ŠTANCL Vít, MATERNA Zdeněk, WEISSHARDT Florian, BURMESTER Michael and SMRŽ Pavel. Teleoperation of Domestic Service Robots: Effects of Global 3D Environment Maps in the User Interface on Operators' Cognitive and Performance Metrics. In: Proceedings of International Conference on Social Robotics. Lecture Notes in Artificial Intelligence (LNCS/LNAI), vol. 2013. Bristol: Springer Verlag, 2013, pp. 392-401. ISBN 978-3-319-02674-9. ISSN 0302-9743. Detail

2012

HULÍK Rostislav, BERAN Vítězslav, ŠPANĚL Michal, KRŠEK Přemysl and SMRŽ Pavel. Fast and Accurate Plane Segmentation in Depth Maps for Indoor Scenes. In: IEEE International Conference on Intelligent Robots and Systems. Vilamoura, Algarve: Department of Computer Graphics and Multimedia FIT BUT, 2012, pp. 1665-1670. ISBN 978-1-4673-1737-5. ISSN 2153-0858. Detail
QIU Renxi, JI Ze, NOYVIRT Alexandre, SOROKA Anthony, SETCHI Rossi, PHAM Duc Truong, XU Shuo, SHIVAROV Naiden, PIGINI Lucia, ARBEITER Georg, WEISSHARDT Florian, GRAF Brigit, MAST Marcus, BLASI Lorenzo, FACAL David, ROOKER Martijn, LOPEZ Rafael, LI Dayou, LIU Beisheng, KRONREIF Gernot and SMRŽ Pavel. Towards robust personal assistant robots: Experience gained in the SRS project. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Vilamoura: Institute of Electrical and Electronics Engineers, 2012, pp. 1651-1657. ISBN 978-1-4673-1737-5. Detail