Derleme
BibTex RIS Kaynak Göster

Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme

Yıl 2023, Cilt: 6 Sayı: 1, 59 - 66, 15.03.2023
https://doi.org/10.38016/jista.1175323

Öz

Hizmet robotları için gündelik etkileşimlerinde yürütme, sensör veya ortamsal faktörlerden dolayı emniyetsiz durumlar oluşabilir. Bu tür durumlarda emniyetin sağlanması kritik öneme sahiptir. Bu durumların sezilebilmesi için sürekli eylem gözetimi ve hata sezme bileşenlerine ihtiyaç duyulmaktadır. Bu amaçla, bu çalışmada nesne etkileşim hatalarının sezilmesi için çok kipli bir eylem gözetimi ve hata sezme sistemi sunulmuştur. Tek bir sensör kipine bağımlı kalmak yerine, farklı tipte sensörlerden alınan gözlemler tümleştirilerek farklı hata senaryoları için hata sezme başarımı arttırılmıştır. Önerilen sistemde iç algı, işitsel algı ve görsel algı kipleri birbirlerinden bağımsız olarak işlenerek semantik yüklemler elde edilmiş ve bu yüklemler hata sezme için birleştirilmiştir. İnsansı robotumuz ile masa üstünde yapılan deney sonuçlarına göre sensör verilerinin hata sezmeye katkılarının tamamlayıcı olduğu gözlenmiştir. Çok kipli sensör füzyonuyla hata sezme, tutma eylemi için %86, bırakma ve itme eylemleri için %95 oranında hata sezme başarımı ile tek kipli hata sezmeden daha başarılı sonuçlar üretmiştir.

Destekleyen Kurum

Tübitak

Proje Numarası

115E368

Kaynakça

  • Adam S., Larsen M., Jensen K., and Schultz U. P., 2014. Towards Rule-based Dynamic Safety Monitoring for Mobile Robots. Simulation, Modeling, and Programming for Autonomous Robots. Springer, 207–218.
  • Aldoma A., Marton Z.C., Tombari F., Wohlkinger W., Potthast C., Zeisl B., Rusu R. B., Gedikli S., and Vincze M., 2012. Point cloud library. IEEE Robotics & Automation Magazine, 1070(12).
  • Bouguerra A., Karlsson L., and Saffiotti A., 2007. Handling uncertainty in semantic-knowledge based execution monitoring. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 437–443.
  • Brigham E. O., Pastor J. R., Apostol T. M., Rodríguez M., Martínez M. R., Edwards C. H., Edwards D. E. H., 1998. The fast Fourier transform and its applications, Prentice Hall.
  • Doherty P., Kvarnström J., and Heintz F., 2009. A temporal logic-based planning and execution monitoring framework for unmanned aircraft systems. Autonomous Agents and Multi-Agent Systems, 19(3), 332–377.
  • Freeman W. T. and Roth M., 1994. Orientation histograms for hand gesture recognition. Mitsubishi Electric Research Laboratories Teknik Raporu.
  • Fritz C., 2005. Execution monitoring – a survey. University of Toronto Teknik Raporu.
  • Fourlas G. K., Karkanis S., Karras G. C., and Kyriakopoulos K. J., 2014. Model based actuator fault diagnosis for a mobile robot. IEEE International Conference on Industrial Technology (ICIT), 79–84.
  • Goel P., Dedeoglu G., Roumeliotis S. I., and Sukhatme G. S., 2000. Fault detection and identification in a mobile robot using multiple model estimation and neural network. IEEE International Conference on Robotics and Automation (ICRA), 2302–2309.
  • HARK: http://www.hark.jp/, 12.09.2022.
  • Häussermann K., Zweigle O., and Levi P., 2015. A novel framework for anomaly detection of robot behaviors. Journal of Intelligent & Robotic Systems, 77(2), 361–375.
  • Hinterstoisser S., Cagniart C., Ilic S., Sturm P., Navab N., Fua P., and Lepetit V., 2012. Gradient response maps for real-time detection of textureless objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(5), 876–888.
  • Hovland G. E., and McCarragher, B. J., 1998. Hidden markov models as a process monitor in robotic assembly. The International Journal of Robotics Research, 17(2), 153–168.
  • Inceoglu A., Ince G., Yaslan Y., Sariel S., 2018-1. Comparative Assessment of Sensing Modalities on Manipulation Failure Detection. IEEE International Conference on Robotics and Automation (ICRA) Workshop on Multimodal Robot Perception.
  • Inceoglu A., Ince G., Yaslan Y., Sariel S., 2018-2. Failure Detection Using Proprioceptive, Auditory and Visual Modalities. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Inceoglu A., Koc C., Kanat B. O., Ersen M., and Sariel S., 2018-3. Continuous visual world modeling for autonomous robot manipulation. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49(1), 192 - 205.
  • ISO 10218-2:2011, 2011. Robots and Robotic Devices – Safety Requirements for Industrial Robots – Part 2: Robot Systems and Integration. ISO, Geneva, Switzerland.
  • ISO 10218:2011, 2011. Robots and Robotic Devices – Safety Requirements for Industrial Robots – Part 1: Robots. ISO, Geneva, Switzerland.
  • Kapotoglu M., Koc C., Sariel S., and Ince G., 2014. Action monitoring in cognitive robots. The 22nd Signal Processing and Communications Applications Conference (SIU), 2154–2157.
  • Kirchner D., and Geihs K., 2014. Qualitative bayesian failure diagnosis for robot systems. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Kvarnström J., Heintz F., and Doherty P., 2008. A temporal logic-based planning and execution monitoring system. ICAPS, 198–205.
  • Logan B., 2000. Mel frequency cepstral coefficients for music modeling. International Symposium on Music Information Retrieval (ISMIR).
  • Mendoza J. P., Veloso M., and Simmons R., 2012. Mobile robot fault detection based on redundant information statistics. IEEE/RSJ International Conference on Intelligent Robots and Systems.
  • Mendoza J. P., Veloso M., and Simmons R., 2015. Plan execution monitoring through detection of unmet expectations about action outcomes. IEEE International Conference on Robotics and Automation (ICRA), 3247–3252.
  • Mendoza J. P., Veloso M., Simmons R., 2014. Focused optimization for online detection of anomalous regions. IEEE International Conference on Robotics and Automation (ICRA), 3358–3363.
  • Micalizio R., 2013. Action failure recovery via model-based diagnosis and conformant planning. Computational Intelligence, 29(2), 233–280.
  • Orendt E. M. and Henrich D., 2015. Design of robust robot programs: Deviation detection and classification using entity-based resources. IEEE International Conference on Robotics and Biomimetics (ROBIO), 1704–1710.
  • Pearson K., 1901. On lines and planes of closest fit to systems of points in space. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, 2(11), 559–572.
  • Pettersson O., 2005. Execution monitoring in robotics: A survey. Robotics and Autonomous Systems, 53(2), 73–88.
  • Pettersson O., Karlsson L., and Saffiotti A., 2007. Model-free execution monitoring in behavior-based robotics. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 37(4), 890–901.
  • ROS, 2022: http://www.ros.org/, 12.09.2022.
  • Rubinstein R., 1999. The cross-entropy method for combinatorial and continuous optimization. Methodology and Computing in Applied Probability, 1(2), 127–190.
  • Saied M., Lussier B., Fantoni I., Francis C., Shraim H., and Sanahuja G., 2015. Fault diagnosis and fault-tolerant control strategy for rotor failure in an octorotor. IEEE International Conference on Robotics and Automation (ICRA).
  • Sassi I., Gouin A., and Thiriet J., 2016. A Bayesian Network for Diagnosis of Networked Mobile Robots. Risk, Reliability and Safety: Innovating Theory and Practice (ESREL).
  • Schleyer G. and Russell R. A., 2011. Disturbance and failure classification in walking robots. Australasian Conference on Robotics and Automation, 1–8.
  • Stavrou D., Eliades D. G., Panayiotou C. G., and Polycarpou M., 2015. Fault detection for service mobile robots using model-based method. Autonomous Robots 40(1), 383–394.

Multimodal Failure Detection in Robot-Object Interaction

Yıl 2023, Cilt: 6 Sayı: 1, 59 - 66, 15.03.2023
https://doi.org/10.38016/jista.1175323

Öz

Unsafe situations might arise for service robots in everyday manipulation settings due to operational, sensory or environmental factors. Ensuring safety is crucial for these settings. In order to detect these situations, onboard continuous execution monitoring and failure detection procedures are needed. To address these issues, we present a multimodal failure monitoring and detection system to detect manipulation failures. Rather than relying only on a single sensor modality, we consider integration of different modalities to get better detection performance in different failure cases. In our system, high level proprioceptive, auditory and visual predicates are extracted by processing each modality separately. Then, the extracted predicates are fused altogether. Experiments on our humanoid robot for tabletop manipulation scenarios indicate that the contributions of modalities are complementary of each other. Multimodal fusion-based failure detection outperforms the unimodal detection with 86% success rate for pick and 95% success rates for place and push actions.

Proje Numarası

115E368

Kaynakça

  • Adam S., Larsen M., Jensen K., and Schultz U. P., 2014. Towards Rule-based Dynamic Safety Monitoring for Mobile Robots. Simulation, Modeling, and Programming for Autonomous Robots. Springer, 207–218.
  • Aldoma A., Marton Z.C., Tombari F., Wohlkinger W., Potthast C., Zeisl B., Rusu R. B., Gedikli S., and Vincze M., 2012. Point cloud library. IEEE Robotics & Automation Magazine, 1070(12).
  • Bouguerra A., Karlsson L., and Saffiotti A., 2007. Handling uncertainty in semantic-knowledge based execution monitoring. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 437–443.
  • Brigham E. O., Pastor J. R., Apostol T. M., Rodríguez M., Martínez M. R., Edwards C. H., Edwards D. E. H., 1998. The fast Fourier transform and its applications, Prentice Hall.
  • Doherty P., Kvarnström J., and Heintz F., 2009. A temporal logic-based planning and execution monitoring framework for unmanned aircraft systems. Autonomous Agents and Multi-Agent Systems, 19(3), 332–377.
  • Freeman W. T. and Roth M., 1994. Orientation histograms for hand gesture recognition. Mitsubishi Electric Research Laboratories Teknik Raporu.
  • Fritz C., 2005. Execution monitoring – a survey. University of Toronto Teknik Raporu.
  • Fourlas G. K., Karkanis S., Karras G. C., and Kyriakopoulos K. J., 2014. Model based actuator fault diagnosis for a mobile robot. IEEE International Conference on Industrial Technology (ICIT), 79–84.
  • Goel P., Dedeoglu G., Roumeliotis S. I., and Sukhatme G. S., 2000. Fault detection and identification in a mobile robot using multiple model estimation and neural network. IEEE International Conference on Robotics and Automation (ICRA), 2302–2309.
  • HARK: http://www.hark.jp/, 12.09.2022.
  • Häussermann K., Zweigle O., and Levi P., 2015. A novel framework for anomaly detection of robot behaviors. Journal of Intelligent & Robotic Systems, 77(2), 361–375.
  • Hinterstoisser S., Cagniart C., Ilic S., Sturm P., Navab N., Fua P., and Lepetit V., 2012. Gradient response maps for real-time detection of textureless objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(5), 876–888.
  • Hovland G. E., and McCarragher, B. J., 1998. Hidden markov models as a process monitor in robotic assembly. The International Journal of Robotics Research, 17(2), 153–168.
  • Inceoglu A., Ince G., Yaslan Y., Sariel S., 2018-1. Comparative Assessment of Sensing Modalities on Manipulation Failure Detection. IEEE International Conference on Robotics and Automation (ICRA) Workshop on Multimodal Robot Perception.
  • Inceoglu A., Ince G., Yaslan Y., Sariel S., 2018-2. Failure Detection Using Proprioceptive, Auditory and Visual Modalities. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Inceoglu A., Koc C., Kanat B. O., Ersen M., and Sariel S., 2018-3. Continuous visual world modeling for autonomous robot manipulation. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49(1), 192 - 205.
  • ISO 10218-2:2011, 2011. Robots and Robotic Devices – Safety Requirements for Industrial Robots – Part 2: Robot Systems and Integration. ISO, Geneva, Switzerland.
  • ISO 10218:2011, 2011. Robots and Robotic Devices – Safety Requirements for Industrial Robots – Part 1: Robots. ISO, Geneva, Switzerland.
  • Kapotoglu M., Koc C., Sariel S., and Ince G., 2014. Action monitoring in cognitive robots. The 22nd Signal Processing and Communications Applications Conference (SIU), 2154–2157.
  • Kirchner D., and Geihs K., 2014. Qualitative bayesian failure diagnosis for robot systems. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Kvarnström J., Heintz F., and Doherty P., 2008. A temporal logic-based planning and execution monitoring system. ICAPS, 198–205.
  • Logan B., 2000. Mel frequency cepstral coefficients for music modeling. International Symposium on Music Information Retrieval (ISMIR).
  • Mendoza J. P., Veloso M., and Simmons R., 2012. Mobile robot fault detection based on redundant information statistics. IEEE/RSJ International Conference on Intelligent Robots and Systems.
  • Mendoza J. P., Veloso M., and Simmons R., 2015. Plan execution monitoring through detection of unmet expectations about action outcomes. IEEE International Conference on Robotics and Automation (ICRA), 3247–3252.
  • Mendoza J. P., Veloso M., Simmons R., 2014. Focused optimization for online detection of anomalous regions. IEEE International Conference on Robotics and Automation (ICRA), 3358–3363.
  • Micalizio R., 2013. Action failure recovery via model-based diagnosis and conformant planning. Computational Intelligence, 29(2), 233–280.
  • Orendt E. M. and Henrich D., 2015. Design of robust robot programs: Deviation detection and classification using entity-based resources. IEEE International Conference on Robotics and Biomimetics (ROBIO), 1704–1710.
  • Pearson K., 1901. On lines and planes of closest fit to systems of points in space. The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, 2(11), 559–572.
  • Pettersson O., 2005. Execution monitoring in robotics: A survey. Robotics and Autonomous Systems, 53(2), 73–88.
  • Pettersson O., Karlsson L., and Saffiotti A., 2007. Model-free execution monitoring in behavior-based robotics. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 37(4), 890–901.
  • ROS, 2022: http://www.ros.org/, 12.09.2022.
  • Rubinstein R., 1999. The cross-entropy method for combinatorial and continuous optimization. Methodology and Computing in Applied Probability, 1(2), 127–190.
  • Saied M., Lussier B., Fantoni I., Francis C., Shraim H., and Sanahuja G., 2015. Fault diagnosis and fault-tolerant control strategy for rotor failure in an octorotor. IEEE International Conference on Robotics and Automation (ICRA).
  • Sassi I., Gouin A., and Thiriet J., 2016. A Bayesian Network for Diagnosis of Networked Mobile Robots. Risk, Reliability and Safety: Innovating Theory and Practice (ESREL).
  • Schleyer G. and Russell R. A., 2011. Disturbance and failure classification in walking robots. Australasian Conference on Robotics and Automation, 1–8.
  • Stavrou D., Eliades D. G., Panayiotou C. G., and Polycarpou M., 2015. Fault detection for service mobile robots using model-based method. Autonomous Robots 40(1), 383–394.
Toplam 36 adet kaynakça vardır.

Ayrıntılar

Birincil Dil Türkçe
Konular Yapay Zeka
Bölüm Araştırma Makalesi
Yazarlar

Arda İnceoğlu 0000-0001-8259-3986

Gökhan İnce 0000-0002-0034-030X

Yusuf Yaslan 0000-0001-8038-948X

Sanem Sarıel 0000-0003-2993-6681

Proje Numarası 115E368
Erken Görünüm Tarihi 27 Aralık 2022
Yayımlanma Tarihi 15 Mart 2023
Gönderilme Tarihi 15 Eylül 2022
Yayımlandığı Sayı Yıl 2023 Cilt: 6 Sayı: 1

Kaynak Göster

APA İnceoğlu, A., İnce, G., Yaslan, Y., Sarıel, S. (2023). Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme. Journal of Intelligent Systems: Theory and Applications, 6(1), 59-66. https://doi.org/10.38016/jista.1175323
AMA İnceoğlu A, İnce G, Yaslan Y, Sarıel S. Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme. jista. Mart 2023;6(1):59-66. doi:10.38016/jista.1175323
Chicago İnceoğlu, Arda, Gökhan İnce, Yusuf Yaslan, ve Sanem Sarıel. “Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme”. Journal of Intelligent Systems: Theory and Applications 6, sy. 1 (Mart 2023): 59-66. https://doi.org/10.38016/jista.1175323.
EndNote İnceoğlu A, İnce G, Yaslan Y, Sarıel S (01 Mart 2023) Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme. Journal of Intelligent Systems: Theory and Applications 6 1 59–66.
IEEE A. İnceoğlu, G. İnce, Y. Yaslan, ve S. Sarıel, “Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme”, jista, c. 6, sy. 1, ss. 59–66, 2023, doi: 10.38016/jista.1175323.
ISNAD İnceoğlu, Arda vd. “Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme”. Journal of Intelligent Systems: Theory and Applications 6/1 (Mart 2023), 59-66. https://doi.org/10.38016/jista.1175323.
JAMA İnceoğlu A, İnce G, Yaslan Y, Sarıel S. Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme. jista. 2023;6:59–66.
MLA İnceoğlu, Arda vd. “Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme”. Journal of Intelligent Systems: Theory and Applications, c. 6, sy. 1, 2023, ss. 59-66, doi:10.38016/jista.1175323.
Vancouver İnceoğlu A, İnce G, Yaslan Y, Sarıel S. Robot-Nesne Etkileşiminde Çok Kipli Hata Sezme. jista. 2023;6(1):59-66.

Zeki Sistemler Teori ve Uygulamaları Dergisi