685 research outputs found

    Towards Multimodal Cognitive Architecture for Human-Robot Shared Perception

    No full text
    For many years, robots have been used in specific repetitive tasks, especially in industrial contexts. However, in recent years, robots start to be deployed in interactive and collaborative contexts with humans. The cognitive capabilities of robots are one of the main open challenges for effective interactions. Shared Perception is one of the important skills that are important for effective collaboration. In robotics, shared perception was studied from the human perspective (how to enable shared perception in an interaction with a robot). In the cognitive architectures side of research shared perception was never studied except for some skills that are important to enable shared perception (perspective talking, gaze understanding, and gaze following). Therefore, my research firstly bases five general required skills for robotics in shared perception which are Having a common representation, Expressing effective communication, Spatiotemporal coordination, Affective modulation mechanism, and Understanding the other. Indeed, it is a complex skill and requires more than a Ph.D. to cover all concepts. Therefore, the main research activities were building cognitive architectures that try to address different concepts within the first three skills. The main aim is to build cognitive architectures that take the robots one step towards shared perception cognitive architecture. The architectures are built sequentially and based on each other. The approach to building these architectures has four characteristics Biological inspiration, Multi-modality more specifically audio and vision, Generalization (Not targeting a specific task), and Attention-based (Starting with state-of-the-art attention models and building upwards to include higher cognitive capabilities). Following this, the Ph.D. has three main research questions as the following: 1. How can we integrate state-of-the-art vision and audio models to allow the robot to jointly attend to the environment with a human partner? Is the behavior of the robot effectively received by the human partner? and What is the mutual influence between the robot and the human partner during the interaction using this architecture? 2. How can this integrated audio-visual attention architecture be used by the robot to understand a complex audio-visual environment? How can uncertainty be handled? How can the robot actively perceive the environment? 3. Can this perception architecture be generalized to different robots and applied to a complex task that requires coordination with another agent? Each question of these three questions is related to one or more skills within the first three required skills from the mentioned five skills above. Trying to address these questions, I designed a series of architectures that are implemented cumulatively and showed how different cognitive blocks can be integrated to improve the perception capabilities of the robot, dealing with uncertainty, and noise in general conditions. The validation of these architectures was done using multiple robotic platforms (iCub, Pepper robot, and Essex agricultural robot) in different conditions with the robot only, with the existence of a human partner, with another robotic agent, and in a real-world application. Further, I did some research activities related to improving the auditory modality. This was due to the outcomes of the experiments where audio processing was the main bottleneck process in the system. The improvements were building a developmental pipeline for audio. I used this pipeline to create an alternative model for audio localization that achieved very promising results. The second activity in auditory improvements was exploring alternative learning processes other than deep learning models that are more lightweight and suitable for robotic applications. Although the proposed architectures don’t address all the required skills of shared perception, they address some points in that direction and also some open challenges in the field of cognitive architecture. More specifically, mutual influence in human-robot interaction scenarios, cross-modal interaction, and general unified perception modeling. The last integrated proposed architecture is a solid base for the development of a shared perception cognitive architecture for robots. Finally, this work opens multiple research lines in the future. The future development research lines can be divided into three main categories which are Integrating other cognitive components, Improving the individual modalities, and Applications, and Modeling the impairments

    Enhancing the hydrogen photo-production using zinc oxide films doped with iron, tin, and aluminum

    No full text
    Hydrogen is recognized as the most promising renewable energy source and can be efficiently produced through water photo-electrolysis green process. This study investigates the performance of ZnO nanorods doped with Fe, Al, and Sn at a 2 % molar ratio for hydrogen photo-production. The films were prepared using a combination of successive ionic layer adsorption and reaction (SILAR) and chemical bath deposition (CBD) methods. X-ray diffraction (XRD) analysis confirmed the hexagonal structure of the doped ZnO films with preferential growth along the (002) orientation, while energy-dispersive X-ray spectroscopy (EDX) confirmed their high purity. The doping with Al maintains the ZnO nanorods morphology while Fe, and Sn doping induced changes to overlapped nanoflakes/nanoflowers morphology. Optical analysis revealed a clear trend in the energy band gap, with Fe-ZnO film exhibiting the lowest value (2.95 eV), followed by Al-ZnO (3.03 eV), Sn-ZnO (3.07 eV), and ZnO (3.11 eV). The Fe-ZnO film also demonstrated the best performance as a photoelectrode for hydrogen generation, achieving optimized incident photon-to-current efficiency (IPCE) and applied bias photon-to-current efficiency (ABPE) values of 1.45 % and 0.20 % respectively, under 500 nm monochromatic illumination, with high reproducibility, and durability. These findings represent one step forward to developing ZnO-doped photoanodes for efficient and sustainable hydrogen green production

    sj-png-5-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-5-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p

    sj-png-7-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-7-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p

    sj-png-6-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-6-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p

    sj-png-2-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-2-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p

    sj-png-4-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-4-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p

    sj-png-9-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-9-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p

    sj-png-1-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-1-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p

    sj-png-8-ppj-10.1177_17504589231186491 – Supplemental material for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia

    No full text
    Supplemental material, sj-png-8-ppj-10.1177_17504589231186491 for A systematic review and meta-analysis on the efficacy and safety of the Baska mask versus other laryngeal mask airways during general anaesthesia by Hammad Ali Fadlalmola, Amal Mohamed Elhusein, Abdalla Mohamed Osman, Hamza Hosean Balola, Elturabi Elsayed Ebrahim, Sitelgeel Hamouda Babiker, Nagwa Ibrahim Ghoneim, Raga Abdelfatah Ebrahim, Maha Abdalla Ali, Amani Abdelgader Mohammed, Ghada Siddig Eshag, Sara Elsadig Mohamed, Farida Rahamtalla Shaaeldein and Khaled Mohammed Al-Sayaghi in Journal of Perioperative Practice</p
    corecore