90 research outputs found
Tuning the body to music
No full textTämän työn aiheena ovat äänen psykoakustiset ominaisuudet, musiikkiin liitettävät tunteet, ja niiden aiheuttamat fysiologiset vasteet. Tavoitteena on kehittää reaaliaikainen järjestelmä psykoakustisten ominaisuuksien mallintamiseksi kuuntelijan fysiologisten vasteiden perusteella. Tämän teknologian mahdollisia käyttökohteita ovat fysiologisesti ja tunteellisesti tietoisten käyttöliittymien kehittäminen, sekä taiteellinen ilmaisu.
Työ alkaa katsauksella autonomiseen hermostoon, affektiiviseen tietotekniikkaan ja musiikin tiedonhakuun. Metodiosiossa kartoitetaan tunnettuja työkaluja ja menetelmiä fysiologisten signaalien ja psykoakustisten ominaisuuksien analysoimiseksi. Koska saatavilla ei ollut työkaluja ihon sähkönjohtavuuden, sydänsähkökäyrän ja hengityksen reaaliaikaista analyysiä varten, kehitettiin tätä tarkoitusta varten uusi tietokoneohjelmisto. Äänen analyysi ja regressiomallinnus toteutettiin olemassaolevilla työkaluilla.
Arviointitutkimuksen avulla pyrittiin selvittämään regressiomallin toimivuus. Validoidussa paradigmassa monen muuttujan lineaarista regressiomallia ja neuroverkkomallia verrattiin vakiomalliin. Lopputulos oli sekalainen. Vakiomalli oli tarkempi kuin kaksi muuta mallia, mutta neuroverkkomalli saavutti merkittäviä korrelaatioita ennusteiden ja kohdearvojen välille. Päätösluvussa teen ehdotuksia nykyisen järjestelmän edelleenkehittämistä varten, sekä ehdotan mahdollisia jatkotutkimuksen aiheita.}The topic of this work is determining the relationship between the psychoacoustic qualities of sound, musical emotions, and their physiological response patterning. The goal is the development of a real-time system for predicting psychoacoustic features, derived from a songs audio signal, with physiological measurements of the listener. Possible uses for this technology are in the creation of physiologically and affectively aware user interfaces, as well as in artistic expression.
The background chapter consists of an overview of the autonomous nervous system, affective computing, and music information retrieval. In the methods chapter the available tools and methods for the analysis of physiological signals and psychoacoustic features from music are evaluated. Because no readily available software is identified for real-time analysis of electrodermal activation, electrocardiography and respiration inductance plethysmography, a new software application is developed for this purpose. Audio analysis and regression modeling are approached using existing tools.
An evaluation study is conducted to determine the efficacy of the regression model. In a validated paradigm, a multiple linear regression model and an artificial neural network model are tested against a constant regressor, or dummy model. The results of the evaluation study are mixed. The dummy model outperforms the other models in prediction accuracy, but the artificial neural network model achieves significant correlations between predictions and target values. In the conclusion chapter I suggest improvements to the current system and possible future directions for this research
Intersubjectivity and cooperation in synchronous computer-mediated interaction
No full textInterpersonal communication depends on a variety of signals, which humans have evolved to observe and understand in face-to-face interaction. Direct social perception and primary intersubjectivity refer to the ability to process non-verbal signals about the mental states of other people quickly and automatically, as a way to sort of co-experience them. Mediated communication is often necessary and even preferred due to different reasons, such as distance, time, or the use of technological tools, but currently there is no match for physical presence when it comes to engaging the mechanisms of primary intersubjectivity for understanding emotion and intent.
This thesis is about the development of digital tools for improving collaboration in synchronous computer-mediated communication. While exploring multimodal technologies for communication, a lack of quantifiable measures for assessing the effects of prototypes on cooperation was identified. To this end, collaborative performance tasks were developed for a series of studies and used in order to investigate cooperation in computer-mediated interaction.
In Study I, a joint coordination task in the form of a collaborative car racing game was used to study inter-brain synchronization without physical presence. The study revealed that EEG synchonization happens in the online gaming context. EEG synchronization was connected to task performance both momentarily, with higher gamma synchrony occurring during better performance, and pairwise, with higher overall alpha synchrony among high-performing pairs.
Study II details the development and testing of a collaborative block design task, which was created to assess pair performance in social virtual reality (VR). The task can also be replicated in face-to-face interaction, making it possible to compare effects in these two domains. Individual visuospatial intelligence was identified as a factor that needs to be controlled when using the collaborative block design task.
In Study III, a mouse controlled visual guidance task was developed to study the application of heart rate sharing in online chat box customer service. Combining quantitative and qualitative data, the study revealed that biosignal sharing might not be an optimal strategy for supporting cooperation and presence in customer service text chat.
Taken together, the results suggest that both cooperative task performance and inter-brain synchronization can be meaningful measures in the development of synchronous computer-mediated communication. A final task, SynchroMouse is presented as a possible activity for increasing inter-brain and interpersonal synchronization online.Tämä väitöskirja koskee läsnäolon ja yhteistyön tukemista samanaikaisessa verkon yli tapahtuvassa vuorovaikutuksessa, ja menetelmiä yhteistyön mittaamiseksi. Yhteistyötehtäviä kehitettiin tutkimussarjassa, joka tutkii yhteistoimintaa tietokonevälitteisessä kommunikaatiossa.
Verkossa tapahtuva ihmistenvälinen vuorovaikutus on hyvin suosittua, ja sen käyttö on lisääntynyt viime vuosina. Sitä käytetään yhteistyöhön ja sosiaalisten suhteiden ylläpitoon. Meidän sosiaaliset kykymme ovat kuitenkin kehittyneet kasvokkain tapahtuvassa vuorovaikutuksessa, ja verkossa pienet eleet, ilmeet ja ihmisten välinen tahdistuminen, joiden avulla ymmärrämme toistemme tunteita ja aikeita, jäävät usein vähemmälle huomiolle.
Ensimmäinen osatutkimus osoitti, että aivojen välistä tahdistumista tapahtuu kun ihmiset pelaavat verkkopeliä ilman fyysistä läsnäoloa, ja että tahdistuminen on yhteydessä yhteistyössä suoriutumiseen. Toisessa osatutkimuksessa kehitettiin menetelmää, jolla voidaan arvioida yhteistyötä virtuaalitodellisuudessa, ja vertailla sitä kasvokkain tapahtuvaan yhteistyöhön. Kolmas osatutkimus tutki sykeinformaation käyttämistä kommunikaatiossa, ja osoitti sen olevan haitallista yhteistyötehtävässä suoriutumisen suhteen.
Kokonaisuudessaan väitöstutkimus osoittaa, että verkkovuorovaikutusta voidaan kehittää yhteistyötehtävillä. Aivojen välisen tahdistumisen lisääminen voi myös olla keino parantaa läsnäolon tunnetta ja empatiaa verkossa. Lopuksi esitellään moninpelitehtävä, SynchroMouse, jonka on tarkoitus lisätä tahdistumista etänä.ei saavutettav
Emotion transfer protocol
No full textA problem exists in computer-mediated communication (CMC). A distinct lack of presence and emotional nuance causes the quality of CMC to be shallower than face-to-face communication, causing misunderstandings and a lack of empathy. This thesis proposes a solution by widening the emotional bandwidth, with the help of augmenting the digital communication channel by utilizing new technologies and principles derived from scientific theory and practice in design.
The goal of this thesis is to draft a proposal for a new internet protocol: the Emotion Transfer Protocol. Several questions need to be answered: How can emotions be described in an accurate and meaningful way? How can emotions be measured, transmitted, and represented? This thesis approaches these questions from an inclusive point of view, by considering different and even op-posing answers, leaving space for future work to expand and reduce the scope of the protocol.
The protocol itself is divided into three components: input, transmission, and output. Each of the components is presented as a collection of approaches that are currently used in daily life, and in research to represent, map, and read emotions. An interesting finding that is present on all levels of emotion science and technology is a divide between unconscious and conscious representations, and this is also considered in the protocol by dividing it into an explicit and an implicit version
A novel idea of unlabeled emotions is presented, meaning emotional representations that are left to be interpreted by the receiver. Unlabeled emotions and emotion transmission are explored in three different practical art, design, and research projects
Science Capital: Results from a Finnish Population Survey
No full textThis project is created for storing the materials, data and analysis code of the Finnish Science Capital Population Survey 2021 reported in Kaakinen, J. K., Havu-Nuutinen, S., Häikiö, T., Julku, H., Koskela, T., Mikkilä-Erdmann, M., ... & Wikström, V. (2025). Science capital: Results from a Finnish population survey. Public Understanding of Science, https://doi.org/10.1177/0963662524131075
Musical Composition by Regressional Mapping of Physiological Responses to Acoustic Features
No full textIn this paper an emotionally justified approach for controlling sound with physiology is presented. Measurements of listeners' physiology, while they are listening to recorded music of their own choosing, are used to create a regression model that predicts features extracted from music with the help of the listeners' physiological response patterns. This information can be used as a control signal to drive musical composition and synthesis of new sounds an approach involving concatenative sound synthesis is suggested. An evaluation study was conducted to test the feasibility of the model. A multiple linear regression model and an artificial neural network model were evaluated against a constant regressor, or dummy model. The dummy model outperformed the other models in prediction accuracy, but the artificial neural network model achieved significant correlations between predictions and target values for many acoustic features
Musical Engagement that is Predicated on Intentional Activity of the Performer with NOISA Instruments
No full textThis paper presents our current research in which we study the notion of performer engagement within the variance and diversities of the intentional activities of the performer in musical interaction. We introduce a user-test study with the aim to evaluate our system's engagement prediction capability and to understand in detail the system's response behaviour. The quantitative results indicate that our system recognises and monitors performer's engagement successfully, although we found that the system's response to maintain and deepen the performer's engagement is perceived differently among participants. The results reported in this paper can be used to inform the design of interactive systems that enhance the quality of performer's engagement in musical interaction with new interfaces
- …
