290 research outputs found
Matlab package to assess acoustic contamination of neural electrophysiological data
No full textThe present package contains MATLAB code assessing the acoustic contamination of neural recordings, as well as an example dataset. It refers to the following article:
Roussel et al 2020 J. Neural Eng. https://doi.org/10.1088/1741-2552/abb25e
Please cite this article in publications using this package.
REQUIREMENTS
The scripts in this package require MATLAB R2018b or a more recent release.
CONTENT
The "Data" directory contains an example dataset recorded using a microphone and a neural recording system connected to an electrocorticography electrode grid immersed in a saline solution. The files are formatted as MAT-files with a defined structure.
The "Toolbox" directory contains a MATLAB class named ContaminationAnalysis designed to perform the analysis of potential acoustic contamination. The public methods of this class allow to compute the analyses, store the produced data and display the results. The "functions" subfolder contains MATLAB functions that are used in the ContaminationAnalysis class and/or in the scripts featured in this package.
The "Scripts" directory contains two MATLAB scripts. "data_formatting_example_script" shows how to format the data before analyzing it. "analysis_example_script" shows how to use the ContaminationAnalysis class to carry out the analyses.
LICENSE
Unless stated otherwise, the copyright of all the files of this package (code and data) is owned by INSERM and they are distributed under GNU GPL 3 license. The text of this license can be found in the directory containing the present file.
Some files are distributed under other licenses that are compatible with GNU GPL 3 license. These files, as well as the text of their respective license, are located in the following directories:
- Toolbox/functions/GetFullPath (Copyright 2016 Jan Simon, distributed under 3-clause BSD license)
- Toolbox/functions/matplotlib (Copyright 2019 Stephen Cobeldick, distributed under 3-clause BSD license)
- Toolbox/functions/linkFigureAxes (based on linkaxesInFigure, Copyright 2012 Prime Photonics, LC, distributed under 2-clause BSD license
Interview with Florent Perek
No full textProfessor Florent Perek has a PhD in English and General Linguistics (University of Freiburg) and is a Lecturer in Cognitive Linguistics at the Department of English Language and Applied Linguistics at University of Birmingham, UK. Professor Perek is the author of several articles in international peer-reviewed journals and has, among his most important publications, the 2015 book, Argument structure in usage-based construction grammar: experimental and corpus-based perspectives, edited by John Benjamins.Professor Florent Perek has a PhD in English and General Linguistics (University of Freiburg) and is a Lecturer in Cognitive Linguistics at the Department of English Language and Applied Linguistics at University of Birmingham, UK. Professor Perek is the author of several articles in international peer-reviewed journals and has, among his most important publications, the 2015 book, Argument structure in usage-based construction grammar: experimental and corpus-based perspectives, edited by John Benjamins.------------------------------------------------------------------------------------ENTREVISTA COM FLORENT PEREKFlorent Perek é Doutor em Inglês e Linguística Geral (Universidade de Freiburg, Alemanha) e Professor da área de Linguística Cognitiva do Departamento de Língua Inglesa e Linguística Aplicada na Universidade de Birmingham, no Reino Unido. Perek é autor de uma série de artigos em revistas renomadas internacionalmente e tem, entre suas importantes publicações, seu livro de 2015, o qual foi intitulado Estrutura argumental na gramática de construções baseada no uso: perspectivas experimental e baseada em corpus e foi editado pela John Benjamins.---Original em inglês
Toward a brain-computer interface for speech restoration
No full textRestorer la faculté de parler chez des personnes paralysées et aphasiques pourrait être envisagée via l’utilisation d’une interface cerveau-machine permettant de contrôler un synthétiseur de parole en temps réel. L’objectif de cette thèse était de développer trois aspects nécessaires à la mise au point d’une telle preuve de concept.Premièrement, un synthétiseur permettant de produire en temps-réel de la parole intelligible et controlé par un nombre raisonable de paramètres est nécessaire. Nous avons choisi de synthétiser de la parole à partir des mouvements des articulateurs du conduit vocal. En effet, des études récentes ont suggéré que l’activité neuronale du cortex moteur de la parole pourrait contenir suffisamment d’information pour décoder la parole, et particulièrement ses propriété articulatoire (ex. l’ouverture des lèvres). Nous avons donc développé un synthétiseur produisant de la parole intelligible à partir de données articulatoires. Dans un premier temps, nous avons enregistré un large corpus de données articulatoire et acoustiques synchrones chez un locuteur. Ensuite, nous avons utilisé des techniques d’apprentissage automatique, en particulier des réseaux de neurones profonds, pour construire un modèle permettant de convertir des données articulatoires en parole. Ce synthétisuer a été construit pour fonctionner en temps réel. Enfin, comme première étape vers un contrôle neuronal de ce synthétiseur, nous avons testé qu’il pouvait être contrôlé en temps réel par plusieurs locuteurs, pour produire de la parole inetlligible à partir de leurs mouvements articulatoires dans un paradigme de boucle fermée.Deuxièmement, nous avons étudié le décodage de la parole et de ses propriétés articulatoires à partir d’activités neuronales essentiellement enregistrées dans le cortex moteur de la parole. Nous avons construit un outil permettant de localiser les aires corticales actives, en ligne pendant des chirurgies éveillées à l’hôpital de Grenoble, et nous avons testé ce système chez deux patients atteints d’un cancer du cerveau. Les résultats ont montré que le cortex moteur exhibe une activité spécifique pendant la production de parole dans les bandes beta et gamma du signal, y compris lors de l’imagination de la parole. Les données enregistrées ont ensuite pu être analysées pour décoder l’intention de parler du sujet (réelle ou imaginée), ainsi que la vibration des cordes vocales et les trajectoires des articulateurs principaux du conduit vocal significativement au dessus du niveau de la chance.Enfin, nous nous sommes intéressés aux questions éthiques qui accompagnent le développement et l’usage des interfaces cerveau-machine. Nous avons en particulier considéré trois niveaux de réflexion éthique concernant respectivement l’animal, l’humain et l’humanité.Restoring natural speech in paralyzed and aphasic people could be achieved using a brain-computer interface controlling a speech synthesizer in real-time. The aim of this thesis was thus to develop three main steps toward such proof of concept.First, a prerequisite was to develop a speech synthesizer producing intelligible speech in real-time with a reasonable number of control parameters. Here we chose to synthesize speech from movements of the speech articulators since recent studies suggested that neural activity from the speech motor cortex contains relevant information to decode speech, and especially articulatory features of speech. We thus developed a speech synthesizer that produced intelligible speech from articulatory data. This was achieved by first recording a large dataset of synchronous articulatory and acoustic data in a single speaker. Then, we used machine learning techniques, especially deep neural networks, to build a model able to convert articulatory data into speech. This synthesizer was built to run in real time. Finally, as a first step toward future brain control of this synthesizer, we tested that it could be controlled in real-time by several speakers to produce intelligible speech from articulatory movements in a closed-loop paradigm.Second, we investigated the feasibility of decoding speech and articulatory features from neural activity essentially recorded in the speech motor cortex. We built a tool that allowed to localize active cortical speech areas online during awake brain surgery at the Grenoble Hospital and tested this system in two patients with brain cancer. Results show that the motor cortex exhibits specific activity during speech production in the beta and gamma bands, which are also present during speech imagination. The recorded data could be successfully analyzed to decode speech intention, voicing activity and the trajectories of the main articulators of the vocal tract above chance.Finally, we addressed ethical issues that arise with the development and use of brain-computer interfaces. We considered three levels of ethical questionings, dealing respectively with the animal, the human being, and the human species
Vers une interface cerveau-machine pour la restauration de la parole
No full textRestoring natural speech in paralyzed and aphasic people could be achieved using a brain-computer interface controlling a speech synthesizer in real-time. The aim of this thesis was thus to develop three main steps toward such proof of concept.First, a prerequisite was to develop a speech synthesizer producing intelligible speech in real-time with a reasonable number of control parameters. Here we chose to synthesize speech from movements of the speech articulators since recent studies suggested that neural activity from the speech motor cortex contains relevant information to decode speech, and especially articulatory features of speech. We thus developed a speech synthesizer that produced intelligible speech from articulatory data. This was achieved by first recording a large dataset of synchronous articulatory and acoustic data in a single speaker. Then, we used machine learning techniques, especially deep neural networks, to build a model able to convert articulatory data into speech. This synthesizer was built to run in real time. Finally, as a first step toward future brain control of this synthesizer, we tested that it could be controlled in real-time by several speakers to produce intelligible speech from articulatory movements in a closed-loop paradigm.Second, we investigated the feasibility of decoding speech and articulatory features from neural activity essentially recorded in the speech motor cortex. We built a tool that allowed to localize active cortical speech areas online during awake brain surgery at the Grenoble Hospital and tested this system in two patients with brain cancer. Results show that the motor cortex exhibits specific activity during speech production in the beta and gamma bands, which are also present during speech imagination. The recorded data could be successfully analyzed to decode speech intention, voicing activity and the trajectories of the main articulators of the vocal tract above chance.Finally, we addressed ethical issues that arise with the development and use of brain-computer interfaces. We considered three levels of ethical questionings, dealing respectively with the animal, the human being, and the human species.Restorer la faculté de parler chez des personnes paralysées et aphasiques pourrait être envisagée via l’utilisation d’une interface cerveau-machine permettant de contrôler un synthétiseur de parole en temps réel. L’objectif de cette thèse était de développer trois aspects nécessaires à la mise au point d’une telle preuve de concept.Premièrement, un synthétiseur permettant de produire en temps-réel de la parole intelligible et controlé par un nombre raisonable de paramètres est nécessaire. Nous avons choisi de synthétiser de la parole à partir des mouvements des articulateurs du conduit vocal. En effet, des études récentes ont suggéré que l’activité neuronale du cortex moteur de la parole pourrait contenir suffisamment d’information pour décoder la parole, et particulièrement ses propriété articulatoire (ex. l’ouverture des lèvres). Nous avons donc développé un synthétiseur produisant de la parole intelligible à partir de données articulatoires. Dans un premier temps, nous avons enregistré un large corpus de données articulatoire et acoustiques synchrones chez un locuteur. Ensuite, nous avons utilisé des techniques d’apprentissage automatique, en particulier des réseaux de neurones profonds, pour construire un modèle permettant de convertir des données articulatoires en parole. Ce synthétisuer a été construit pour fonctionner en temps réel. Enfin, comme première étape vers un contrôle neuronal de ce synthétiseur, nous avons testé qu’il pouvait être contrôlé en temps réel par plusieurs locuteurs, pour produire de la parole inetlligible à partir de leurs mouvements articulatoires dans un paradigme de boucle fermée.Deuxièmement, nous avons étudié le décodage de la parole et de ses propriétés articulatoires à partir d’activités neuronales essentiellement enregistrées dans le cortex moteur de la parole. Nous avons construit un outil permettant de localiser les aires corticales actives, en ligne pendant des chirurgies éveillées à l’hôpital de Grenoble, et nous avons testé ce système chez deux patients atteints d’un cancer du cerveau. Les résultats ont montré que le cortex moteur exhibe une activité spécifique pendant la production de parole dans les bandes beta et gamma du signal, y compris lors de l’imagination de la parole. Les données enregistrées ont ensuite pu être analysées pour décoder l’intention de parler du sujet (réelle ou imaginée), ainsi que la vibration des cordes vocales et les trajectoires des articulateurs principaux du conduit vocal significativement au dessus du niveau de la chance.Enfin, nous nous sommes intéressés aux questions éthiques qui accompagnent le développement et l’usage des interfaces cerveau-machine. Nous avons en particulier considéré trois niveaux de réflexion éthique concernant respectivement l’animal, l’humain et l’humanité
Coupled simulator for research on the interaction between pedestrians and (automated) vehicles
No full textDriving simulators are regarded as valuable tools for human factors research on automated driving and traffic safety. However, simulators that enable the study of human-human interactions are rare. In this study, we present an open-source coupled simulator developed in Unity. The simulator supports input from head-mounted displays, motion suits, and game controllers. It facilitates research on interactions between pedestrians and humans inside manual and automated vehicles. We present results of a demo experiment on the interaction between a passenger in an automated car equipped with an external human-machine interface, a driver of a manual car, and a pedestrian. We conclude that the newly developed open-source coupled simulator is a promising tool for future human factors research.Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.Human-Robot InteractionMedical Instruments & Bio-Inspired Technolog
Un consulat et ses finances. Millau (1187-1461)
No full textÀ partir d’une documentation financière riche et variée conservée aux archives municipales de Millau, Florent Garnier s’est intéressé en particulier à l’exceptionnelle série de comptes des consuls boursiers du XIIIe au XVe siècle. Ces registres sont de première importance pour connaître de la vie du consulat de Millau, de ses habitants et, plus largement, du Rouergue et du royaume pendant la guerre de Cent Ans. L’auteur met en lumière la genèse de l’administration financière millavoise, l’élaboration de règles comptables et fiscales puis leur mise en œuvre par le consulat pour collecter et gérer des ressources permanentes nécessaires au financement de ses dépenses. Florent Garnier s’est également livré à une étude prosopographique des gens des finances de cette ville médiévale. Activité exceptionnelle pour certains, placement pour d’autres, étape enfin vers les charges de consul, la gestion de l’argent urbain attire des personnes d’horizons divers. Certains trésoriers de la ville, comptables particuliers ou fermiers de l’impôt, apparaissent comme de véritables « professionnels » des finances. Dépense pour les uns, source de revenu pour d’autres, le prélèvement fiscal est également un enjeu qui s’offre aux différents acteurs de la vie municipale. Il l’est tout autant dans les relations nouées par la communauté urbaine avec le prince. Cette étude qui dépasse la simple monographie s’inscrit dans les récentes recherches menées dans le cadre de l’Occident méditerranéen. « Au fi l de cette recherche profondément novatrice, Florent Garnier s’est imposé comme l’artisan éclairé d’une méthode, l’observateur minutieux d’un milieu et le décrypteur ingénieux d’un système » Albert Rigaudière.Using the rich and varied collection of financial documents preserved in the Millau municipal archives, Florent Garnier has focussed in particular on the exceptional series of Treasurer’s accounts for the period from the 13th to the 15th century. These records are extremely important in enabling us to gain an understanding of how the Millau Treasury was run, the life of the town’s inhabitants and, more broadly, that of Rouergue and the kingdom during the Hundred Years War. The author reveals how the financial administration of Millau developed, how accounting and tax rules were formulated and then how they were implemented by the Treasury in order to collect and manage the resources which they constantly needed to finance their expenditure. Florent Garnier has also conducted a prosopographic study of the people involved in the finances of this medieval town. An exceptional activity for some, a job for others, a step closer to the post of Treasurer: the management of the town’s finances attracted a broad range of people. Some of the town’s Treasurers, who were private accountants or tax collectors known as tax farmers, appear to have been real financial ‘professionals’. The levying of taxes, which was an expense for some and a source of revenues for others, was also a task which was open to various players on the municipal scene. It was a particularly key factor in the relationships established by the urban community with the local prince. This study, which is more than a simple monograph, forms part of the research which has recently been conducted in this field in the Western Mediterranean. ‘Throughout this highly innovative research, Florent Garnier has shown himself to be a craftsman skilled in applying his chosen method, a meticulous observer of a milieuand the ingenious decoder of a system.’ (Albert Rigaudière).La abundante y variada documentación financiera que se guarda en los archivos municipales de Millau ha dado a Florent Garnier la ocasión de interesarse de forma particular en la excepcional serie de cuentas de los llamados consuls boursiers (los “cónsules de la bolsa”), que ejercieron su actividad entre los ss. XIII y XV. Estos registros son de importancia capital para saber de la vida en el Consulado de Millau, de sus habitantes y, de forma más amplia, de la antigua provincia de Rouergue y del reino de Francia durante la Guerra de los Cien Años. El autor hace un repaso por la génesis de la administración financiera del Consulado de Millau así como por la elaboración de las reglas contables y fiscales y su aplicación por parte del Consulado con el fin de recaudar y gestionar los recursos permanentes necesarios a la financiación de sus gastos. Florent Garnier se ha dedicado asimismo a un estudio prosopográfico de los hombres de finanzas de esta ciudad medieval. Cargo de prestigio o acomodo para unos, escalón para acceder al cargo de cónsul para otros, la gestión del dinero municipal atrajo a personas de orígenes diversos. Algunos de los tesoreros de la ciudad, contables particulares o recaudadores delegados, aparecen como auténticos “profesionales” de las finanzas. Gasto para unos, fuente de ingresos para otros, la recaudación tributaria es una cuestión tan crucial para los diferentes actores de la vida municipal como las relaciones que vinculan a la comunidad urbana con el príncipe. Este estudio que supera los límites de la mera monografía se enmarca dentro de las recientes investigaciones que tienen por objeto el Occidente Mediterráneo. “Florent Garnier se va imponiendo a lo largo de esta investigación profundamente innovadora como el artífice aventajado de un método, como el observador minucioso de un mundo que descifra con ingenio un sistema” (Albert Rigaudière).Le Comité pour l’histoire économique et financière est présidé par le ministre de l’Économie, des Finances et de l’Industrie, son vice-président est Maurice Lévy-Leboyer. Commission administrative : Les directeurs et chefs de service du ministère de l’Économie, des Finances et de l’Industrie, le gouverneur de la Banque de France, le directeur générale des Archives de France, le président de la Bibliothèque de France, le président de l’Imprimerie nationale. Commission scientifique : Guy Antonetti, Jean-Charles Asselain, Françoise Bayard, Christian de Boissieu, Éric Bussière, Jacques Campet, François Caron, Philippe Contamine, Agnès D’Angio-Barros, Robert Frank, Patrick Fridenson, René Girault (†), Jean-Noël Jeanneney, Jean Kerhervé, Michel Lescure, Maurice Lévy-Leboyer, Michel Margairaz, Jacques Marseille, François Monnier, Alain Plessis, Raymond Poidevin (†), Albert Rigaudière, Guy Thuillier, Jean Tulard, Denis Woronoff. Membres honoraires : Michel Aglietta, Michel Antoine, Louis Bergeron, Jean-Jacques Bienvenu, Yves Mény, Gabriel Montagnier. La mission du Comité est de contribuer à une meilleure connaissance de l’histoire de l’État et de son rôle en matière économique et financière depuis le Moyen Âge jusqu’à nos jours, de susciter des travaux scientifiques et d’en aider la diffusion
: From material objects to digital data: multi-scale and multi-temporal digitalization challenges
No full textContributeurs : Florent Comte, Eloi Gattet, El Mustapha Mouaddib, Anthony Pamart, Renato Saleri, Livio De Luca, Aurore Pfitzmann // Author contributions : Conceptualization: F.C.; Data curation: F.C., E.G., E.M.M., A.P., R.S.; Formal analysis: ; Funding acquisition: L.D.L.; Investigation: ; Methodology: ; Project administration: L.D.L., A.P.; Resources: ; Software: ; Supervision: L.D.L.; Validation: L.D.L.; Visualization: F.C., E.G., E.M.M., A.P., R.S.; Writing – original draft: F.C., E.G., E.M.M., A.P., R.S.; Writing – review & editing: F.C.International audienceDescription des réflexions et des outils utilisés pour la numérisation 3D dans le cadre du Chantier Scientifique de Notre-Dame de Paris
Contradictive influence vectors of impressionism discoursing in the French music of the 20th century half - postimpressionist „aesthetics of labyrinth” - the composer’s portraits of Charles Koechlin and Florent Schmitt
No full textHerein article has been entirely based on the French documentation and written as result of the author’s many years of research study in the field of French culture and music. The studies have brought to revealing more and more cards, which has occurred in terms of these two not particularly widely known composers in Poland: Charles Koechlin and Florent Schmitt. These two artists complemented and developed the Claude Debussy’ output. At times they redirected his composer’s interest into other spheres, thus getting influenced by other trends, producing slightly magic creations, fascinating with their sound and aesthetic conveyance. The core of this presentation is to precisely define the genesis of the two contrary creative worlds characteristic for the French postimpressionism of those two not widely known characters. The author also strives to sketch the opposition of these two creative standpoints, a line drawn in the form of expressionistic impressionism, coloured with the touch of German influence, and a line of classicist, typically Gallic, modally determined and paradoxically, contrapuntally; the common element for these two aesthetic spheres is their sensitivity to oriental infiltrations. The author derives her conclusions from a deep analysis of the works composed by Koechlin and Schmitt. Both composers, despite their metamorphoses, at the same time likewise and differently fit well into the picture of romantic isolation: Charles Koechlin, devoted to „shadows of the past”, and Florent Schmitt – absorbed in the dramatic narration, while „social interaction” only partially determined their art. Axioms of tradition did not loose their meaning with those artists, but got evolved, revalued, even in their most
contractive dimensions, even in the canon of the French everlasting classicism. In the final
part, the author proposes to recognise Gerard Denizeau with the epithet „aesthetician of labyrinth”, which was used by the author to name the art of the second half of the twentieth century; this Gallic labyrinth of the postimpressionist art, built on contradictory assumptions, does not have a single, proper way out, and its multiple pathways remind of the courtly French style gardens with their principle of „game” and illusion. When looking at these processes in a universal way we can notice that the music is a part of the nature, that each power has its reversal, and reversals of both power are opposite. The above drawn picture also arguments that each direction has two reversals, that each action resonates in reaction, usually binary-oriented
Key considerations in designing a speech brain-computer interface
No full textInternational audienceRestoring communication in case of aphasia is a key challenge for neurotechnologies. To this end, brain-computer strategies can be envisioned to allow artificial speech synthesis from the continuous decoding of neural signals underlying speech imagination. Such speech brain-computer interfaces do not exist yet and their design should consider three key choices that need to be made: the choice of appropriate brain regions to record neural activity from, the choice of an appropriate recording technique, and the choice of a neural decoding scheme in association with an appropriate speech synthesis method. These key considerations are discussed here in light of (1) the current understanding of the functional neuroanatomy of cortical areas underlying overt and covert speech production, (2) the available literature making use of a variety of brain recording techniques to better characterize and address the challenge of decoding cor-tical speech signals, and (3) the different speech synthesis approaches that can be considered depending on the level of speech representation (phonetic, acoustic or articulatory) envisioned to be decoded at the core of a speech BCI paradigm
Real-time Control of a DNN-based Articulatory Synthesizer for Silent Speech Conversion: a pilot study
No full textInternational audienceThis article presents a pilot study on the real-time control of an articulatory synthesizer based on deep neural network (DNN), in the context of silent speech interface. The underlying hypothesis is that a silent speaker could benefit from real-time audio feedback to regulate his/her own production. In this study, we use 3D electromagnetic-articulography (EMA) to capture speech articulation, a DNN to convert EMA to spectral trajectories in real-time, and a standard vocoder excited by white noise for audio synthesis. As shown by recent literature on silent speech, adaptation of the articulo-acoustic modeling process is needed to account for possible inconsistencies between the initial training phase and practical usage conditions. In this study, we focus on different sensor setups across sessions (for the same speaker). Model adaptation is performed by cascading another neural network to the DNN used for articulatory-to-acoustic mapping. The intelligibility of the synthetic speech signal converted in real-time is evaluated using both objective and perceptual measurements
- …
