Published papers

This paper describes a new wearable thermal display, the Thermal Feedback Influencer, that can provide chilling stimuli to the skin in order to enhance emotional experiences of music listening. We developed a prototype device that can be attached to behind the ear. The device is designed to be small and lightweight enough to be worn comfortably. In this work, we describe basic concepts of this research, preliminary test results, details and evaluation of the developed prototype. We also summarize methods to provide thermal feedback with music and discuss the possible applications and future research plans.

Approximately 30% of patients with schizophrenia do not respond to antipsychotics and are thus considered to have treatment-resistant schizophrenia (TRS). To date, only four studies have examined glutamatergic neurometabolite levels using proton magnetic resonance spectroscopy (1H-MRS) in patients with TRS, collectively suggesting that glutamatergic dysfunction may be implicated in the pathophysiology of TRS. Notably, the TRS patient population in these studies had mild-to-moderate illness severity, which is not entirely reflective of what is observed in clinical practice. In this present work, we compared glutamate + glutamine (Glx) levels in the dorsal anterior cingulate cortex (dACC) and caudate among patients with TRS, patients with non-TRS, and healthy controls (HCs), using 3T 1H-MRS (PRESS, TE = 35 ms). TRS criteria were defined by severe positive symptoms (i.e., ≥5 on 2 Positive and Negative Syndrome Scale (PANSS)-positive symptom items or ≥4 on 3 PANSS-positive symptom items), despite standard antipsychotic treatment. A total of 95 participants were included (29 TRS patients [PANSS = 111.2 ± 20.4], 33 non-TRS patients [PANSS = 49.8 ± 13.7], and 33 HCs). dACC Glx levels were higher in the TRS group vs. HCs (group effect: F[2,75] = 4.74, p = 0.011; TRS vs. HCs: p = 0.012). No group differences were identified in the caudate. There were no associations between Glx levels and clinical severity in either patient group. Our results are suggestive of greater heterogeneity in TRS relative to non-TRS with respect to dACC Glx levels, necessitating further research to determine biological subtypes of TRS.

ヒトの身体運動スキル獲得過程に観測されるパフォーマンスや運動の変動性について、神経生理学的な観点と非線形力学系モデリングの観点から概説した。

Auditory frisson is the experience of feeling of cold or shivering related to sound in the absence of a physical cold stimulus. Multiple examples of frisson-inducing sounds have been reported, but the mechanism of auditory frisson remains elusive. Typical frisson-inducing sounds may contain a looming effect, in which a sound appears to approach the listener’s peripersonal space. Previous studies on sound in peripersonal space have provided objective measurements of sound-inducing effects, but few have investigated the subjective experience of frisson-inducing sounds. Here we explored whether it is possible to produce subjective feelings of frisson by moving a noise sound (white noise, rolling beads noise, or frictional noise produced by rubbing a plastic bag) stimulus around a listener’s head. Our results demonstrated that sound-induced frisson can be experienced stronger when auditory stimuli are rotated around the head (binaural moving sounds) than the one without the rotation (monaural static sounds), regardless of the source of the noise sound. Pearson’s correlation analysis showed that several acoustic features of auditory stimuli, such as variance of interaural level difference (ILD), loudness, and sharpness, were correlated with the magnitude of subjective frisson. We had also observed that the subjective feelings of frisson by moving a musical sound had increased comparing with a static musical sound.

Why do professional athletes and musicians exhibit individually different motion patterns? For example, baseball pitchers generate various pitching forms, e.g., variable wind-up, cocking, and follow-through forms. However, they commonly rotate their wrists and fingers at increasingly high speeds via shoulder and trunk motions. Despite the universality of common and individually different motion patterns in skilled movements, the abovementioned question remains unanswered. Here, we focus on a motion required to hit a snare drum, including the indirect phase of task achievement (i.e., the early movement and mid-flight phases) and the direct phase of task achievement (i.e., the hit phase). We apply tensor decomposition to collected kinematic data for the drum-hitting motion, enabling us to decompose high-dimensional and time-varying motion data into individually different and common movement patterns. As a result, individually different motion patterns emerge during the indirect phase of task achievement, and common motion patterns are evident in the direct phase of task achievement. Athletes and musicians are thus possibly allowed to perform individually different motion patterns during the indirect phase of task achievement. Additionally, they are required to exhibit common patterns during the direct phase of task achievement.

Despite previous neuroimaging studies demonstrating morphological abnormalities of the thalamus and other subcortical structures in patients with schizophrenia, the potential role of the thalamus and its subdivisions in the pathophysiology of this illness remains elusive. It is also unclear whether similar changes of these structures occur in individuals at high risk for psychosis. In this study, magnetic resonance imaging was employed with the Multiple Automatically Generated Templates (MAGeT) brain segmentation algorithm to determine volumes of the thalamic subdivisions, the striatum (caudate, putamen, and nucleus accumbens), and the globus pallidus in 62 patients with schizophrenia, 38 individuals with an at-risk mental state (ARMS) [4 of whom (10.5%) subsequently developed schizophrenia], and 61 healthy subjects. Cognitive function of the patients was assessed by using the Brief Assessment of Cognition in Schizophrenia (BACS) and the Schizophrenia Cognition Rating Scale (SCoRS). Thalamic volume (particularly the medial dorsal and ventral lateral nuclei) was smaller in the schizophrenia group than the ARMS and control groups, while there were no differences for the striatum and globus pallidus. In the schizophrenia group, the reduction of thalamic ventral lateral nucleus volume was significantly associated with lower BACS score. The pallidal volume was positively correlated with the dose of antipsychotic treatment in the schizophrenia group. These results suggest that patients with schizophrenia, but not those with ARMS, exhibit volume reduction in specific thalamic subdivisions, which may underlie core clinical features of this illness.

Humans develop auditory-motor interaction to produce a variety of rhythmic sounds using body movements, which are often produced and amplified with tools, such as drumming. The extended production of sounds allows us to express a wide range of emotions, accompanied by physiological changes. According to previous studies, even young infants enhance movements in response to auditory feedback. However, their exhibition of physiological adaptation on the emergence of auditory-motor interaction is unclear. We investigated the movement and cardiac changes associated with auditory feedback to spontaneous limb movements in 3-month-old infants. The results showed that infants increased the frequency of limb movements inducing auditory feedback, while they exhibited a more regular rhythm of the limb movements. Furthermore, heart rate increase associated with the limb movement was first inhibited immediately after the timing of the auditory feedback, which may reflect sustained attention to the auditory stimuli. Then, through auditory-motor experience, the heart rate increase was inhibited even prior to the auditory feedback, leading to suppression of the peak intensity of the heart rate increase. These findings suggest that young infants regulate the cardiovascular system as well as limb movements in anticipation of the auditory feedback. The anticipatory regulation associated with movement and attentional changes may contribute to reduced cardiovascular stress in auditory-motor interaction, and provide a developmental basis for more sophisticated goal-directed behavior of producing rhythmic sounds.

Motor learning is a process whereby the acquisition of new skills occurs with practice, and can be influenced by the provision of feedback. An important question is what frequency of feedback facilitates motor learning. The guidance hypothesis assumes that the provision of less augmented feedback is better than more because a learner can use his/her own inherent feedback. However, it is unclear whether this hypothesis holds true for all types of augmented feedback, including for example sonified information about performance. Thus, we aimed to test what frequency of augmented sonified feedback facilitates the motor learning of a novel joint coordination pattern. Twenty healthy volunteers first reached to a target with their arm (baseline phase). We manipulated this baseline kinematic data for each individual to create a novel target joint coordination pattern. Participants then practiced to learn the novel target joint coordination pattern, receiving either feedback on every trial i.e., 100% feedback (n = 10), or every other trial, i.e., 50% feedback (n = 10; acquisition phase). We created a sonification system to provide the feedback. This feedback was a pure tone that varied in intensity in proportion to the error of the performed joint coordination relative to the target pattern. Thus, the auditory feedback contained information about performance in real-time (i.e., “concurrent, knowledge of performance feedback”). Participants performed the novel joint coordination pattern with no-feedback immediately after the acquisition phase (immediate retention phase), and on the next day (delayed retention phase). The root-mean squared error (RMSE) and variable error (VE) of joint coordination were significantly reduced during the acquisition phase in both 100 and 50% feedback groups. There was no significant difference in VE between the groups at immediate and delayed retention phases. However, at both these retention phases, the 100% feedback group showed significantly smaller RMSE than the 50% group. Thus, contrary to the guidance hypothesis, our findings suggest that the provision of more, concurrent knowledge of performance auditory feedback during the acquisition of a novel joint coordination pattern, may result in better skill retention.

熟練ドラム奏者の最速リズム運動制御機構に着目し、これまで世界的に未開拓であったドラム奏者の運動制御学分野の開拓に寄与した。