Search Results (10)

This paper investigates the relationship between syllabic duration and F0 contours for implementing three prosodic functions. Work on rhythm usually describes the evolution of syllable-sized durations throughout utterances, rarely making reference to melodic events. On the other hand, work on intonation usually describes linear sequences of melodic events with indirect references to duration. Although some scholars have explored the relationship between these two parameters for particular functions, to our knowledge, there has been no investigation on the systematic correlation between syllabic duration and F0 values throughout narrative sequences. Based on a corpus of story retelling with nine speakers of Brazilian Portuguese from two regions, our work investigated the interplay between syllabic duration and melody to signal three prosodic functions: terminal and non-terminal boundary marking and prominence. The examination of local syllabic duration maxima and four F0 descriptors revealed that these maxima act as landmarks for particular F0 shapes: for non-terminal boundaries, the great majority of shapes were increasing and increasing–decreasing patterns; for terminal boundaries, almost all shapes were decreasing F0 patterns; and for prominence marking, the great majority of shapes were high tones across the stressed syllable. Time series analyses revealed significant correlations between duration and specific F0 descriptors, pointing to a ruled interplay between F0 and syllabic duration patterns in Brazilian Portuguese story retelling. Full article

This paper is devoted to the features of sentence prosody (intonation) in Brazilian Portuguese spoken by immigrants whose first language is Russian, and explores the consequences that L1–L2 influence in intonation may have for communication. The study addressed four research questions: (1) Do Brazilian Portuguese L2 speakers with Russian L1 always succeed in producing the correct utterance type? (2) Can L1–L2 influence lead to misunderstanding of connotations? (3) Is it possible that sometimes L1–L2 influence leads to being perceived as too emotional or not emotional enough? (4) Can L1–L2 influence in intonation be a significant factor in the perception of accent? In a perceptual experiment, productions of four target utterances in Brazilian Portuguese by Russian L1 and Brazilian Portuguese L1 speakers were evaluated by 124 Brazilian listeners in terms of sentence type, possible connotations, accent and arousal. The target utterances included three questions of different types and an exclamation. The findings revealed that the speaker’s L1 influenced the perception of prosodic meanings by Brazilian listeners. In some cases, interference from Russian melodic contours caused the incorrect identification of the sentence type in Brazilian Portuguese. However, even when sentence type was perceived correctly, differences could be found regarding the perception of arousal or accent. Full article

Background: This study investigated how different hearing profiles influenced melodic contour identification (MCI) in a real-world concert setting with a live band including drums, bass, and a lead instrument. We aimed to determine the impact of various auditory assistive technologies on music perception in an ecologically valid environment. Methods: The study involved 43 participants with varying hearing capabilities: normal hearing, bilateral hearing aids, bimodal hearing, single-sided cochlear implants, and bilateral cochlear implants. Participants were exposed to melodies played on a piano or accordion, with and without an electric bass as a masker, accompanied by a basic drum rhythm. Bayesian logistic mixed-effects models were utilized to analyze the data. Results: The introduction of an electric bass as a masker did not significantly affect MCI performance for any hearing group when melodies were played on the piano, contrary to its effect on accordion melodies and previous studies. Greater challenges were observed with accordion melodies, especially when accompanied by an electric bass. Conclusions: MCI performance among hearing aid users was comparable to other hearing-impaired profiles, challenging the hypothesis that they would outperform cochlear implant users. A cohort of short melodies inspired by Western music styles was developed for future contour identification tasks. Full article

Humming is probably more effective than speech for improving mothers’ cardiorespiratory function and infants’ self-regulation. We intend to understand the effects of (1) maternal humming vs. speech on preterm infants’ physiological parameters, (2) maternal humming vs. speech on mothers’ physiological parameters, and (3) humming melodic contours and the process of the lengthening of the final note on preterm infants’ physiological parameters. This study was designed as a single-group repeated measures study, using microanalytical methodology (ELAN software version 4.9.4), with a protocol (silent baseline/speech, humming/silence/humming, or speech/silence) applied to preterm dyads (N = 36). Audio and video observations were recorded. Infants’ and mothers’ heart rates (HR) and O₂ saturations were observed once a minute. The proportion of O₂ saturation relative to HR (Prop. O₂ saturation/HR) was estimated for both partners during the protocol. We found that the infants’ HR mean was significantly lower during humming (p = 0.028), while a significantly higher Prop. O₂ saturation/HR ratio was recorded during humming for infants (p = 0.027) and mothers (p = 0.029). The duration of sinusoidal contours, together with the lengthening of the final note, predicts infants’ Prop. O₂ saturation/HR ratio. Musical features of humming seem to improve the physiological stability of preterm infants during kangaroo care. Full article

The music-based attention assessment (MAA) is a melody contour identification task that evaluates different types of attention. Previous studies have examined the psychometric and physiological validity of the MAA across various age groups in clinical and typical populations. The purpose of this study was to confirm the MAA’s criterion validity in individuals with traumatic brain injury (TBI) and to correlate this with standardized neuropsychological measurements. The MAA and various neurocognitive tests (i.e., the Wechsler adult intelligence scale DST, Delis–Kaplan executive functioning scale color-word interference test, and Conner’s continuous performance test) were administered to 38 patients within two weeks prior to or post to the MAA administration. Significant correlations between MAA and neurocognitive batteries were found, indicating the potential of MAA as a valid measure of different types of attention deficits. An additional multiple regression analysis revealed that MAA was a significant factor in predicting attention ability. Full article

The literature reports the benefits of multimodal interaction with the maternal voice for preterm dyads in kangaroo care. Little is known about multimodal interaction and vocal modulation between preterm mother–twin dyads. This study aims to deepen the knowledge about multimodal interaction (maternal touch, mother’s and infants’ vocalizations and infants’ gaze) between a mother and her twin preterm infants (twin 1 [female] and twin 2 [male]) during speech and humming in kangaroo care. A microanalytical case study was carried out using ELAN, PRAAT, and MAXQDA software (Version R20.4.0). Descriptive and comparative analysis was performed using SPSS software (Version V27). We observed: (1) significantly longer humming phrases to twin 2 than to twin 1 (p = 0.002), (2) significantly longer instances of maternal touch in humming than in speech to twin 1 (p = 0.000), (3) a significant increase in the pitch of maternal speech after twin 2 gazed (p = 0.002), and (4) a significant increase of pitch in humming after twin 1 vocalized (p = 0.026). This exploratory study contributes to questioning the role of maternal touch during humming in kangaroo care, as well as the mediating role of the infant’s gender and visual and vocal behavior in the tonal change of humming or speech. Full article

Tonal languages make use of pitch variation for distinguishing lexical semantics, and their melodic richness seems comparable to that of music. The present study investigated a novel priming effect of melody on the pitch processing of Mandarin speech. When a spoken Mandarin utterance is preceded by a musical melody, which mimics the melody of the utterance, the listener is likely to perceive this utterance as song. We used functional magnetic resonance imaging to examine the neural substrates of this speech-to-song transformation. Pitch contours of spoken utterances were modified so that these utterances can be perceived as either speech or song. When modified speech (target) was preceded by a musical melody (prime) that mimics the speech melody, a task of judging the melodic similarity between the target and prime was associated with increased activity in the inferior frontal gyrus (IFG) and superior/middle temporal gyrus (STG/MTG) during target perception. We suggest that the pars triangularis of the right IFG may allocate attentional resources to the multi-modal processing of speech melody, and the STG/MTG may integrate the phonological and musical (melodic) information of this stimulus. These results are discussed in relation to subvocal rehearsal, a speech-to-song illusion, and song perception. Full article

Prior to the establishment of the Roman rite with its Gregorian chant, in the Iberian Peninsula and Southern France the Mozarabic rite, with its own tradition of chant, was dominant from the sixth until the eleventh century. Few of these chants are preserved in pitch readable notation and thousands exist only in manuscripts using adiastematic neumes which specify only melodic contour relations and not exact intervals. Though their precise melodies appear to be forever lost it is possible to use computational machine learning and statistical sequence generation methods to produce plausible realizations. Pieces from the León antiphoner, dating from the early tenth century, were encoded into templates then instantiated by sampling from a statistical model trained on pitch-readable Gregorian chants. A concert of ten Mozarabic chant realizations was performed at a music festival in the Netherlands. This study shows that it is possible to construct realizations for incomplete ancient cultural remnants using only partial information compiled into templates, combined with statistical models learned from extant pieces to fill the templates. Full article

A key for earcon design in public environments is to incorporate an individual’s perceived level of cognitive load for better communication. This study aimed to examine the cognitive load changes required to perform a melodic contour identification task (CIT). While healthy college students (N = 16) were presented with five CITs, behavioral (reaction time and accuracy) and cerebral hemodynamic responses were measured using functional near-infrared spectroscopy. Our behavioral findings showed a gradual increase in cognitive load from CIT1 to CIT3 followed by an abrupt increase between CIT4 (i.e., listening to two concurrent melodic contours in an alternating manner and identifying the direction of the target contour, p < 0.001) and CIT5 (i.e., listening to two concurrent melodic contours in a divided manner and identifying the directions of both contours, p < 0.001). Cerebral hemodynamic responses showed a congruent trend with behavioral findings. Specific to the frontopolar area (Brodmann’s area 10), oxygenated hemoglobin increased significantly between CIT4 and CIT5 (p < 0.05) while the level of deoxygenated hemoglobin decreased. Altogether, the findings indicate that the cognitive threshold for young adults (CIT5) and appropriate tuning of the relationship between timbre and pitch contour can lower the perceived cognitive load and, thus, can be an effective design strategy for earcon in a public environment. Full article

In this paper, we report on a free-hand motion capture study in which 32 participants ‘traced’ 16 melodic vocal phrases with their hands in the air in two experimental conditions. Melodic contours are often thought of as correlated with vertical movement (up and down) in time, and this was also our initial expectation. We did find an arch shape for most of the tracings, although this did not correspond directly to the melodic contours. Furthermore, representation of pitch in the vertical dimension was but one of a diverse range of movement strategies used to trace the melodies. Six different mapping strategies were observed, and these strategies have been quantified and statistically tested. The conclusion is that metaphorical representation is much more common than a ‘graph-like’ rendering for such a melodic sound-tracing task. Other findings include a clear gender difference for some of the tracing strategies and an unexpected representation of melodies in terms of a small object for some of the Hindustani music examples. The data also show a tendency of participants moving within a shared ‘social box’. Full article