Categories
Auditory Cortex EEG / MEG Evoked Activity Linguistics Papers Publications

New Paper out: HELLO? in press (Neu­roIm­age)

Pho­net­ic cues instan­ta­neous­ly mapped onto dialec­tal cat­e­gories appear to be extract­ed at ear­ly moments in audi­to­ry speech per­cep­tion, as we try to show in our paper

You had me at “Hel­lo”: Rapid extrac­tion of dialect infor­ma­tion from spo­ken words

to appear in Neu­roIm­age (Math­ias Scharinger, Philip Mon­a­han, William Idsardi).

In a mod­i­fied pas­sive odd­ball design, we com­pare the Mis­match Neg­a­tiv­i­ty (MMN) to deviants in one Amer­i­can Eng­lish dialect (Stan­dard Amer­i­can Eng­lish or African-Amer­i­can Ver­nac­u­lar Eng­lish) to the stan­dards of the respec­tive oth­er dialect. In a con­trol con­di­tion, deviants with­in the same dialects have the same aver­aged acoustic dis­tance to their stan­dards than the cross-dialec­tal aver­aged acoustic dis­tance. Stan­dards and deviants were always spo­ken exem­plars of ‘Hel­lo’ in both dialects (ca. 500 ms). MMN effects are sig­nif­i­cant in the cross-dialec­tal con­di­tion only, imply­ing that a pure acoustic stan­dard-deviant dis­tance is not suf­fi­cient to elic­it sub­stan­tial mis­match effects. We inter­pret these find­ings, togeth­er with N1m source local­iza­tion data, as evi­dence for a rapid extrac­tion of dialect infor­ma­tion via salient acoustic-pho­net­ic cues. From the loca­tion and ori­en­ta­tion of the N1m source activ­i­ty, we can infer that dialect switch­es from stan­dards to deviants engage areas in supe­ri­or tem­po­ral sulcus/gyrus.

Ref­er­ences

  • Scharinger M, Mon­a­han PJ, Idsar­di WJ. You had me at “Hel­lo”: Rapid extrac­tion of dialect infor­ma­tion from spo­ken words. Neu­roim­age. 2011 Jun 15;56(4):2329–38. PMID: 21511041. [Open with Read]
Categories
Auditory Cortex EEG / MEG Evoked Activity Papers Place of Articulation Features Publications

New Paper out: Com­pre­hen­sive map of a language’s vow­el space

We are glad to announce that our paper (Math­ias Scharinger, Saman­tha Poe, & William Idsar­di) on cor­ti­cal rep­re­sen­ta­tions of Turk­ish vow­els is in press in Jour­nal of Cog­ni­tive Neu­ro­science. In this paper, we extend pre­vi­ous meth­ods of obtain­ing cen­ters of cor­ti­cal activ­i­ty evoked by vow­el exem­plars (e.g. Obleser et al., 2003, on Ger­man) and pro­vide an N1m ECD (Equiv­a­lent Cur­rent Dipole) map of the entire vow­el space of Turk­ish. Intrigu­ing­ly, ECD loca­tions mapped near­ly per­fect to loca­tions in F2/F1 space, although our mod­el com­par­i­son sug­gest­ed that inclu­sion of dis­crete fea­ture based pre­dic­tors for both loca­tions as well as col­lo­ca­tions of vow­els in audi­to­ry cor­tex improves the mod­el fits sub­stan­tial­ly. We dis­cuss the find­ings on the back­ground of neur­al cod­ing schemes for speech-relat­ed audi­to­ry categories.

Fig­ure 1: Loca­tions of Turk­ish vow­el stim­uli in acoustic space (F1,F2, top pan­el) and N1m ECD loca­tions in cor­ti­cal space (lat­er­al-medi­al/an­te­ri­or-pos­te­ri­or/in­fe­ri­or-supe­ri­or, bot­tom panel).

UPDATE: Paper is avail­able here.

Ref­er­ences

  • Scharinger M, Idsar­di WJ, Poe S. A com­pre­hen­sive three-dimen­sion­al cor­ti­cal map of vow­el space. J Cogn Neu­rosci. 2011 Dec;23(12):3972–82. PMID: 21568638. [Open with Read]
Categories
Auditory Cortex Auditory Neuroscience Auditory Working Memory Clinical relevance EEG / MEG Neural Oscillations Papers Publications Speech

New paper out: Alpha oscil­la­tions in audition

I am also delight­ed to report the fruits of a very recent col­lab­o­ra­tion with Nathan Weisz and his OBOB lab at the Uni­ver­si­ty of Kon­stanz, Germany.

Alpha Rhythms in Audi­tion: Cog­ni­tive and Clin­i­cal Perspectives

In this review paper, which appears in the new, excit­ing “Fron­tiers in Psy­chol­o­gy” jour­nal, we sum the recent evi­dence that alpha oscil­la­tions (here broad­ly defined from 6 to 13 Hz) are play­ing a very inter­est­ing role in the audi­to­ry sys­tem, just as they do in the visu­al and the somatosen­so­ry system.

In essence, we back Ole Jensen’s and oth­ers’ quite pari­mo­nious idea of alpha as a func­tion­al inhi­bi­tion / gat­ing sys­tem across cor­ti­cal areas.

From our own lab, pre­lim­i­nary data from two recent exper­i­ments is includ­ed: On the role of alpha osil­la­tions as a poten­tial mark­er for speech intel­li­gi­bil­i­ty and its acoustic deter­mi­nants, as well as on speech degra­da­tion and work­ing mem­o­ry load and their com­bined reflec­tion in alpha pow­er increases.

 

NB — the final pdf is still lack­ing, and Front Psy­chol is still not list­ed in PubMed. This should not stop you from sub­mit­ting to their excit­ing new jour­nals, as the review process is very fair and effi­cient and the out­reach via free avail­abil­i­ty promis­es to be considerable.

Ref­er­ences

  • Weisz N, Hart­mann T, Müller N, Lorenz I, Obleser J. Alpha rhythms in audi­tion: cog­ni­tive and clin­i­cal per­spec­tives. Front Psy­chol. 2011 Apr 26;2:73. PMID: 21687444. [Open with Read]
Categories
Auditory Neuroscience Auditory Perception fMRI Linguistics Papers Publications Speech

New paper out: “Upstream del­e­ga­tion” for pro­cess­ing of com­plex syn­tax under degrad­ed acoustics

A new paper is about to appear in Neu­roim­age on the inter­ac­tion of syn­tac­tic com­plex­i­ty and acoustic degradation.

It is writ­ten by myself, PhD stu­dent Lars Mey­er, and Angela Friederi­ci. In a way, the paper brings togeth­er one of Angela’s main research ques­tions (which brain cir­cuits medi­ate the pro­cess­ing of syn­tax?) with a long-stand­ing inter­est of mine, that is, how do adverse lis­ten­ing sit­u­a­tions affect the com­pre­hen­sion of speech.

The paper is entitled

Dynam­ic assign­ment of neur­al resources in audi­to­ry com­pre­hen­sion of com­plex sentences

The paper first estab­lish­es that acoustic vari­ants of increas­ing­ly com­plex sen­tences essen­tial­ly behave like writ­ten ver­sions of these sentences.
The data then neat­ly show that pro­cess­ing chal­leng­ing (but legal) syn­tax under var­i­ous lev­els of degra­da­tion has a very dif­fer­ent effect on the neur­al cir­cuits involved than prof­it­ing from seman­tics: While the lat­ter has been shown pre­vi­ous­ly to involve more wide­spread, het­ero­modal brain areas, the dou­ble demand of increas­ing­ly com­plex syn­tax and an increas­ing­ly degrad­ed speech sig­nal (from which the com­plex syn­tax has to be parsed) elic­it an “upstream” shift of acti­va­tion back to less abstract pro­cess­ing areas in the supe­ri­or tem­po­ral and prefrontal/frontal cortex.

We ten­ta­tive­ly have termed this process “upstream del­e­ga­tion”. We have also tried and estab­lished a slight­ly unusu­al method to do jus­tice to the fMRI acti­va­tion data: We have includ­ed all z‑scores gath­ered along cer­tain spa­tial dimen­sions, irre­spec­tive of whether they were sub- or suprathresh­old, and have treat­ed them as dis­tri­b­u­tions. Check it out and let us know what you think.

Ref­er­ences

  • Obleser J, Mey­er L, Friederi­ci AD. Dynam­ic assign­ment of neur­al resources in audi­to­ry com­pre­hen­sion of com­plex sen­tences. Neu­roim­age. 2011 Jun 15;56(4):2310–20. PMID: 21421059. [Open with Read]
Categories
Auditory Cortex Auditory Speech Processing EEG / MEG Evoked Activity Linguistics Papers Place of Articulation Features Publications

Paper in press: Are labi­als special?

This went online just a day before Christmas:

Neu­ro­mag­net­ic evi­dence for a fea­t­ur­al dis­tinc­tion of Eng­lish con­so­nants: Sen­sor- and source-space data

by Math­ias Scharinger, Jen­nifer Mer­ick­el, Joshua Riley, and William Idsardi
http://dx.doi.org/10.1016/j.bandl.2010.11.002

We want­ed to look at fea­t­ur­al (cat­e­gor­i­cal) place of artic­u­la­tion dis­tinc­tions in Eng­lish con­so­nants, and select­ed labi­al and coro­nal frica­tives and glides for an MMN study. In this study, we looked at sen­sor- and source-space effects of labi­al deviants pre­ced­ed by coro­nal stan­dards and coro­nal deviants pre­ced­ed by labi­al stan­dards, across the two man­ners of artic­u­la­tion, i.e. frica­tives and glides. Note that there are rather dra­mat­ic acoustic dif­fer­ences between these man­ners of artic­u­la­tion: uncor­re­lat­ed noise through nar­row con­stric­tion vs. vow­el-like sound with typ­i­cal res­o­nance fre­quen­cies. We found con­sis­tent place-of-artic­u­la­tion effects, inde­pen­dent of man­ner of artic­u­la­tion: labi­al deviants pro­duced larg­er MMN, con­tra a direc­tion­al hypoth­e­sis of under­spec­i­fi­ca­tion, and dipole source loca­tions fol­lowed the Obleser-gra­di­ent in that labi­als elicit­ed N1m dipoles ante­ri­or to dipoles of coro­nals in audi­to­ry cortex.

Ref­er­ences

  • Scharinger M, Mer­ick­el J, Riley J, Idsar­di WJ. Neu­ro­mag­net­ic evi­dence for a fea­t­ur­al dis­tinc­tion of Eng­lish con­so­nants: sen­sor- and source-space data. Brain Lang. 2011 Feb;116(2):71–82. PMID: 21185073. [Open with Read]
Categories
Auditory Neuroscience Auditory Speech Processing EEG / MEG Linguistics Papers Psychology Publications Speech

New paper out: Are ear­ly N100 and the late Gam­ma-band response neg­a­tive­ly cor­re­lat­ed in com­pre­hen­sion of degrad­ed speech?

Late 2010 was par­tic­u­lar­ly good to us:

Mul­ti­ple brain sig­na­tures of inte­gra­tion in the com­pre­hen­sion of degrad­ed speech

by Jonas Obleser and Son­ja Kotz, in Neu­roIm­age.

The final pdf will hope­ful­ly be avail­able online very soon. Mean­while the fig­ure below cap­tures our main results:

Ref­er­ences

  • Obleser J, Kotz SA. Mul­ti­ple brain sig­na­tures of inte­gra­tion in the com­pre­hen­sion of degrad­ed speech. Neu­roim­age. 2011 Mar 15;55(2):713–23. PMID: 21172443. [Open with Read]
Categories
Auditory Cortex Auditory Neuroscience fMRI Linguistics Papers Publications Speech

New paper out: Pat­terns of vow­el and con­so­nant sensitivity

Dear fol­low­ers of the slow­ly emerg­ing Obleser lab,
I am glad to present to you a new paper that was pub­lished last week:

Seg­re­ga­tion of vow­els and con­so­nants in human audi­to­ry cor­tex: Evi­dence for dis­trib­uted hier­ar­chi­cal orga­ni­za­tion

by Jonas Obleser, Amber Leaver, John Van­Meter, and Josef P. Rauscheck­er, in Fron­tiers in Psy­chol­o­gy. It was sub­mit­ted to the new sec­tion of Audi­to­ry Cog­ni­tive Neu­ro­science and wil be one of the first papers to appear in this section.

The paper present evi­dence from a small-vox­el 3T study we scanned in George­town a few years ago that

  • nat­u­ral­ly coar­tic­u­lat­ed syl­la­bles like /de:/ or /gu:/ con­tain enough infor­ma­tion for a machine learn­ing algo­rithm to tell vow­el cat­e­gories (front vs back) from each oth­er, and also stop con­so­nant cat­e­gories (/d/ vs /g/) – across participants!
  • with a sur­pris­ing­ly sparse over­lap across sub­ar­eas of the supe­ri­or tem­po­ral cor­tex, how­ev­er and
  • data from the left ante­ri­or region of inter­est (defined as left and ante­ri­or of a prob­a­bilis­tic pri­ma­ry audi­to­ry cor­tex def­i­n­i­tion sen­su Rademach­er et al., 2001) appears par­tic­u­lar­ly “geared” towards these speech–from-speech classifications.

The paper was edit­ed by Mic­ah Mur­ray and received very con­struc­tive reviews from Elia Formisano and Lee Miller (a fea­ture of Fron­tiers jour­nals is to dis­close the peer review­ers after accep­tance; nice fea­ture, I think.)

The final pdf is avail­able online now, and it seems that the Pubmed list­ings for the Fron­tiers in psy­chol­o­gy jour­nal are about to hap­pen very soon.

Ref­er­ences

  • Obleser J, Leaver AM, Van­meter J, Rauscheck­er JP. Seg­re­ga­tion of vow­els and con­so­nants in human audi­to­ry cor­tex: evi­dence for dis­trib­uted hier­ar­chi­cal orga­ni­za­tion. Front Psy­chol. 2010 Dec 24;1:232. PMID: 21738513. [Open with Read]
Categories
Auditory Neuroscience Degraded Acoustics Editorial Notes fMRI Linguistics Papers Publications Speech

New arti­cles

May I humbly point you to three new arti­cles I had the hon­our to be involved in recently.

First­ly, Chris Petkov, Nikos Logo­thetis and I have put togeth­er a very broad overview over what we think is the cur­rent take on pro­cess­ing streams of voice, speech and, more gen­er­al­ly, vocal­i­sa­tion input in pri­mates. It appears in THE NEUROSCIENTIST and is aimed at (sic) neu­ro­sci­en­tists who are not in the lan­guage and audi­tion field on an every­day basis. It goes back all the way to Wer­nicke and also owes a lot to the hard work on func­tion­al and anatom­i­cal path­ways in the pri­mate brain by peo­ple like Jon Kaas, Troy Hack­ett, Josef Rauscheck­er, or Jef­frey Schmahmann.

Sec­ond­ly, Angela Friederi­ci, Son­ja A. Kotz, Sophie Scott and myself have a new arti­cle in press in HUMAN BRAIN MAPPING where we have tried and dis­en­tan­gled the gram­mat­i­cal vio­la­tion effects in speech that Angela had observed ear­li­er in the ante­ri­or supe­ri­or tem­po­ral gyrus and the effects of speech intel­li­gi­bil­i­ty Sophie had clear­ly pin­point­ed in the sul­cus just below. When com­bin­ing these two manip­u­la­tions into one exper­i­men­tal frame­work, the results turned out sur­pris­ing­ly clear-cut! Also, an impor­tant find­ing on the side: While the acti­va­tions we observed are of course bilat­er­al, any kind of true inter­ac­tion of gram­mar and intel­li­gi­bil­i­ty were locat­ed in the left hemi­sphere (both in infe­ri­or frontal and in supe­ri­or tem­po­ral areas). Watch out here for the upcom­ing pre-print.

Final­ly, recent data by Son­ja Kotz and I have some­what scru­ti­nised the way I see the the inter­play of the ante­ri­or and pos­te­ri­or STS, as well as the IFG and, impor­tant­ly, the left angu­lar gyrus (see the fig­ure below show­ing the response behav­iour of the left angu­lar gyrus over var­i­ous lev­els of degra­da­tion as well as seman­tic expectan­cy, with pooled data from the cur­rent as well as a pre­vi­ous study in J Neu­rosci by Obleser et al., 2007). These data, on a fine-tuned cloze-prob­a­bil­i­ty manip­u­la­tion to sen­tences of vary­ing degra­da­tion are avail­able now in CEREBRAL CORTEX. Thanks for you inter­est, and let me know what you think.

 

Ref­er­ences

  • Petkov CI, Logo­thetis NK, Obleser J. Where are the human speech and voice regions, and do oth­er ani­mals have any­thing like them? Neu­ro­sci­en­tist. 2009 Oct;15(5):419–29. PMID: 19516047. [Open with Read]
  • Friederi­ci AD, Kotz SA, Scott SK, Obleser J. Dis­en­tan­gling syn­tax and intel­li­gi­bil­i­ty in audi­to­ry lan­guage com­pre­hen­sion. Hum Brain Mapp. 2010 Mar;31(3):448–57. PMID: 19718654. [Open with Read]
  • Obleser J, Kotz SA. Expectan­cy con­straints in degrad­ed speech mod­u­late the lan­guage com­pre­hen­sion net­work. Cereb Cor­tex. 2010 Mar;20(3):633–40. PMID: 19561061. [Open with Read]