GYOBA  Jiro

HIDAKA  Souta

KAWACHI  Yousuke

SAKUTA  Yuiko

SHIGETA  Remi

HIDAKA, Souta

SHIGETA, Remi

KAWACHI, Yousuke

SAKUTA, Yuiko

GYOBA, Jiro

Institutional Repositories DataBase (IRDB)

Speed and Consistency of Sound-Color Association in a Colored-Hearing Test

紀要類(bulletin)departmental bulletin pape

Tohoku University Repository (TOUR) / 東北大学機関リポジトリ

Speed and Consistency of Sound-ColorAssociation in a Colored-Hearing Test著者 HIDAKA  Souta, SHIGETA  Remi, KAWACHI Yousuke, SAKUTA  Yuiko, GYOBA  Jirojournal orpublication titleTohoku psychologica foliavolume 66page range 68-74year 2008-03-31URL http://hdl.handle.net/10097/54692rllohoku t'syt,,Ill,1°gJt･,iL F｡liil2007, 66, 68-74Speed and Consistency of Sound-Color Associationin a Colored-Hearing Testso.Tr,､A HIDAKA (日高聡太)I, REMI SHICETA (重田礼美)I,(Tohoku Um'uefSilr) (Tohoku Uru'uer･sity)Y(,.刷KE KAWACHI (河地庸介)I, YuIKL, SAKUTrA (作田由衣子)2,(T｡hoku Um'uersily) (Waseda Um'per･sily)and JIR｡ GYOBA (行場次朗)( Tohoku Um'uer.S･ily)Sy.leSthcsia is the plle-10menO,l i-l Which the, stiml,lati…1 0f m.･,的nSOry rr-lalily msJts ill Percent,(m inanother modality, namely, ll.IStimulaLcd modality･ Colored hearlng lS a SyneSthesia i.I Which sound stimulali｡Ilin血ces visllal co一or percept10n･ The cllrrOl.t res(,arch investlgated tile SPeed and consisteIICy Or soLInd-colorassoふali｡n ill a COlored-hearing test by llSi.-g a color search Task･ 11110 r《-Its showed that the re嶺(症,Il time (RT)｡f the colored-hcarmg group was faster LIMA that or the control group･ We also fouml that th colors sclc.I,teJJ hythe colored-heanng group W｡,mJ more COnSistent tl.a.. those selecLcd by the control group･ These nndi..gs suggcstcdthat il. colored-he,arms SyneSthetes. automatic, and剛.Gist.mt sound-color ass"iatitm oc-･s in the pemep1-I stage｡rpr｡cesslrlg･Key words: ｡,01,m,d-hearmg, color sear.･Jh task, rca.I,tion limc, number of selcctcJ "lors, amow.I ofinrormationIntroductionSy.leSthesia is the pher10.-lerlOn in which the stimulatioll Of olle SeIISOlY mOdality causesperception ill another m｡dality, Ilamely河Ie u,IStimulated modality (Ramachalldran 氏 Hubbard,2003). Most people can linguistically express a multimodal sensatioII Such as "red is a wa-color･" synesthesia is disti.lguishable from such ordinary mediated ass"iations becausesynestheteS experience multimodal sensations as real percepts (Cytowic & Wood, 1 982a)･Colored hearlllg lS a Cross-modal synesthetic perceptl｡n ill Which sound stimuli ir-dl⊥Ce Visualcolor perception. Marks (1 975) reponed tllat COlored-lleari,lg SyneSthetes col･ld perceive a varietyor colors with the physical transitions of tone or pitch･ Cytowic and Wood (1982b) also found thatsylleSthetes exhibit highly consisteilt aSSmiations between sounds and colors as Compared topeople without colored hearlng･I Dcparlmnt ｡f● Psy{hology, GradL･ilte S｡,r100I or Arls皿l I,ellers, rllo]10kll Univers.ty, 27工Kawau｡Jhi, A･,ha-kl.,sendai 980-8576, Japam Email‥ hidaka@saLt(,｢…ku･ac･jp2　Faculty or Human S｡,cll(杓WilSeda Univers･ly, Mikajima 2-579-15, Tokorozawa, 359-1 192. Japa･1SPFll.ED AND (】ONSISTF.N(lY OF SOUND-(】OLOR ASSO(】lArIlJ()N LN A COS.OREl)-HHARING rllF.ST　　69Crapheme-Color synesthesia is a sylleSthesia in which graphemes such as letters or numbersymbols induce color per{℃pt10m･ It was reported that grapheme-Color synesthetes couldimmediately detect a target letter什om among distractors in a visual search task hy uslngsylleSthetic colors as ``pop out''cues (Laeng, Sva的al, 皮 Oelmann, 2004; Palmeri, Blake, Marois,Flame.Y, a Whetsell, 2002)I Hubbard, Arman, Ramachandran, and Bonyton (2005) found thatgrapheme-color synestlleth perceptlOn COuld aid in texture segregation perfo-aTICe and reducethe e鵬ct ｡f cr｡wding･ In additiom mey reponed that synesthetes with better pe晶rmance ｡nthese behavior tasks showed greater brain activity ill early visual areas (Vl, V2, V3, and hV4).TlleSe mdings irldicated that grapheme-color perceptlOn Occurs in the perceptlIal, relatively earlystage ｡f processing (Hubbard 皮 Ramachandran, 2005)･Compared to the llumber or studies or- grapheme-color sylleSthesia, there are fewpsychophysical studies on colored-hearlng SyneSthesia･ In Order to investlgate Whether colored-hearmg synesthetic perceptl｡n Occurs in the perceptual stage of processlng, the currellt researchinvestigated the Speed or sound-Color association in colored hearing by using reaction time (RT)as an index･ It could be assumed that colored-hearmg sylleSthetic seIISation occurs as a realperce叫whereas the association between colors alld soullds are cognltlVe Or Con(℃ptl⊥al fbr peoplewithout colored hearing (Cytowic 皮 Wood, 1 9821))･ Therefbre, we predicted that colored-hearillgMsynesthetes would perceive pop-｡ut''C｡1°rs iIIVOked by sou,lds ill a COlor search task so that theirRTs would he faster than those of non-synesthetes･ We also investlgated the consistency ofsound-Color association in colored hearlng by usmg the number of selected colors and the amountor infbrmatioll Of sound fb∫ color as indices.MethodPartlCIPant･1･In order to recru.t particIPantS With colored hearlng, We distributed a questionnaire to 151students of Tohoku Urliversity (70 males and 81 females)I The questionnaire comprised 16 items:10 were used in Ulich (1957) and 6 Were originally created based on the mdings ｡f Mills, Boteler,and Larcombe (2003)･ Representative examples of our items are as fbllows: "D(, you experieIICeseelng COlors when you hear soullds or music?''and ``Do you imaglne COlors when you hearsounds or musi詰'The particIPantS Were asked to rate each item by uslng a fIve-polnt S｡,ale. Basedon the ratiT,g Scores, We Clas誼ed 1;うpeople (宣bur males alld llil,e ‰Ilales) as ``Colored-hearillgsynesthetes," 36 people (14 males and 22 females) as "moderate colored-hearing synesthetes:Iand 1 02 people as "non-Synesthete,S･ " In the experiment. C,ighl people (two males and six femles)were particIPantS Or the "colored-hearmg group･ " Two or them were colored-hearmg sync,sthetesand six were moderate colored-hearing synesthetes･ Ten nob-synesth,tes (flour males and sixfemales) were control group participants. All the participants had normal or correcte,a-toT10malvision and normal hearlng･ Funher, We conHmed that they had normal color vision by thelshihara color blindness test.ApparatusThe stimllli were presented oil a CRT display (Mitsuhishi, Diamorld M2, 17 inches) with a70 IIidaka, S･, Shigcta, R･, Kawachi, Y･, Sakuta, Y･ a,ld Gv.血, ･TTable 1 Hues, thr｡matic coordinates, and luminancc values of color stimuli used in the present stu.lyChromatic coordinatesx-axis Y-axis LumillanCe (｡d I m2)BlueBrownGlaucousGreenOliveOral-gePinkPurpleRed pLlPleRedW hiteY ell｡W0.19　　　　　　0.19○○　oO O　イ1　3　イl　/0　7　0　5一2　2　4　5　4　3　4　5　3　40　0　0　0　0　0　0　0　0　000　0　2　3　/0　/4　0　∠U　2　003　5　5　/4　3　2　3　3　3　/40　0　0　0　0　0　0　0　0　012.367.5221.3729.2446.3243.7246.95ll.1814.9521.80112.8073.15resolution of 1280 × 1024 pixels and a refresh rate of 70 Hz･ A customized PC (Dell Dimension8250) with E-prime (Psychology So丑ware Tools, lnc･) was used to colltrOl the experiment･ ThepaniclpalltS held their heads oI- a Chin rest･ Two speakers were nxed on either side of the display･Stimulisounds. Seven single pitches of` piano tones (C, D, B, F, G, A, and B) created by the PCs誼ware were used as sound stimuli. The duration of each s｡urld was 1000 ms･ The soundpressure of each sound was approximately 50 dB･colors. We choose 12 colors仕om the MllnSell color system inclllding those reponed assynesthetic colors in grapheme-color synesthesia (Mills et al･, 2003; Laeng et al･, 2004)･ Hues･.hromatic coordinates, and luminance vallleS Of the color stimuli are shown in Table L Eachcolor stimulus (0.65 × 0.65 dog) was presented as a matrix of3 × 4 with agap ofO･4 deg･ Thevisual angle of the color matrix was within 5 dog because it was repohed that synesthetic colorperception does not usually occur in peripheral vision (Laeng et alっ2004)･ The observationdistance was 114.6 cm.1}ocedureEach trial began with the presentation of a white circle (0･5 dog) at the center of the display･Tlle PaniclpantS Were asked to move the mouse cursor to the center oil the circle and press tlle聞mouse buttoll. A範r 1000 ms, a matrix of 12 color stimllli was presented･ The position of eachcolor stimulus was randomized in each trial･ Followed hy a 1000-ms interval, one of the sevensound stimuli was presented･ The sound stimulus was randomly selected in each trial andspEED AND CONSJSrll上二NCY OF SOUNI)_Co一,OR ASSOCIATION IN A COL.ORED-IIEARJNC rIIES"11　7lcounterbalamed across trials･ The particIPantS localized the mouse cllrSOr On One Of the colorstimuli that they perceived as being associated w血the sound stimulus, and pressed the軸m(,usebutton･ They were asked to make their resp0-1SeS aS Soon aS pOSSible･ The s｡ulld stimulus waspresented repeatedly until the button was pressed･ The interval between the initial onset of thesound stimulus and the press OII the button was recorded as the RT･ The selected color was alsorecorded.　　　　~T1-e experiment comprised 280 trials (sounds (7) × repetitioIIS (40))〟 1II Order t｡ attenuatethe selection bias of the paniclpantS, the experimerlt COnSisted of two day sessions･ The intervalsbetwee''the sessions ranged五〇m鯖ve to sevell days･ Ill each sessi0.,, tlle pa高cIPantS COnducted10 practice arld 1 40 main trials㍉he main trials were divided into two paれs with a 5-minute breakbetween the pa叶s.Results ,ReOction timeWe analyzed the RTs within ± 2 SDs品,m the mean f♭r each panicIPant･ The lnean RTin the color search task tor the colored-hearlng group Was 21 22 ms and that for the control groupwas 3248 ms (Figure 1 )･ A two-tailed t-test revealed a significant dit'feremJe in RT between the twogroups (t(16) -　-2･15,p < ･05)INumber of selected ,,I,,I,,rs and amount ,,f irformalior･we calculated the number of selec,te,d colors for each sound stimulus. The mean number ofcolors selected hy the colored-hearlrlg group Was 2･71 and the mean number ｡f colors selected hythe Control group was 4･43 (Figure 2)･ A two-tailed t-test revealed a significant d鵬rence in thenuTnber of selected colors betweell the two groups (t(16)ニー2･93, p < ･01)･ We furthercalculated the amount of infomation of sounds for colors in order to confirm the unirormlty Ofsound-color association･ A greater amount ｡f i1品rmation implies higller unifbrmlty･ Ilhe meanamount of information for the colored-hearmg group was 1 ･85 bits and that for the control groupColored-hearlng ControlGroupFigure l･ R｡,sults ofRT･ The abscissa denotes the type of group, and the ordinate denotes the mean RT･ Errorbars denote me mean standard emor.72 Hidaka, S･, ShigolZ., R･, Kawachi, Y･, Saktlta, Y･ and Gy｡ha‥｢7　　/0　　5　　4　　tJ　　2　　1　　0Colored-hearlng ControlGroupFb'gure 2･ Results o川Ie numb.･,I or selected.I,ol｡rs･ The abs｡issa品川,1°,s the tyr,c of group, a-ld the ordillatederlotes the mean numbt･,I of sclt･,(I,ted colors. Em)I bars denote the meall Standard errors.2.01.51.00.50Col ored-hearlng ControlGroupn'gur｡ 3･ Results or the awol.nt Of informatio.-∫ sounds for colors･ Tr" aL猟･jissa d.mtcs the type or group･arld the ordinate denotes the lllCaTl am｡11m ｡f infbrIllaliorl. Error bars dell｡te the meall Standard crrors.was l･02 bits (Figure 3)･ A two-tailed t-test revealed a sign品ant d雌rence in the amount ofinfomation between the two棟｡uPS (t(16) - Sill, p < ･01)〟DiscussionThe cllrrent reSear(,h psychophysically ir,vestlgated the speed and consistency ｡f color-Solmdassociation in colored hearlng by llSlng a001°r search task･ The results showed that the RT oflhecolored-hearlng group Was faster than that of the control group･ This finding indicates thatcolored-hearing SyneSthetes can immediately perceive pop Out" Colors irlduced by soundllstimulation. In line with the previous findings on graphem-Color synesthesia (HubbarJ aRamachandrall, 2005; Laellg et aL 2004; Palmeri et al･, 2002日he presellt mding implies thatcolored-hearlng SyneSthesia occurs in tlle perCeptual, relatively early stage of processlng･spEED AND CONSISriltlニN(】y Oll SOUND-(TOT,OR ASSOCIATION TN A (】Ol.ORED-IIEARING rIIHSrl1　73We also found that the number of colors selected by the colored-hearmg group was smallertllaI､ that selected by the control grollP･ In addition占he amoullt Of irlfbrmalio,1 Or s｡und誼,一･ co一orfor the colored he,arlng group Was found to he, greater tT.an that for the control group･ From thesefIindings, we con鉦med that colored-hearlllg Sy.leSthetes exhibit higher consislen.,y betweensounds alld colors (Cytowic & Wood, 1982h)･ALlhough the existence of synesthesia has been kIIOWn for approximately 250 years, researchOII SylleStheSia by uslng Objective, experimental methods was rleVer COnducl/ed til一 the 197Os(Harrison & Baron-C｡hell, 1 995)〟 IIl particular, the lnany Chara{加ristics of colored-lleariT-gsy,leSthesia remain lmClear･ Our PTeliminary questiorlnaire su…ey revea一ed that a relatively largepopulation experiences some colored-hearmg synesthetic sensations･ This fact indicated that the,stl⊥dy of colored hearlng Should n｡ longer be limited t｡ the的mework ｡f the case study moth(,d･It was suggested that l10t Only the pitch of sounds hllt also loudlleSS Or tO,le ir-duc° a variety ｡fsynesthetic color perceptions (Marks, 1975; Mills et all, 2003)･ ThuS直れher investigatiomeedsto be conducted on whether synesthetic color perceptlOn invoke,d by loudness or tones also o,･JCurSduring the perceptual stage of processmg･ Recently, an fMRI study demonstrated thatgraphe,-,-｡"lop synestheti｡ PemCPtion activate,d early visual are,as (HLIhhard et all, 2005)I Ourpresent finding suggests lhal similar brain activities might be ol,served fbr colored-llearingpercept10m･ PsychophySICal or ,leur｡physiologlCal s血dies would be useful tt, elucidate thecharacteristics of colored-hearlng SyneSthetic percepl1011･ReferencesCytowi｡. R･ E･, & Wood, F･ B･ (1982a)I Synesthesia T･ A review of major theories and their brainbasis. Brain and a,,gTu'tion, 1, 25-35･Cytowic, Fi･ E･, a Wood, F･ B･ (1982b)I Synesth,sin IL Psychophysical relations in the synesthesiaof geometrically shaped taste and colored hen-g･ Brain and Cl,,gnitim, I, 36-49･Harrison工, 皮 Baron-Cohen, S. (1995). Synaesthesia: RecoIICiling the sllbjective with theobjective･ Endeauour, 19. 157-1 60･Hubbard, H. M., Arman, A, CっRamachalldram V･ S･, 皮 B｡ynton, G･M･ (2005)･ Individualdifferences among graphe,me-Color synesthetes: Baiれ-behavior correlations･ Neurt,n･ 45,975-985.Hubbard, E. M., a Ramachandran, V. S. (2005)I Neurocognitive, mechanisms of synesthesia･1Wuron, 48, 509-520.Laeng, B., Svandal, Fっ& OelrnaI叫H･ (2004)･ Does color synesthesia I,(,se a paradox fl,rearly-selection theories of attention? Psychologi｡･al S,,･ien.･e, 15, 277-281 ･Marks,I. E. (1975). On colored-hearing sy,leSthesia: Cross一m｡(lal traTISl〔ltioIIS (,1● serlS｡rydimensions･型ychological Bulletin, 82, 303-331 iMills, C, B., Boteler, E. H., 皮 Larcombe, C. K. (2003). "Seeing thi･lgS in lrly head": Asynesthete 's images for music and notes･ Per｡･eplm, 32, 1 359-1376･Palmeri, T. ら Blake, RっMarois, R., Flannery, M･A･, 皮 WhetSell, W, Jr･ (2002)〟 rIlhe perceptllalreality of syrleSthetic colors･ Pr,,,,･eedi,～g the Natio,7al A,,･ademy Qf Scien,,･e ,f USA, 99,74 IliJaka, S., ShigcLa, Fi･, Kaw"hi, Y･, SakL･ta. Y･ awl Gyoha, I4127-4131.RamachaI-dram, V. S., 氏 Hubbard,且. M. (2003). Hearing colors, tasting shapes･ Scient.fl,,IAmerican, 288, 52-59.Ulich, H. (1957). Synasthesie ulld Geschlecht･ Zeitschr･ fh'r Ll.perimentell`-I.d AngeLL,ark te華ych(,I(,gie, 4, 31 -57･各エ(Received November 19, 2007)(Accepted Jalluary 23, 2008)

https://tohoku.repo.nii.ac.jp/?action=repository_action_common_download&item_id=1440&item_no=1&attribute_id=18&file_no=1

Speed and Consistency of Sound-Color Association in a Colored-Hearing Test

Abstract

Similar works

Full text

Available Versions

Institutional Repositories DataBase (IRDB)

Tohoku University Repository (TOUR) / 東北大学機関リポジトリ