A general, flexible decision model, applied to visual search

2
BioMed Central Page 1 of 2 (page number not for citation purposes) BMC Neuroscience Open Access Poster presentation A general, flexible decision model, applied to visual search Nick Bentley* and Emilio Salinas Address: Department of Neurobiology and Anatomy, Wake Forest University School of Medicine, Winston Salem, NC 27157-1010, USA Email: Nick Bentley* - [email protected] * Corresponding author To survive, an organism must pursue multiple goals and switch between them at appropriate times. Generating such behavioral flexibility is an extremely important brain function, yet little is known about how a network of neu- rons can pursue different goals at different times. A net- work's behavior can only change with an organism's goals if it receives information about those goals as input. Thus, network responses must depend jointly on both current stimuli and current goals. How are these sources of infor- mation combined to generate behavior? And, given those combinations, how can different decision criteria be implemented depending on the task at hand? Here we present a plausible network model for visual search that exhibits different decision criteria depending on the current goal. The network accurately performs sev- eral different search tasks based on the same stimulus set, and is capable of switching between tasks without retrain- ing. The model consists of three layers, each directly inspired by cortical neurobiology: (1) A layer of input or sensory neurons whose responses to stimuli are gain-modulated depending on current goals. Such gain modulation implies that sensory and goal-dependent information are combined nonlinearly, as documented in various experi- ments, but the exact form of this nonlinearity is not cru- cial. (2) A randomly connected layer of non-linear neurons that acts as a reservoir computer. As in a liquid- state machine, this layer is capable of generating widely different response patterns. (3) A standard race-to-thresh- old decision model containing two competing neural populations. These are used to indicate the system's deci- sion, whether a target is present or absent in the display, depending on which population reaches a threshold first. We illustrate the model's performance in a series of visual search tasks for which human behavioral data are availa- ble. We show that a single fixed network can perform all of these tasks correctly, qualitatively reproducing eight sets of experimental observations: 1. Variations in reaction times due to the number of dis- played distractors (set size effects). 2. Differences in reaction times between conjunction and single-feature (or pop-out) searches. 3. Differences in reaction times between target-absent and target-present displays. 4. Reaction-time dependencies on the similarity between distractors and targets. 5. Search asymmetries; that is, differences in reaction-time curves when target and distractor objects are exchanged. 6. The redundant targets effect; that is, decreased reaction times as the number of targets present increases. 7. The ability to perform both singleton search (search for an object that stands out in some way) and directed-object search (search for a specific object). from Sixteenth Annual Computational Neuroscience Meeting: CNS*2007 Toronto, Canada. 7–12 July 2007 Published: 6 July 2007 BMC Neuroscience 2007, 8(Suppl 2):P30 doi:10.1186/1471-2202-8-S2-P30 <supplement> <title> <p>Sixteenth Annual Computational Neuroscience Meeting: CNS*2007</p> </title> <editor>William R Holmes</editor> <note>Meeting abstracts – A single PDF containing all abstracts in this Supplement is available <a href="http:www.biomedcentral.com/content/pdf/1471-2202-8-S2-full.pdf">here</a></note> <url>http://www.biomedcentral.com/content/pdf/1471-2202-8-S2-info.pdf</url> </supplement> © 2007 Bentley and Salinas; licensee BioMed Central Ltd.

Transcript of A general, flexible decision model, applied to visual search

Page 1: A general, flexible decision model, applied to visual search

BioMed CentralBMC Neuroscience

ss

Open AccePoster presentationA general, flexible decision model, applied to visual searchNick Bentley* and Emilio Salinas

Address: Department of Neurobiology and Anatomy, Wake Forest University School of Medicine, Winston Salem, NC 27157-1010, USA

Email: Nick Bentley* - [email protected]

* Corresponding author

To survive, an organism must pursue multiple goals andswitch between them at appropriate times. Generatingsuch behavioral flexibility is an extremely important brainfunction, yet little is known about how a network of neu-rons can pursue different goals at different times. A net-work's behavior can only change with an organism's goalsif it receives information about those goals as input. Thus,network responses must depend jointly on both currentstimuli and current goals. How are these sources of infor-mation combined to generate behavior? And, given thosecombinations, how can different decision criteria beimplemented depending on the task at hand?

Here we present a plausible network model for visualsearch that exhibits different decision criteria dependingon the current goal. The network accurately performs sev-eral different search tasks based on the same stimulus set,and is capable of switching between tasks without retrain-ing.

The model consists of three layers, each directly inspiredby cortical neurobiology: (1) A layer of input or sensoryneurons whose responses to stimuli are gain-modulateddepending on current goals. Such gain modulationimplies that sensory and goal-dependent information arecombined nonlinearly, as documented in various experi-ments, but the exact form of this nonlinearity is not cru-cial. (2) A randomly connected layer of non-linearneurons that acts as a reservoir computer. As in a liquid-state machine, this layer is capable of generating widelydifferent response patterns. (3) A standard race-to-thresh-old decision model containing two competing neural

populations. These are used to indicate the system's deci-sion, whether a target is present or absent in the display,depending on which population reaches a threshold first.

We illustrate the model's performance in a series of visualsearch tasks for which human behavioral data are availa-ble. We show that a single fixed network can perform allof these tasks correctly, qualitatively reproducing eightsets of experimental observations:

1. Variations in reaction times due to the number of dis-played distractors (set size effects).

2. Differences in reaction times between conjunction andsingle-feature (or pop-out) searches.

3. Differences in reaction times between target-absent andtarget-present displays.

4. Reaction-time dependencies on the similarity betweendistractors and targets.

5. Search asymmetries; that is, differences in reaction-timecurves when target and distractor objects are exchanged.

6. The redundant targets effect; that is, decreased reactiontimes as the number of targets present increases.

7. The ability to perform both singleton search (search foran object that stands out in some way) and directed-objectsearch (search for a specific object).

from Sixteenth Annual Computational Neuroscience Meeting: CNS*2007Toronto, Canada. 7–12 July 2007

Published: 6 July 2007

BMC Neuroscience 2007, 8(Suppl 2):P30 doi:10.1186/1471-2202-8-S2-P30

<supplement> <title> <p>Sixteenth Annual Computational Neuroscience Meeting: CNS*2007</p> </title> <editor>William R Holmes</editor> <note>Meeting abstracts – A single PDF containing all abstracts in this Supplement is available <a href="http:www.biomedcentral.com/content/pdf/1471-2202-8-S2-full.pdf">here</a></note> <url>http://www.biomedcentral.com/content/pdf/1471-2202-8-S2-info.pdf</url> </supplement>

© 2007 Bentley and Salinas; licensee BioMed Central Ltd.

Page 1 of 2(page number not for citation purposes)

Page 2: A general, flexible decision model, applied to visual search

BMC Neuroscience 2007, 8(Suppl 2):P30

Publish with BioMed Central and every scientist can read your work free of charge

"BioMed Central will be the most significant development for disseminating the results of biomedical research in our lifetime."

Sir Paul Nurse, Cancer Research UK

Your research papers will be:

available free of charge to the entire biomedical community

peer reviewed and published immediately upon acceptance

cited in PubMed and archived on PubMed Central

yours — you keep the copyright

Submit your manuscript here:http://www.biomedcentral.com/info/publishing_adv.asp

BioMedcentral

8. Similar reaction-time curves for search in standard,static displays and in dynamic displays, in which the posi-tions of all objects change randomly with a certain fre-quency.

The last point is particularly significant because othermodels predict large differences in reaction times betweenstatic and dynamic conditions, whereas ours does not. Wealso show that the model is robust to noise, and can per-form either with perfect accuracy or exhibit behaviorallyrealistic error rates, depending on noise and trainingparameters.

Our model demonstrates that three key properties of cor-tical neurons – gain-modulation, recurrent connectivity,and race-to-threshold dynamics – can be combined togenerate a powerful and flexible decision-making model.We suggest that these features, which are successful at rep-licating many aspects of visual search, may be combinedin a similar manner to generate goal-dependent decisionsin many other circumstances.

Page 2 of 2(page number not for citation purposes)