OALib Journal期刊
ISSN: 2333-9721
费用：99美元

投递稿件

查看量	下载量

相关文章
更多...

PLOS ONE 2009

Extraction of Surface-Related Features in a Recurrent Model of V1-V2 Interactions

DOI: 10.1371/journal.pone.0005909

Ulrich Weidenbacher, Heiko Neumann

Full-Text Cite this paper Add to My Lib

Abstract:

Background Humans can effortlessly segment surfaces and objects from two-dimensional (2D) images that are projections of the 3D world. The projection from 3D to 2D leads partially to occlusions of surfaces depending on their position in depth and on viewpoint. One way for the human visual system to infer monocular depth cues could be to extract and interpret occlusions. It has been suggested that the perception of contour junctions, in particular T-junctions, may be used as cue for occlusion of opaque surfaces. Furthermore, X-junctions could be used to signal occlusion of transparent surfaces. Methodology/Principal Findings In this contribution, we propose a neural model that suggests how surface-related cues for occlusion can be extracted from a 2D luminance image. The approach is based on feedforward and feedback mechanisms found in visual cortical areas V1 and V2. In a first step, contours are completed over time by generating groupings of like-oriented contrasts. Few iterations of feedforward and feedback processing lead to a stable representation of completed contours and at the same time to a suppression of image noise. In a second step, contour junctions are localized and read out from the distributed representation of boundary groupings. Moreover, surface-related junctions are made explicit such that they are evaluated to interact as to generate surface-segmentations in static images. In addition, we compare our extracted junction signals with a standard computer vision approach for junction detection to demonstrate that our approach outperforms simple feedforward computation-based approaches. Conclusions/Significance A model is proposed that uses feedforward and feedback mechanisms to combine contextually relevant features in order to generate consistent boundary groupings of surfaces. Perceptually important junction configurations are robustly extracted from neural representations to signal cues for occlusion and transparency. Unlike previous proposals which treat localized junction configurations as 2D image features, we link them to mechanisms of apparent surface segregation. As a consequence, we demonstrate how junctions can change their perceptual representation depending on the scene context and the spatial configuration of boundary fragments.

References

[1]	Rubin N (2001) The Role of Junctions in Surface Completion and Contour Matching. Perception 30: 339–366.
[2]	Nakayama K, He ZJ, Shimojo S (1995) Visual surface representation: a critical link between lower-level and higher-level vision. In: Kosslyn S, Osherson DN, editors. In:. An invitation to cognitive science. Cambridge: MIT Press. pp. 1–70.
[3]	McDermott J, H. AE (2004) The geometry of the occluding contour and its effect on motion interpretation. Journal of Vision 4: 944–954.
[4]	Harris CJ, Stephens M (1988) A combined corner and edge detector. Proc of the 4th Alvey Vision Conference 147–151.
[5]	Smith S, Brady J (1997) SUSAN: A new approach to low level image processing. International journal of computer vision 23: 45–78.
[6]	Ahissar M, Hochstein S (2002) View from the Top: Hierarchies and Reverse Hierarchies in the Visual System. Neuron 36: 791–804.
[7]	Hubel DH, Wiesel TN (1968) Receptive Fields and Functional Architecture of Monkey Striate Cortex. Journal of Physiology 195: 215–243.
[8]	Heitger F, von der Heydt R, Peterhans E, Kübler O (1998) Simulation of neural contour mechanisms: Representing anomalous contours. Image and Vision Computing 16: 407–421.
[9]	von der Heydt R, Peterhans E, Baumgartner G (1984) Illusory contours and cortical neuron responses. Science 224: 1260–1262.
[10]	von der Heydt R, Heitger F, Peterhans E (1993) Perception of occluding contours: Neural mechanisms and a computational model. Biomed Res 14: 1–6.
[11]	Lamme VAF, Rolfsemma PR (2000) The distinct modes of vision offered by feedforward and recurrent processing. Trends in Neurosciences 23: 571–579.
[12]	Hupé JM, James AC, Payne BR, Lomber SG, Girard P, et al. (1998) Cortical Feedback Improves Discrimination Between Figure and Background by V1, V2 and V3 Neurons. Nature 394: 784–787.
[13]	Hupé JM, James AC, Girard P, Lomber SG, Payne BR, et al. (2001) Feedback connections act on the early part of the responses in monkey visual cortex. Journal of Neurophysiology 85: 134–145.
[14]	Hirsch JA, Gibert CD (1991) Synaptic physiology of horizontal connections in the cat's visual cortex. Journal of Neuroscience 11: 1800–1809.
[15]	Salin PA, Bullier J (1995) Corticocortical connections in the visual system: Structure and function. Physiological Reviews 75: 107–154.
[16]	Sillito AM, Cudeiro J, Jones HE (2006) Always returning: feedback and sensory processing in visual cortex and thalamus. Trends in cognitive sciences 29: 307–316.
[17]	Grossberg S, Mingolla E (1985) Neural Dynamics of Form Perception: Boundary Completion, Illusory Figures and Neon Color Spreading. Psychological Review 92: 173–211.
[18]	Ponce CR, Born RT (2008) Stereopsis. Current Biology 18: R845–R850.
[19]	Sperling G (1970) Model of visual adaptation and contrast detection. Perception and Psychophysic 8: 143–157.
[20]	Heeger DJ (1992) Normalisation of cell responses in cat striate cortex. Visual Neuroscience 9: 181–198.
[21]	Caradini M, Heeger DJ (1994) Summation and Division by neurons in primate visual cortex. Science 264: 1333–1336.
[22]	Tolhurst DJ, Heeger DJ (1997) Comparison of Contrast-normalization and Threshold Models of the Responses of Simple Cells in Cat Striate Cortex. Visual Neuroscience 14: 293–309.
[23]	Gilbert C, Wiesel TN (1989) Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex. Journal of Neuroscience 9: 2432–2442.
[24]	Schmidt KE, Goebel R, L？wel S, Singer W (1997) The perceptual grouping criterion of colinearity is reflected by anisotropies of connections in the primary visual cortex. European Journal of Computational Neuroscience 9: 1083–1089.
[25]	Bosking WH, Zhang Y, Schofield B, Fitzpatrick D (1997) Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. Journal of Neuroscience 17: 2112–2127.
[26]	Hubel D, Wiesel T (1965) Receptive fields and functional architecture of two nonstriate areas (18 and 19) of the cat. Journal of Neurophysiology 28: 229–289.
[27]	DeAngelis GC, Freeman RD, Ohzawa I (1994) Length and width tuning of neurons in the cat's primary visual cortex. Journal of Neurophysiology 71: 347–374.
[28]	Jones HE, L. GK, W. W, A.M. S (2001) Surround Suppression in Primate V1. Journal of Neurophysiology 86: 2011–2028.
[29]	Sceniak MP, Hawken MJ, Shapley R (2001) Visual Spatial Characterization of Macaque V1 Neurons. Journal of Neurophysiology 85: 1873–1887.
[30]	Thielscher A, Neumann H (2008) Globally consistent depth sorting of overlapping 2D surfaces in a model using local recurrent interactions. Biological Cybernetics 98: 305–337.
[31]	von der Heydt R (1984) Illusory contours and cortical neuron responses. Science 224: 1260–1262.
[32]	Ito M, Komatsu H (2004) Representation of Angles Embedded within Contour Stimuli in Area V2 of Macaque Monkeys. Journal of Neuroscience 24: 3313–3324.
[33]	Neumann H, Sepp W (1999) Recurrent V1-V2 interactions in early boundary processing. Biological Cybernetics 81: 425–444.
[34]	Crick F, C. K (1998) Constraints on cortical and thalamic projections: The no-strong-loop hypothesis. Nature 391: 245–250.
[35]	Desimone R, Duncan J (1995) Neural Mechanisms of Selective Visual Attention. Annual Reviews of Neuroscience 18: 193–222.
[36]	Li Z (1999) Pre-Attentive segmentation in the primary visual cortex. Spatial Vision 13: 25–50.
[37]	Zhou H, Friedman HS, von der Heydt R (2000) Coding of Border Ownership in Monkey Visual Cortex. Journal of Neuroscience 20: 6594–6611.
[38]	Zhaoping L (2005) Border Ownership from Intracortical Interactions in Visual Area V2. Neuron 47: 143–153.
[39]	Rubin N (2001) Figure and ground in the brain. Nature Neuroscience 4: 857–858.
[40]	Kanizsa G (1955) Margini quasi-percettivi in campi con stimolazione omogenea. Rivista di Psicologia 49: 7–30.
[41]	Varin D (1971) Fenomeni di contrasto e diffusione cromatica nell' organisatione spaziale del campo percetiivo. Rivista di Psicologia 65: 101–128.
[42]	Schmid C, Mohr R, Bauckhage C (2000) Evaluation of interest point detectors. International journal of computer vision 37: 151–172.
[43]	Koffka K (1935) Principles of gestalt psychology. In: Brace H, editor. New York.
[44]	Shipley TF, Kellman PJ, editors. (2001) Computational Neural Models of Spatial Integration and Perceptual Grouping: Elsevier Science. pp. 353–400.
[45]	Bayerl P, Neumann H (2004) Disambiguating visual motion through contextual feedback modulation. Neural Computation 16: 2041–2066.
[46]	Thielscher A, Neumann H (2005) Neural Mechanisms of Texture Processing: Texture boundary Detection and Visual Search. Spatial Vision 18: 227–257.
[47]	Hamker FH (2005) The emergence of attention by population-based inference and its role in distributed processing and cognitive control of vision. Computer Vision and Image Understanding 100: 64–106.
[48]	Gove A, Grossberg S, Mingolla E (1995) Brightness perception, illusory contours, and corticogeniculate feedback. Visual Neuroscience 12: 1027–1052.
[49]	Eckhorn R, Reitboeck HJ, Arndt M, Dicke P (1990) Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex. Neural Computation 2: 293–307.
[50]	Ross WD (2000) Visual cortical mechanisms of perceptual grouping: Interacting layers, networks, columns, maps. Neural Networks 13: 571–588.
[51]	Peterhans E, von der Heydt R (1989) Mechanisms of contour perception in monkey visual cortex II. Journal of Neuroscience 9: 1749–1763.
[52]	Mundhenk TN, Itti L (2003) A new computational algorithm for the modeling of early visual contour integration in humans. Neurocomputing 52-54: 599–604.
[53]	Baylis G, Driver J (2001) Generalization Over Contrast and Mirror Reversal, But not Figure-Ground Reversal. Nature Neuroscience 4: 937–942.
[54]	Hansen T, Neumann H (2004) Neural Mechanisms for the Robust Representation of Junctions. Neural Computation 16: 1013–1037.
[55]	Kapadia MK, Ito M, Gibert CD, Westheimer G (1995) Improvement in Visual Sensitivity by Changes in Local Context: Parallel Studies in Human Observers and in V1 of Alert Monkeys. Neuron 15: 843–856.
[56]	Field DH, Hayes A, Hess RF (1993) Contour integration by the human visual system: Evidence for a local “association field”. Vision Research 33: 173–193.
[57]	Maffai L, Fiorentini A (1976) The unresponsive regions of visual cortical receptive fields. Vision Research 16: 1131–1139.
[58]	Peterhans E (1997) Functional organization of area V2 in awake monkey. In: Rockland KS, Kaas JH, Peters A, editors. Extrastriate cortex in primates. pp. 335–357.
[59]	Lesher GW, Mingolla E (1993) The role of edges and line-ends in illusory contour formation. Vision Research 33: 2253–2270.
[60]	Kapadia MK, Westheimer G, Gibert CD (1999) Dynamics of spatial summation in primary visual cortex of alert monkeys. Proc Natl Acad Sci USA 96: 12073–12078.
[61]	Knierim JJ, van Essen DC (1992) Neuronal responses to static texture patterns in area V1 of alert macaque monkey. Journal of Neurophysiology 67: 961–980.
[62]	Sillito AM, L. GK, Jones HE, Cudeiro J, Davis J (1995) Visual cortical mechanisms detecting focal orientation discontinuities. Nature 378: 492–496.
[63]	Ts'o DY, Gibert CD, Wiesel TN (1986) Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysis. Journal of Neuroscience 6: 1160–1170.
[64]	Kobatake E, Tanaka K (1994) Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. Journal of Neurophysiology 71: 856–867.
[65]	Anzai A, Peng X, van Essen DC (2007) Neurons in monkey visual area V2 encode combinations of orientations. Nature Neuroscience 10: 1313–1321.
[66]	Boynton GM, Hedgé J (2004) Visual Cortex: The Continuing Puzzle of Area V2. Current Biology 14: R523–R524.
[67]	Williams D, Phillips G (1987) Cooperative phenomena in the perception of motion direction. Optical Society of America, A 4: 878–885.
[68]	Kersten D (1991) Transparency and the cooperative computation of scene attributes. In: Landy MS, Movshon JA, editors. Computational Models of visual processing. Cambridge: MIT Press. pp. 209–228.
[69]	Metelli F (1974) The Perception of Transparency. Scientific American 230: 90–98.
[70]	Anderson BL (1997) A theory of illusory lightness and transparency in monocular and binocular images: The role of contour junctions. Perception 26: 419–453.
[71]	Wolfe JM, Randall SB, Kunar AM, Horowitz TS (2005) Visual search for transparency and opacity: Attentional guidance by cue combination? Journal of Vision 5: 257–274.
[72]	Watanabe T, Cavanagh P (1993) Transparent surfaces defined by implicit X junctions. Vision Research 33: 2339–2346.
[73]	Wallach H (1935) Ueber visuell wahrgenommene Bewegungsrichtung. Psychologische Forschung 20: 325–380.
[74]	Pack CC, Born RT (2001) Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain. Nature 409: 1040–1042.
[75]	Pack CC, Livingston MS, Duffy KR, Born RT (2003) End-stopping and the aperture problem: Two-Dimensional motion signals in macaque V1. Neuron 39: 671–680.
[76]	Guo K, Robertson R, Nevado A, Pulgarin M, Mahmoodi S, et al. (2006) Primary visual cortex neurons that contribute to resolve the aperture problem. Neuroscience 138: 1397–1406.
[77]	Lorenceau J, Shiffrar M (1992) The influence of terminators in motion integration across space. Vision Research 32: 263–273.
[78]	Nowlan S, Sejnowski N (1995) A selection model for motion processing in area MT of primates. Journal of Neuroscience 15: 1195–1214.
[79]	Pasupathy A, Conner CE (1999) Response to contour features in macaque area V4. Journal of Neurophysiology 82: 2490–2502.
[80]	Fellemann DJ, van Essen DC (1991) Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex 1: 1–47.
[81]	Daugman JG (1988) Complete discrete 2D Gabor transforms by neural networks for image analysis and compression. Transactions on Acoustics, Speech, and Signal Processing 36: 1169–1179.

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133