SpikeSEG: Spiking segmentation via STDP saliency mapping

Paul Kirkland, Gaetano Di Caterina, John Soraghan, George Matich

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

3 Citations (Scopus)
61 Downloads (Pure)

Abstract

Taking inspiration from the structure and behaviourof the human visual system and using the Transposed Convo-lution and Saliency Mapping methods of Convolutional NeuralNetworks (CNN), a spiking event-based image segmentationalgorithm, SpikeSEG is proposed. The approach makes use ofboth spike-based imaging and spike-based processing, where theimages are either standard images converted to spiking images orthey are generated directly from a neuromorphic event drivensensor, and then processed using a spiking fully convolutionalneural network. The spiking segmentation method uses the spikeactivations through time within the network to trace back anyoutputs from saliency maps, to the exact pixel location. Thisnot only gives exact pixel locations for spiking segmentation,but with low latency and computational overhead. SpikeSEGis the first spiking event-based segmentation network and overthree experiment test achieves promising results with 96%accuracy overall and a 74% mean intersection over union forthe segmentation, all within an event by event-based framework.
Original languageEnglish
Title of host publication2020 International Joint Conference on Neural Networks (IJCNN)
Place of PublicationPiscataway, N.J.
PublisherIEEE
Number of pages8
ISBN (Electronic)978-1-7281-6926-2
DOIs
Publication statusPublished - 28 Sep 2020
Event2020 International Joint Conference on Neural Networks (IJCNN)- IEEE World congress on computational intelligence(WCCI) 2020: IJCNN - glasgow, Glasgow, United Kingdom
Duration: 19 Jul 202024 Jul 2020
Conference number: 48605X
https://wcci2020.org/ijcnn-sessions/
https://wcci2020.org/

Conference

Conference2020 International Joint Conference on Neural Networks (IJCNN)- IEEE World congress on computational intelligence(WCCI) 2020
Abbreviated titleIJCNN
Country/TerritoryUnited Kingdom
CityGlasgow
Period19/07/2024/07/20
Internet address

Keywords

  • spiking nural network
  • SNN
  • convolution
  • segmentation

Fingerprint

Dive into the research topics of 'SpikeSEG: Spiking segmentation via STDP saliency mapping'. Together they form a unique fingerprint.

Cite this