Projects per year
Abstract
Optimizing images as output of a neural network has been shown to introduce a powerful prior for image inverse tasks, capable of producing solutions of reasonable quality in a fully internal learning context, where no external datasets are involved. Two potential technical approaches involve fitting a coordinate-based Multilayer Perceptron (MLP), or a Convolutional Neural Network to produce the result image as output. The aim of this work is to evaluate the two counterparts, as well as a new framework proposed here, named Neural Knitwork, which maps pixel coordinates to local texture patches rather than singular pixel values. The utility of the proposed technique is demonstrated on the tasks of image inpainting, super-resolution, and denoising. It is shown that the Neural Knitwork can outperform the standard coordinate-based MLP baseline for the tasks of inpainting and denoising, and perform comparably for the super-resolution task.
Original language | English |
---|---|
Article number | 110378 |
Number of pages | 9 |
Journal | Pattern Recognition |
Volume | 151 |
Early online date | 4 Mar 2024 |
DOIs | |
Publication status | Published - 31 Jul 2024 |
Keywords
- generative models
- image denoising
- image inpainting
- image super-resolution
- image synthesis
- internal learning
- zero-shot learning
Fingerprint
Dive into the research topics of 'Neural knitworks: patched neural implicit representation networks'. Together they form a unique fingerprint.Projects
- 1 Finished
-
Fostering Precision Agriculture and Livestock Farming through Secure Access to Large-Scale HPC-Enabled Virtual Industrial Experimentation Environment Empowering Scalable Big Data Analytics (H2020-ICT-2018-2020) (CYBELE)
Tachtatzis, C. (Principal Investigator), Cardona Amengual, J. (Academic), Andonovic, I. (Co-investigator), Atkinson, R. (Co-investigator) & Michie, C. (Co-investigator)
European Commission - Horizon Europe + H2020
1/01/19 → 31/12/21
Project: Research