333 research outputs found
A survey on modern trainable activation functions
No full textIn neural networks literature, there is a strong interest in identifying and defining activation functions which can improve neural network performance. In recent years there has been a renovated interest in the scientific community in investigating activation functions which can be trained during the learning process, usually referred to as trainable, learnable or adaptable activation functions. They appear to lead to better network performance. Diverse and heterogeneous models of trainable activation function have been proposed in the literature. In this paper, we present a survey of these models. Starting from a discussion on the use of the term “activation function” in literature, we propose a taxonomy of trainable activation functions, highlight common and distinctive proprieties of recent and past models, and discuss main advantages and limitations of this type of approach. We show that many of the proposed approaches are equivalent to adding neuron layers which use fixed (non-trainable) activation functions and some simple local rule that constrains the corresponding weight layers
A study on recovering the cloud top-height from infra-red video sequences
No full textIn this paper we present some preliminary results on an opticalfow based technique aimed at recovering the cloud-top height from infra-red image sequences.
The recovery of the cloud-top height from satellite infra-red images is an important topic in meteorological studies, and is traditionally based on the analysis of
the temperature maps. In this work we explore the feasibility for this problem of a technique based on a robust multi-resolution opticalfow algorithm. The robustness is achieved adopting a Least Median of Squares paradigm. The algorithm has been tested on semi-synthetic data (i.e. real data that have been synthetically
warped in order to have a reliable ground truth for the motion eld), and on real short sequences (pairs of frames) coming from the ATSR2 data set. Since we assumed
the same geometry as for the ATSR2 data, the cloud top height could be recovered from the motion eld by means of the widely used Prata and Turner
equation
A simple and efficient architecture for trainable activation functions
No full textAutomatically learning the best activation function for the task is an active topic in neural network research. At the moment, despite promising results, it is still challenging to determine a method for learning an activation function that is, at the same time, theoretically simple and easy to implement. Moreover, most of the methods proposed so far introduce new parameters or adopt different learning techniques. In this work, we propose a simple method to obtain a trained activation function which adds to the neural network local sub-networks with a small number of neurons. Experiments show that this approach could lead to better results than using a pre-defined activation function, without introducing the need to learn a large number of additional parameters
Stereo Matching Tecniques for Cloud-top Height Retrieval
No full textThis paper presents an ongoing study for the estimation of the cloud-top height by using only geometrical methods. In agreement with some recent studies showing that it is possible to achieve reliable height estimations not only with the classical methods based on radiative transfer, this article includes a comparison of performances of a selected set of vision algorithms devoted to extract
dense disparity maps or motion fields from Infra Red stereo image pairs. This collection includes both area-based techniques and an optical flow-based method and the comparison is accomplished by using a set of cloudy scenes selected from the Along-Track Scanning Radiometer (ATSR2) database. The first group of algorithms yields results generally comparable in terms of the measures used for the inter-comparison, while the maps from the optical flowbased method are slightly better
Comparison of Stereo Vision Techniques for Cloud-Top height retrieval
No full textThis paper presents an ongoing study for the estimation of the cloud-top height by using only geometrical methods. In agreement with some recent studies showing that it is possible to achieve reliable height estimations not only with the classical methods based on radiative transfer, this article includes a comparison of performances of a selected set of vision algorithms devoted to extract dense disparity maps or motion fields from Infra Red stereo image pairs. This
collection includes both area-based techniques and an optical flow-based method and the comparison is accomplished by using a set of cloudy scenes selected from the Along-Track Scanning Radiometer (ATSR2) database. The first group of algorithms yields results generally comparable in terms of the measures used for the inter-comparison, while the maps from the optical flow-based method are slightly better
XAI approach for addressing the dataset shift problem: BCI as a case study
No full textIn the Machine Learning (ML) literature, a well-known problem is the Dataset Shift problem where, differently from the ML standard hypothesis, the data in the training and test sets can follow different probability distributions leading ML systems toward poor generalisation performances. Therefore, such systems can be unreliable and risky, particularly when used in safety-critical domains. This problem is intensely felt in the Brain-Computer Interface (BCI) context, where bio-signals as Electroencephalographic (EEG) are used. In fact, EEG signals are highly non-stationary signals both over time and between different subjects. Despite several efforts in developing BCI systems to deal with different acquisition times or subjects, performance in many BCI applications remains low. Exploiting the knowledge from eXplainable Artificial Intelligence (XAI) methods can help develop EEG-based AI approaches, overcoming the performance returned by the current ones. The proposed framework will give greater robustness and reliability to BCI systems with respect to the current state of the art, alleviating the dataset shift problem and allowing a BCI system to be used by different subjects at different times without the need for further calibration/training stages
A distributed genetic algorithm for restoration of vertical line scratches
No full textThis paper reports a distributed algorithm for the restoration of still frames corrupted by
vertical line scratches. The restoration is here approached as an optimisation problem,
and is solved using an ad-hoc Genetic Algorithm. The distributed algorithm is designed following
a pipeline logical structure. The front end is a network of standard workstations
with heterogeneous operating systems. The quality of image is appreciable and the computational
time is quite low with respect the sequential version
Improving face recognition in low quality video sequences: Single frame vs multi-frame super-resolution
No full textRe-Identification aims to detect the presence of a subject spotted in one video in other videos. Traditional methods use information extracted from single frames like color, clothes, etc. A sequence in time domain of consecutive subject images could contain a greater amount of information compared with a single image of the same subject. Typically, these sequences are taken from surveillance cameras at very poor resolution. Even with modern cameras the resolution can be a problem when dealing with a subject who is far from the camera. A possible way of handling low resolution images is by using a multi-frame super-resolution algorithm. Multi-frame super-resolution image reconstruction aims at obtaining a high-resolution image by fusing a set of low-resolution images. Low-resolution images are usually subject to some degradation which causes substantial information loss. Therefore, contiguous images in a sequence could be viewed as a degraded version (SR image) of an image at higher resolution (HR image). Using a multi-frame SR algorithm could achieve a restoration of the HR image. This work aims to investigate the possibility of using a multi-frame super-resolution algorithm to enhance the performance of a classic re-identification system by exploiting information provided by video sequences made available by a video surveillance system. In the case that the SR technique employed results in an effective performance enhancement, we intend to show empirically how many match frames are required to have an effective improvement
- …
