Obtaining a large amount of visual data has become a trivial task in todays technological world. However, making use of this enormous amount of data poses a huge challenge. Computer vision and machine learning, in particular deep learning, offer answers to these requirements, however most of the approaches proposed rely on labelled training data; they therefore still require a significant human effort for labelling the required amounts of data, which is very costly, tedious and sometimes error-prone or even impossible. In this project we will address this issue for a particular computer vision task of anomaly detection in images. Our aim is to go beyond the traditional supervised learning, where all anomalies on all training images have to be adequately labelled. The objective of the proposed project is to develop novel deep learning methods for modelling complex consistency and detecting inconsistencies in visual data using training images annotated with different levels of accuracy. We will validate the developed methods in three related but different problem domains; visual inspection, remote sensing, and visual surveillance.

Research activity

Engineering sciences and technologies

Range per year

1,72 FTE

Research organisations <https://www.sicris.si/public/jqm/prj.aspx?lang=eng&opdescr=search&opt=2&subopt=403&code1=cmn&code2=auto&psize=10&hits=1&page=1&count=&search_term=J2-9433&id=17299&slng=&order_by=>

Researchers <https://www.sicris.si/public/jqm/prj.aspx?lang=eng&opdescr=search&opt=2&subopt=402&code1=cmn&code2=auto&psize=10&hits=1&page=1&count=&search_term=J2-9433&id=17299&slng=&order_by=>

Project phases and their realization

Workpackages:

The work programme will be divided into seven work packages. Research will be conducted in the first five work packages that will address the following objectives of the project:

·Development of (weakly) supervised approaches for anomaly detection (WP1).

·Development of novel semi- and self-supervised learning of data consistency for anomaly detection (WP2).

·Development of deep generative compositional models for anomaly detection (WP3).

·Guiding the learning process by considering the cognitive relevance of the learned models (WP4).

·Adaptation of developed data consistency learning for anomaly detection to three problem domains: (i) visual inspection, (ii) remote sensing, and (iii) visual surveillance (WP5).

·The remaining two work packages relate to the dissemination of the results (WP6) and project management (WP7).

Project phases:

·Year 1: Activities on work packages WP1, WP2, WP4, WP5, WP6, WP7

·Year 2: Activities on work packages WP2, WP3, WP4, WP5, WP6, WP7

·Year 3: Activities on work packages WP3, WP4, WP5, WP6, WP7

Milestones:

·After Year 1: Weakly supervised anomaly detection

·After Year 2: Semi-supervised anomaly detection

·After Year 3: Unsupervised anomaly detection

Project bibliographic references

Financed by

Slovenian Research Agency