A deep probabilistic framework for heterogeneous self-supervised learning of affordances | IEEE Conference Publication | IEEE Xplore

A deep probabilistic framework for heterogeneous self-supervised learning of affordances


Abstract:

The perception of affordances provides an action-centered parametric representation of the environment. By perceiving an object's visual features in terms of what actions...Show More

Abstract:

The perception of affordances provides an action-centered parametric representation of the environment. By perceiving an object's visual features in terms of what actions they afford, novel behavior opportunities can be inferred about previously unseen objects. In this paper, a flexible deep probabilistic framework is proposed which allows an explorative agent to learn tool-object affordances in continuous space. To this end, we use a deep variational auto-encoder with heterogeneous probabilistic distributions to infer the most probable action that achieves a desired effect or to predict a parametric probability distribution over action consequences i.e. effects. Our experiments show the generalization of the method to unseen objects and tools and we have analyzed the influence of different design choices. Our framework goes beyond other proposals by incorporating various probability distributions tailored for each individual modality and by eliminating the need for any pre-processing of the data.
Date of Conference: 15-17 November 2017
Date Added to IEEE Xplore: 08 January 2018
ISBN Information:
Electronic ISSN: 2164-0580
Conference Location: Birmingham, UK

References

References is not available for this document.