Abstract
How does the brain represent the geometry of 3D objects? Most researchers considering this question focus on vision. However, infants first learn about 3D objects in the haptic system -- that is, by tactile exploration of objects. In this project, we develop a neural network model that learns something about the structure of a 3D cuboid, using input from the motor system that controls a simulated hand navigating on its surfaces. It does this with a simple unsupervised network, that learns to represent frequently-experienced sequences of motor movements. The network learns an approximate mapping from agent-centred (i.e., egocentric) movements to object-centred (i.e., allocentric) locations on the cuboid's surfaces. We also show how this mapping can be improved by the addition of tactile landmarks, by the presence of asymmetries in the cuboid and by the supplement of agent's configurations. We then investigate how the learned geometry of the cuboid can support a reinforcement scheme, that enables the agent to learn simple paths to goal locations on the cuboid.
Related Publications
Bibtex has been copied to clipboard.
X. Yan, A. Knott and S. Mills. A neural network model for learning to represent 3D objects via tactile exploration. In CogSci, 2018.
@inproceedings{yan2018neural,
title={A neural network model for learning to represent 3D objects via tactile exploration.},
author={Yan, Xiaogang and Knott, Alistair and Mills, Steven},
booktitle={CogSci},
URL = "https://www.cs.otago.ac.nz/research/student-publications/Xiaogang-Yan-CogSci2018.pdf",
year={2018}
}
Bibtex has been copied to clipboard.
X. Yan, A. Knott and S. Mills. A Model for Learning Representations of 3D Objects Through Tactile Exploration: Effects of Object Asymmetries and Landmarks. In Australasian Joint Conference on Artificial Intelligence, pp. 271-283, 2018.
@inproceedings{yan2018model,
title={A Model for Learning Representations of 3D Objects Through Tactile Exploration: Effects of Object Asymmetries and Landmarks},
author={Yan, Xiaogang and Knott, Alistair and Mills, Steven},
booktitle={Australasian Joint Conference on Artificial Intelligence},
pages={271--283},
year={2018},
url = {https://www.springerprofessional.de/en/a-model-for-learning-representations-of-3d-objects-through-tacti/16309864},
organization={Springer}
}
Bibtex has been copied to clipboard.
X. Yan, A. Knott and S. Mills. A neural network model for learning to represent 3D objects via tactile exploration: technical appendix. Department of Computer Science, University of Otago, 2018.
@book{yan2018a,
title={A neural network model for learning to represent 3D objects via tactile exploration: technical appendix},
author={Yan, Xiaogang and Knott, Alistair and Mills, Steven},
year={2018},
url={https://www.otago.ac.nz/computer-science/otago685604.pdf},
publisher={Department of Computer Science, University of Otago}
}
Bibtex has been copied to clipboard.