University of Twente Student Theses


Towards an interactive drone : a Bayesian optimization approach

Khattab, A. A. M. (2018) Towards an interactive drone : a Bayesian optimization approach.

[img] PDF
Abstract:For a drone, equipped with an impedance controller, to correctly deal with physical contact and interaction with the environment, the impedance parameters should be adjusted correctly depending on the interaction task. Concentrating on interaction tasks requiring a constant set of impedance parameters values throughout operation. A model-free learning framework is proposed to automatically find the suitable parameters values. The framework relies on Bayesian optimization and episodic reward calculation requiring the drone to repeatedly perform a predetermined task in the environment actively searching in the impedance parameters space. The sample-efficiency and safety of learning were improved by adding two novel modifications to Bayesian optimization. The first one is local optimization of acquisition functions allowing learning to get early warnings during exploration. The second one is conditioning the reward signal with a logistic function exploiting the initial knowledge and enabling generalizing learning settings to different situations. The proposed technique was validated by applying it to learn the suitable impedance parameters values for a simulated drone performing sliding tasks. The results show that the proposed framework is able to automatically find suitable impedance parameters values in different situations given the same initial knowledge and that the learned parameters values can be generalized to similar interaction tasks.
Item Type:Essay (Master)
Faculty:EEMCS: Electrical Engineering, Mathematics and Computer Science
Subject:54 computer science
Programme:Embedded Systems MSc (60331)
Link to this item:
Export this item as:BibTeX
HTML Citation
Reference Manager


Repository Staff Only: item control page