Multi target tracking using a compact Q-learning with a teacher

E. M. Saad, M. H. Awadalla, A. M. Hamdy, H. I. Ali

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper focuses on developing a team of mobile robots capable of learning via human interaction. A modified Q-learning algorithm incorporating a teacher is proposed. The paper first concentrates on simplifying the Q-learning algorithm to be implemented on small and simple team of robots having limited capabilities of memory and computational power. Second it concentrates on the incorporation of a human teacher in the Q-learning algorithm. Experiments using the well-known robot simulator Webots on both single and multi-target tracking tasks have been conducted. The achieved results show the success of the proposed algorithm in the over all system performance.

Original languageEnglish
Title of host publication2008 International Conference on Computer Engineering and Systems, ICCES 2008
Pages173-178
Number of pages6
DOIs
Publication statusPublished - 2008
Event2008 International Conference on Computer Engineering and Systems, ICCES 2008 - Cairo, Egypt
Duration: Nov 25 2008Nov 27 2008

Other

Other2008 International Conference on Computer Engineering and Systems, ICCES 2008
CountryEgypt
CityCairo
Period11/25/0811/27/08

Fingerprint

Target tracking
Learning algorithms
Robots
Mobile robots
Simulators
Data storage equipment
Experiments

Keywords

  • Human-robot interaction
  • Machine learning
  • Q-learning
  • Reinforcement learning

ASJC Scopus subject areas

  • Computer Science Applications
  • Hardware and Architecture
  • Software

Cite this

Saad, E. M., Awadalla, M. H., Hamdy, A. M., & Ali, H. I. (2008). Multi target tracking using a compact Q-learning with a teacher. In 2008 International Conference on Computer Engineering and Systems, ICCES 2008 (pp. 173-178). [4772991] https://doi.org/10.1109/ICCES.2008.4772991

Multi target tracking using a compact Q-learning with a teacher. / Saad, E. M.; Awadalla, M. H.; Hamdy, A. M.; Ali, H. I.

2008 International Conference on Computer Engineering and Systems, ICCES 2008. 2008. p. 173-178 4772991.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Saad, EM, Awadalla, MH, Hamdy, AM & Ali, HI 2008, Multi target tracking using a compact Q-learning with a teacher. in 2008 International Conference on Computer Engineering and Systems, ICCES 2008., 4772991, pp. 173-178, 2008 International Conference on Computer Engineering and Systems, ICCES 2008, Cairo, Egypt, 11/25/08. https://doi.org/10.1109/ICCES.2008.4772991
Saad EM, Awadalla MH, Hamdy AM, Ali HI. Multi target tracking using a compact Q-learning with a teacher. In 2008 International Conference on Computer Engineering and Systems, ICCES 2008. 2008. p. 173-178. 4772991 https://doi.org/10.1109/ICCES.2008.4772991
Saad, E. M. ; Awadalla, M. H. ; Hamdy, A. M. ; Ali, H. I. / Multi target tracking using a compact Q-learning with a teacher. 2008 International Conference on Computer Engineering and Systems, ICCES 2008. 2008. pp. 173-178
@inproceedings{9953719afad64978b28516c249b58a0e,
title = "Multi target tracking using a compact Q-learning with a teacher",
abstract = "This paper focuses on developing a team of mobile robots capable of learning via human interaction. A modified Q-learning algorithm incorporating a teacher is proposed. The paper first concentrates on simplifying the Q-learning algorithm to be implemented on small and simple team of robots having limited capabilities of memory and computational power. Second it concentrates on the incorporation of a human teacher in the Q-learning algorithm. Experiments using the well-known robot simulator Webots on both single and multi-target tracking tasks have been conducted. The achieved results show the success of the proposed algorithm in the over all system performance.",
keywords = "Human-robot interaction, Machine learning, Q-learning, Reinforcement learning",
author = "Saad, {E. M.} and Awadalla, {M. H.} and Hamdy, {A. M.} and Ali, {H. I.}",
year = "2008",
doi = "10.1109/ICCES.2008.4772991",
language = "English",
isbn = "9781424421152",
pages = "173--178",
booktitle = "2008 International Conference on Computer Engineering and Systems, ICCES 2008",

}

TY - GEN

T1 - Multi target tracking using a compact Q-learning with a teacher

AU - Saad, E. M.

AU - Awadalla, M. H.

AU - Hamdy, A. M.

AU - Ali, H. I.

PY - 2008

Y1 - 2008

N2 - This paper focuses on developing a team of mobile robots capable of learning via human interaction. A modified Q-learning algorithm incorporating a teacher is proposed. The paper first concentrates on simplifying the Q-learning algorithm to be implemented on small and simple team of robots having limited capabilities of memory and computational power. Second it concentrates on the incorporation of a human teacher in the Q-learning algorithm. Experiments using the well-known robot simulator Webots on both single and multi-target tracking tasks have been conducted. The achieved results show the success of the proposed algorithm in the over all system performance.

AB - This paper focuses on developing a team of mobile robots capable of learning via human interaction. A modified Q-learning algorithm incorporating a teacher is proposed. The paper first concentrates on simplifying the Q-learning algorithm to be implemented on small and simple team of robots having limited capabilities of memory and computational power. Second it concentrates on the incorporation of a human teacher in the Q-learning algorithm. Experiments using the well-known robot simulator Webots on both single and multi-target tracking tasks have been conducted. The achieved results show the success of the proposed algorithm in the over all system performance.

KW - Human-robot interaction

KW - Machine learning

KW - Q-learning

KW - Reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=67649544245&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=67649544245&partnerID=8YFLogxK

U2 - 10.1109/ICCES.2008.4772991

DO - 10.1109/ICCES.2008.4772991

M3 - Conference contribution

SN - 9781424421152

SP - 173

EP - 178

BT - 2008 International Conference on Computer Engineering and Systems, ICCES 2008

ER -