Matthew E. Taylor's Publications

Sorted by DateClassified by Publication TypeSorted by First Author Last NameClassified by Research Category

Towards Addressing Model Uncertainty: Robust Execution-time Coordination for Teamwork (Short Paper)

Jun-young Kwak, Rong Yang, Zhengyu Yin, Matthew E. Taylor, and Milind Tambe. Towards Addressing Model Uncertainty: Robust Execution-time Coordination for Teamwork (Short Paper). In The IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT), August 2011. Short Paper: 21% acceptance rate for papers, additional 28% for short papers
IAT-11

Download

[PDF]189.7kB  

Abstract

Despite their worst-case NEXP-complete planning complexity, DEC-POMDPs remain a popular framework for multiagent teamwork. This paper introduces effective teamwork under model uncertainty (i.e., potentially inaccurate transition and observation functions) as a novel challenge for DEC-POMDPs and presents MODERN, the first executioncentric framework for DEC-POMDPs explicitly motivated by addressing such model uncertainty. MODERN's shift of coordination reasoning from planning-time to execution-time avoids the high cost of computing optimal plans whose promised quality may not be realized in practice. There are three key ideas in MODERN: (i) it maintains an exponentially smaller model of other agents' beliefs and actions than in previous work and then further reduces the computationtime and space expense of this model via bounded pruning; (ii) it reduces execution-time computation by exploiting BDI theories of teamwork, and limits communication to key trigger points; and (iii) it limits its decision-theoretic reasoning about communication to trigger points and uses a systematic markup to encourage extra communication at these points - thus reducing uncertainty among team members at trigger points. We empirically show that MODERN is substantially faster than existing DEC-POMDP execution-centric methods while achieving significantly higher reward.

BibTeX Entry

@inproceedings{11IAT-Kwak,
  author="Jun-young Kwak and Rong Yang and Zhengyu Yin and Matthew E. Taylor and Milind Tambe",
title = {Towards Addressing Model Uncertainty: Robust Execution-time Coordination for Teamwork (Short Paper)},
booktitle = {The {IEEE/WIC/ACM} International Conference on Intelligent Agent Technology ({IAT})},
month="August",
year = {2011},
note = {Short Paper: 21% acceptance rate for papers, additional 28% for short papers},
wwwnote = {<a href="http://liris.cnrs.fr/~wi-iat11/IAT_2011/">IAT-11</a>},
abstract="Despite their worst-case NEXP-complete planning complexity, DEC-POMDPs remain a popular framework for multiagent teamwork. This paper introduces effective teamwork under model uncertainty (i.e., potentially inaccurate transition and observation functions) as a novel challenge for DEC-POMDPs and presents MODERN, the first executioncentric framework for DEC-POMDPs explicitly motivated by addressing such model uncertainty. MODERN's shift of coordination reasoning from planning-time to execution-time avoids the high cost of computing optimal plans whose promised
 quality may not be realized in practice. There are three
 key ideas in MODERN: (i) it maintains an exponentially
 smaller model of other agents' beliefs and actions than in
 previous work and then further reduces the computationtime
 and space expense of this model via bounded pruning;
 (ii) it reduces execution-time computation by exploiting BDI
 theories of teamwork, and limits communication to key trigger
 points; and (iii) it limits its decision-theoretic reasoning about
 communication to trigger points and uses a systematic markup
 to encourage extra communication at these points - thus
 reducing uncertainty among team members at trigger points.
 We empirically show that MODERN is substantially faster
 than existing DEC-POMDP execution-centric methods while
 achieving significantly higher reward.",
}

Generated by bib2html.pl (written by Patrick Riley ) on Thu Jul 24, 2014 16:09:10