Guy Shani

Senior Academic

The Skyline algorithm for POMDP value function pruning

Christopher Raphael, Guy Shani

We address the pruning or filtering problem, encountered in exact value iteration in POMDPs and elsewhere, in which a collection of linear functions is reduced to the minimal subset retaining the same maximal surface. We introduce the Skyline algorithm, which traces the graph corresponding to the maximal surface. The algorithm has both a complete and an iterative version, which we present, along with the classical Lark's algorithm, in terms of the basic dictionary-based simplex iteration from linear programming. We discuss computational complexity results, and present comparative experiments on both randomly-generated and well-known POMDP benchmarks.

Publication language English
Pages 61-77
Journal Annals of Mathematics and Artificial Intelligence
Volume 65
Issue number 1
Publication status Published - 01.05.2012

Keywords

Dynamic programming
Linear programming
POMDP

ASJC Scopus subject areas

Applied Mathematics
Artificial Intelligence
Access to Document
10.1007/s10472-012-9302-1
Other files and links
Link to publication in Scopus