The 3rd International Planning Competition: Results and Analysis

D. Long, M. Fox

Research output: Contribution to journalArticle

164 Citations (Scopus)

Abstract

This paper reports the outcome of the third in the series of biennial international planning competitions, held in association with the International Conference on AI Planning and Scheduling (AIPS) in 2002. In addition to describing the domains, the planners and the objectives of the competition, the paper includes analysis of the results. The results are analysed from several perspectives, in order to address the questions of comparative performance between planners, comparative difficulty of domains, the degree of agreement between planners about the relative difficulty of individual problem instances and the question of how well planners scale relative to one another over increasingly difficult problems. The paper addresses these questions through statistical analysis of the raw results of the competition, in order to determine which results can be considered to be adequately supported by the data. The paper concludes with a discussion of some challenges for the future of the competition series.
LanguageEnglish
Pages1-59
Number of pages58
JournalJournal of Artificial Intelligence Research
Volume20
Publication statusPublished - 2003

Fingerprint

Planning
Statistical methods
Scheduling

Cite this

@article{1e43f7e6fab342b8b61bc7e8e9ce15c1,
title = "The 3rd International Planning Competition: Results and Analysis",
abstract = "This paper reports the outcome of the third in the series of biennial international planning competitions, held in association with the International Conference on AI Planning and Scheduling (AIPS) in 2002. In addition to describing the domains, the planners and the objectives of the competition, the paper includes analysis of the results. The results are analysed from several perspectives, in order to address the questions of comparative performance between planners, comparative difficulty of domains, the degree of agreement between planners about the relative difficulty of individual problem instances and the question of how well planners scale relative to one another over increasingly difficult problems. The paper addresses these questions through statistical analysis of the raw results of the competition, in order to determine which results can be considered to be adequately supported by the data. The paper concludes with a discussion of some challenges for the future of the competition series.",
author = "D. Long and M. Fox",
year = "2003",
language = "English",
volume = "20",
pages = "1--59",
journal = "Journal of Artificial Intelligence Research",
issn = "1076-9757",

}

The 3rd International Planning Competition: Results and Analysis. / Long, D.; Fox, M.

In: Journal of Artificial Intelligence Research, Vol. 20, 2003, p. 1-59.

Research output: Contribution to journalArticle

TY - JOUR

T1 - The 3rd International Planning Competition: Results and Analysis

AU - Long, D.

AU - Fox, M.

PY - 2003

Y1 - 2003

N2 - This paper reports the outcome of the third in the series of biennial international planning competitions, held in association with the International Conference on AI Planning and Scheduling (AIPS) in 2002. In addition to describing the domains, the planners and the objectives of the competition, the paper includes analysis of the results. The results are analysed from several perspectives, in order to address the questions of comparative performance between planners, comparative difficulty of domains, the degree of agreement between planners about the relative difficulty of individual problem instances and the question of how well planners scale relative to one another over increasingly difficult problems. The paper addresses these questions through statistical analysis of the raw results of the competition, in order to determine which results can be considered to be adequately supported by the data. The paper concludes with a discussion of some challenges for the future of the competition series.

AB - This paper reports the outcome of the third in the series of biennial international planning competitions, held in association with the International Conference on AI Planning and Scheduling (AIPS) in 2002. In addition to describing the domains, the planners and the objectives of the competition, the paper includes analysis of the results. The results are analysed from several perspectives, in order to address the questions of comparative performance between planners, comparative difficulty of domains, the degree of agreement between planners about the relative difficulty of individual problem instances and the question of how well planners scale relative to one another over increasingly difficult problems. The paper addresses these questions through statistical analysis of the raw results of the competition, in order to determine which results can be considered to be adequately supported by the data. The paper concludes with a discussion of some challenges for the future of the competition series.

UR - http://www.jair.org/papers/paper1240.html

M3 - Article

VL - 20

SP - 1

EP - 59

JO - Journal of Artificial Intelligence Research

T2 - Journal of Artificial Intelligence Research

JF - Journal of Artificial Intelligence Research

SN - 1076-9757

ER -