| ICAPS
2005 Competition on Knowledge Engineering for Planning and Scheduling June 7, 2005, Monterey, California, U.S.A. |
|
Welcome
| Committee
| Competitors
| Program | Rules
| Results
|
Area of ScopeThe competition is open to authors of a tool, an integrated tools environment or tools platform (below we simply refer to the entry as "the tool") where the tool helps knowledge engineering for AI P&S purposes in at least one of the following categories:
- knowledge formulation (the acquisition and encoding of domain structure and/or control heuristics)
- planner configuration (fusing application knowledge with a P&S engine)
- validation of the domain model (e.g. using visualization, analysis, re-formulation) or validation of the P&S system as a whole (e.g. using plan/schedule visualization)
- knowledge refinement and maintenance (e.g. through automated learning/training, or a mixed initiative P&S process)
Planners/Schedulers tools themselves are NOT eligible but could be a part of an environment entered. The competition is open to anyone including the members of PC. Only the judges and teams from the judges’ institutions are excluded from the competition. The authors must follow the competition structure. In particular, at least one of the authors is requested to present the system during the conference.
StructurePre-conference:
Authors submit a short paper describing the tool (no more than 5 pages including screenshots, in the ICAPS format) to the workshop organizers by the submission deadline. Papers must be in US letter size, and use the AAAI Style template.
Authors are encouraged to make the tool available for download from web.
The short papers will be 'lightly' reviewed in order to
(a) feed back to the contributors for updating their paper and matters to explain/address during the conference
(b) contribute to the overall evaluation of the submissions
(c) keep to a limit of say 15 contributions
If the tool is accepted for the competition then the authors submit a camera-ready copy of the paper to the workshop organizers by the camera-ready copy deadline and they register for the competition via the standard ICAPS registration. At least one author per tool is requested to come to the conference and demonstrate the system in person. This will entail giving a short talk during the competition workshop and being ready to demonstrate the system and answer questions during the demonstration session. The competitors are kindly requested to bring their tools installed on their own laptops.
At the conference:
The competition will take place during a one day workshop, where competitors will present their systems (15 minutes), and system demonstration. The workshop and system demonstration will be open to everyone attending the conference.
The judges will decide the results by scrutinizing the submitted short papers, the reviews of the short papers, and the system presentations/demonstrations. The proposed criteria to be used by the judges are presented below. There will be a presentation of the results and winners' prizes either during the conference reception or during/before the conference dinner.
Evaluation Criteria used in the Competition:
- support potential: what potential has the tool in helping the processes within the scope of the competition? Will the tool save time and resource?
- scope: how broad is the scope of the tool within the defined scope of the competition?
- usability: can the tool be easily used, accessed and/or configured? Could non planning-experts use it?
- interoperability: can the tool be integrated with other P&S technology? Are its interfaces well defined - can the software be easily used with other P&S software, or easily combined with third party planners?
- innovation: what is the quality of the scientific and technical innovations that underlie the software?
- wider comparison: How does the tool compare with KE software in other areas of AI? For example, could the software be subsumed by some other existing KBS KE tool?
- build quality: does the software appear robust? Has the software been well tested?
- relevance: to what degree does the tool address problems peculiar to KE for P&S? Is the software relevant or applicable to real-world applications?
Important Dates:
Submission deadline: March 21st, 2005 Notification: April 4th, 2005 Camera-ready copy due date: April 14th, 2005 Competition day: June 7th, 2005 Competition results: June 9th, 2005 (right after the conference dinner)