Workshop on Shared Tasks and Comparative Evaluation in Natural Language Generation

Call for Papers

To spark discussion at the workshop, we invite the submission of short position statements that make explicit arguments for or against the adoption of shared evaluation campaigns in NLG; and/or argue for specific approaches to comparative evaluation in NLG.

Submission Information

Position statements should follow the two-column format of ACL proceedings (using these style files), should be in PDF format, and should not exceed two (2) pages, including references. These statements should be accompanied by a short (half page) biographical sketch, also in PDF, highlighting previous work in NLG. Reviewing will not be blind. Please send your position statement and biographical sketch to the workshop organizers, Michael White (mwhite then at symbol then ling.ohio-state.edu) and Robert Dale (rdale then at symbol then ics.mq.edu.au), by no later than Monday January 15, 2007.

Workshop Outcomes

The outcomes of the workshop will be documented in a report, brought together by the organizers, summarizing the workshop discussions and including the participants' contributions. The report is expected to include specific proposals for evaluation mechanisms to be considered by the NLG community. These proceedings will be made publicly available on the workshop website.

Timetable

Jan 15, 2007 Deadline for submitting position statements
Feb 15, 2007 Acceptance decisions returned
April 20–21, 2007 Workshop in Arlington, VA