Call for Papers
Symposium Theme
Ehud Reiter has been a leading light in Natural Language Generation (NLG) research throughout the four decades he worked in this area, in both academia (Aberdeen) and industry (CoGenTech; Arria NLG). Ehud’s influence extends to all aspects of NLG, but the areas in which it has arguably been the strongest is evaluation of NLG systems. On the occasion of his retirement, this workshop, which is held in his honour, will therefore focus on evaluation of NLG systems, highlighting in particular some of the topics that Ehud has tended to emphasize (see below) such as the importance of reproducibility and the risks of data contamination.
Topics of Interest
Topics of interest include (but are not limited to) the following:
- The aims of NLG and NLG evaluation
- Intrinsic versus extrinsic NLG evaluation
- Evaluation of NLG systems in the real world
- Impact assessment of NLG systems and LLMs
- New evaluation challenges arising from the use of LLMs
- Hallucination annotation and its role in NLG evaluation
- Statistical analysis for NLG evaluations
- Data contamination in NLG evaluation
- LLMs as evaluators: opportunities and pitfalls
- The role of LLMs in the development of evaluation metrics
- Reproduction and reproducibility of human evaluation experiments
- Publication bias: What to do with negative results?
- Pre-publication of research hypotheses in NLG evaluation
- NLG evaluation versus psycholinguistic experimentation: what can we learn from each other?
- Disciplinary cultures and evaluation methods
- Evaluating NLG systems/LLMs for assistive technology
Important dates
Note: All deadlines are 23:59 UTC-12.
- First call for papers: 06 February, 2026
- ARR commitment deadline (archival): 16 March, 2026
- Direct paper submission deadline (archival): 24 April, 2026
- Notification of acceptance: 8 May, 2026
- Camera-ready: 22 May, 2026
- Symposium dates: 1-2 June, 2026. Aberdeen, United Kingdom.
Submission
Submission Types
We welcome two types of papers: archival papers and non-archival submissions. Specifically:
- Long Papers (archival): up to eight (8) pages describing substantial, completed work, with concrete evaluation wherever appropriate.
- Short Papers (archival): up to four (4) pages of content. Short papers may describe preliminary contributions, negative results, opinion pieces, or a small set of interesting results.
- Extended Abstracts (non-archival)
Archival papers will be included in the symposium proceedings. The page counts exclude references and appendices. All submissions will be given one extra page of space to address reviewers’ comments.
Archival Submissions
- Long Papers:
- Up to 8 pages (excluding references)
- Unlimited references
- Up to 2 appendix pages
- 1 additional page in the final version to address reviewer comments
- Short Papers:
- Up to 4 pages (excluding references)
- Unlimited references
- Up to 1 appendix page
- 1 additional page in the final version for reviewer comments
Non-Archival Submissions
- Extend abstracts:
- Up to 2 pages including references
- 1 additional appendix page for tables/figures
- Selection based on the symposium fit
Submission procedure and templates
OpenReview submission link coming soon
All submissions must follow the ACL 2026 submission template and guidelines.
Multiple submission policy
We allow multiple submissions for non-archival work.
Optional Supplementary Materials: Appendices, Software and Data
Additionally, supplementary materials can be added in an appendix. Should you make any software or data available within the paper, these need to be fully anonymised.