Panel discusses evaluation strategies for generative language models, suggesting directions for NTCIR tasks.
The goal of this panel is to inspire thinking about evaluation of generative Large Language Models (LLM) at NTCIR. This will be a discussion-focused panel, with panelists initially setting the stage with responses to a few questions, followed by a wide-ranking discussion among the panel and with the audience. We will consider the panel to be a success if some future NTCIR tasks are influenced by our discussion.
No takes yet. Share an insight, caveat, or question.
Oard et al. (2023) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: