LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints

Thomas Palmeira Ferraz, Kartik Mehta, Yu-Hsiang Lin, Haw-Shiuan Chang, Shereen Oraby, Sijia Liu, Vivek Subramanian, Tagyoung Chung, Mohit Bansal, Nanyun Peng

EMNLP, 2024 & Sys2Reasoning @ NeurIPS, 2024

TL;DR: Introducing RealInstruct to evaluate LLMs on real multi-constrained instructions, and DeCRIM self-correction that improves instruction following by decomposing requests and refining responses, enabling open LLMs to outperform GPT-4 with strong feedback.

ARXIV BIB PDF VIDEO TWITTER

LLM Agents Instruction Following Generation