Safe responses matter: Output-aware safety guardrail mitigate over-refusal in MLLMs
Researchers have proposed an output-aware safety guardrail for multimodal large language models designed to reduce instances where systems incorrectly refuse harmless prompts. By shifting safety checks to the output generation phase rather than just the input, the method aims to maintain model utility without sacrificing protection against harmful content.
Covered by 1 source
- AarXiv CS.AI↗Jiayi Li, Kun Zhan1d ago