Paper-Conference

Towards Mitigating Deceptive Safety Alignment in Large Reasoning Models featured image

Towards Mitigating Deceptive Safety Alignment in Large Reasoning Models

Reasoning models hide unsafe thoughts behind safe answers; we propose a metric DSAR to measure it and safety alignment method SARA to mitigate it.

avatar
Xiangyu Zhou
•
Hijacking Large Language Models via Adversarial In-Context Learning featured image

Hijacking Large Language Models via Adversarial In-Context Learning

This work introduces a novel transferable attack against In-Context-Learning to hijack LLMs to generate the target response or jailbreak. We also propose a defense strategy …

avatar
Xiangyu Zhou
•
Not all tokens are meant to be forgotten featured image

Not all tokens are meant to be forgotten

This paper helps large language models forget sensitive and unwanted data without over-forgetting general data.

avatar
Xiangyu Zhou
•

Attention Smoothing Is All You Need For Unlearning

saleh-zare-zade
•