Dynamically Scaled Activation Steering
Apple researchers have introduced Dynamically Scaled Activation Steering, a technique that adjusts model behavior based on specific input needs rather than applying uniform interventions. This method aims to improve performance by reducing unnecessary steering, which often degrades output quality in existing approaches to toxicity mitigation and behavior guidance.
Covered by 1 source
- AApple Machine Learning Blog↗4d ago