← Back to Model Beat
Research·4d ago·all news from November 18, 2026

First-order methods for stochastic and finite-sum convex optimization with deterministic constraints

arXiv:2506.20630v2 Announce Type: replace-cross Abstract: In this paper, we study a class of stochastic and finite-sum convex optimization problems with deterministic constraints. Existing methods typically aim to find an $\epsilon$-$expected\ feasible\ stochastic\ optimal$ solution, in which both the expected constraint violation and the expected optimality gap are within a prescribed tolerance $\epsilon$. However, in many practical applications, constraints must be nearly satisfied with certainty, rendering such solutions potentially unsuitable due to the risk of substantial violations. To address this issue, we propose stochastic first-order methods for finding an $\epsilon$-$surely\ feasible\ stochastic\ optimal$ ($\epsilon$-SFSO) solution, where the constraint violation is deterministically bounded by $\epsilon$ and the expected optimality gap is at most $\epsilon$. Our methods apply an accelerated stochastic gradient (ASG) scheme or a modified variance-reduced ASG scheme $only\ once$ to a sequence of quadratic penalty subproblems with appropriately chosen penalty parameters. We establish first-order oracle complexity bounds for the proposed…

Covered by 1 source · 2 articles

Related stories

ResearchOur first phase of embedded assessmentsNov 16 · 4 sourcesResearchResearch acceleration: The jagged frontierNov 17 · 4 sourcesResearchTop AI Models Regularly Identify Civilians as Military Targets in TestsNov 17 · 4 sourcesResearchCombatting adversarial distillationNov 20