This paper proposes an optimization algorithm to solve iteratively optimal control problems involving systems of conservation laws. The irregularity of their solution requires a specific variational analysis that have direct implications on the numerical implementation. This method is applied to the control of non-equilibrium traffic using the Payne-Whitham and the Aw-Rascle-Zhang model.