The Hamiltonian Inclusion for Nonconvex Velocity Sets

Since Clarke's 1973 proof of the Hamiltonian inclusion for optimal control problems with convex velocity sets, there has been speculation (and, more recently, speculation relating to a stronger, partially convexified version of the Hamiltonian inclusion) as to whether these necessary conditions are valid in the absence of the convexity hypothesis. The issue was in part resolved by Clarke himself when, in 2005, he showed that $L^{\infty}$ local minimizers satisfy the Hamiltonian inclusion. In this paper it is shown, by counterexample, that the Hamiltonian inclusion (and so also the stronger partially convexified Hamiltonian inclusion) are not in general valid for nonconvex velocity sets when the local minimizer in question is merely a $W^{1,1}$ local minimizer, not an $L^{\infty}$ local minimizer. The counterexample demonstrates that the need to consider $L^{\infty}$ local minimizers, not $W^{1,1}$ local minimizers, in the proof of the Hamiltonian inclusion for nonconvex velocity sets is fundamental, not just a technical restriction imposed by currently available proof techniques. The paper also establishes the validity of the partially convexified Hamiltonian inclusion for $W^{1,1}$ local minimizers under a normality assumption, thereby correcting earlier assertions in the literature