Looking for advice on constrained optimization problem. Currently I construct a Lagrangian and use various descent algorithms, line searches, all the usual tricks. No matter what I use, I am limited by a very costly state-evaluation step.
Is there an optimization algorithm that I can implement to avoid state evaluation unless required?