The Optimization Module provides a selection of optimization solver algorithms which can be divides into two main groups: on one hand gradient-based solvers and on the other hand
derivative-free solvers. The two groups are suitable for different types of problems and have different performance characteristics.