Trial and error can sometimes outperform knowledge because convexity matters a lot. Convex functions are easier to optimize because local max is also global max. Non-convex functions (wavy curves) can be harder to optimize bc th