Exploring trade-offs in quantum optimization with noisy qutrits