Data-driven Decision Making with Dynamic Learning under Uncertainty: Theory and Applications