Physics Oriented Deep Learning for Material Prediction and Generation