Designs And Optimizations For Heterogeneous High Performance Computing