Blood lactate concentration is a reliable risk indicator of deterioration in critical care requiring frequent blood sampling. However, lactate measurement is an invasive procedure that can increase risk of infections. Yet there is no clinical consensus on the frequency of measurements. In response we investigate whether machine learning algorithms can be used to predict blood lactate concentration from ICU health records. We evaluate the performance of different prediction algorithms using a multi-centre critical care dataset containing 13,464 patients. Furthermore, we analyse impact of missing value handling methods in prediction performance for each algorithm. Our experimental analysis show promising results, establishing a baseline for further investigation into this problem.