Cloud computing offers an appealing option to the world of high-performance computing (HPC). However, in situations where substantial throughput is required, the amount of cloud instances will need to be increased. This can lead to increased cloud costs, which may become unappealing when trying to fit everything into your budget.
Google preemptible instances are similar to AWS spot instances, with the exception of a flat pricing approach. Using preemptible instances can reduce the Google instance costs by up to 80%. The drawback of using preemptible instances for computational purposes is that the instances may be terminated at any given time, which can lead to data loss and the termination of the entire computation. So, how can we build a computing platform using Google preemptible instances and save up to 80% in infrastructure costs?