Docker

Dockerized remote R futures + file transfer

The future R package makes it easy to delegate expensive computations to a separate R process, including parallel computing on cloud infrastructure. Best of all (and fundamentally), your local R process doesn’t get stuck waiting for the remote evaluation; you can happily chug along through your R script and deal with the fruits of remote-executed code when they are good and ripe. In this post I’ll briefly outline my current future-enabled workflow, and then detail how I shoehorned in the ability to transfer files produced in the cloud back to my local machine.