Modern biological research generates vast amounts of data that require complex computational workflows to process efficiently and reproducibly. As data volumes continue to grow, so does the demand for computing infrastructure to process them. Deploying these workflows in the cloud is becoming increasingly common. This webinar will introduce the fundamental concepts of cloud deployment for Nextflow pipelines and demonstrate the steps required for setting up a fully functional pipeline in the cloud. We will begin by describing the purpose of Workflow Management Systems (such as Nextflow) and why they have become indispensable in modern computational biology. The session will cover both the benefits and potential limitations of cloud-based workflow execution, helping you understand when and why to leverage cloud resources for your computational workloads. We will use the "Biome-specific Shallow-shotgun Inference of Functional Traits through Read-mapping" (BioSIFTR) pipeline as our case study. This pipeline, developed by the Microbiome Informatics team at EMBL-EBI as part of the Finding Pheno project, serves as an excellent example of a complex computational workflow on a public cloud platform using Nextflow.
Beracochea et al. (Wed,) studied this question.