The OSG is a nationally-funded consortium of computing resources at more than one hundred institutional partners that, together, offer a strategic advantage for computing work that can be run as numerous short tasks. For researchers who are not part of an organization with their own pool in the OSG, we offer the Open Science Pool (OSPool), with dozens of campuses contributing excess computing capacity in support of open science.

Learn more about the services provided by the OSG that can support your HTC workload:

OSG Introduction

For problems that can be run as numerous independent jobs (a high-throughput approach) and have requirements represented in the first two columns of the table below, the significant capacity of the OSPool can transform the types of questions that researchers are able to tackle. Importantly, many compute tasks that may appear to not be a good fit can be modified in simple ways to take advantage, and we'd love to discuss options with you!

Learn more and chat with a Research Computing Facilitator by requesting an account here: OSG Connect Sign-Up

Ideal jobs! Still advantageous Maybe not, but get in touch!
Per-job Requirements; Expected Throughput: 1000s concurrent cores 100s concurrent cores let's discuss!
CPU 1 < 8 > 8 (or MPI)
Walltime < 10 hrs* < 20 hrs* > 20 hrs (not a good fit)
RAM < few GB < 40 GB > 40 GB
Input < 500 MB < 10 GB > 10 GB**
Output < 1GB < 10 GB > 10 GB**
Software pre-compiled binaries, containers Most other than -> Licensed software, non-Linux

or checkpointable *per job; you can work with a large dataset on OSG if it can be split into pieces!

Some examples of work that has been a good fit for the OSPool and benefited from using its resources include:

  • image analysis (including MRI, GIS, etc.)
  • text-based analysis, including DNA read mapping and other bioinformatics
  • parameter sweeps
  • Monte Carlo methods and other model optimization

Watch this video from the 2021 OSG Virtual School for a detailed introduction to OSG the Distributed High Throughput Computing framework:

Learn more and chat with a Research Computing Facilitator by requesting an account here: OSG Connect Sign-Up

 

This page was updated on Nov 30, 2021 at 19:04 from welcome/overview/is-it-for-you.md.