Know before you go (on the OSG)‚Äč

FIFE has a Wiki page to help match resource requirements and availability at remote sites

Previous editions of FIFE notes have shown glimpses of the tremendous computing resources available on the Open Science Grid. These resources come from a large number of remote sites, each of which has its own limitations and policies regarding opportunistic access. When users try to match their job requirements to sites, it can be a daunting task. In most situations, the FIFE Group recommends that users should not specify sites explicitly when submitting jobs to OSG locations in order to get the most resources. Instead, sit back, relax, and let the fifebatch system match your job to a free slot at an appropriate site. Occasionally, however, users want or need to send certain types of jobs only to a specific set of remote OSG sites.

The FIFE Group maintains a Wiki page containing information about each OSG site that supports FIFE experiments. For each site, the page lists the supported experiments, the proper site name to use for the jobsub --site option, as well as any known limitations on memory, job lifetime, or special details about the environment on the worker nodes. It is a good idea to consult this page before submitting your jobs to make sure that there are sites that can accept your resource requirements such as enough memory, scratch disk, run time limits, etc.

The Wiki page is not, however, a site status monitor. Just because a particular job's resource requests fit at a particular site, it does not guarantee that the job will start at that site. For example, there may not be any opportunistic slots available at that site at a given moment, or the opportunistic slots that are available may not match the job's requirements in terms of memory or job lifetime. Even so, this Wiki page can help distinguish between a situation where users simply need to wait a little bit for the job to start, or a situation in which the resource requests can never be met at the sites you requested. Many happy return codes on the OSG!

- Ken Herner