For Non-HTCondor Batch Systems¶
This page contains information about job routes that can be used if you are running a non-HTCondor pool at your site.
Setting a default batch queue¶
To set a default queue for routed jobs, set the variable or attribute
default_queue for the ClassAd
transform and deprecated syntax, respectively:
JOB_ROUTER_ROUTE_Slurm_Cluster @=jrt GridResource = "batch slurm" TargetUniverse = 9 SET default_queue "osg_queue" @jrt JOB_ROUTER_ROUTE_NAMES = Slurm_Cluster
JOB_ROUTER_ENTRIES @=jre [ GridResource = "batch slurm"; TargetUniverse = 9; name = "Slurm_Cluster"; set_default_queue = "osg_queue"; ] @jre JOB_ROUTER_ROUTE_NAMES = Slurm_Cluster
Setting batch system directives¶
To write batch system directives that are not supported in the route examples above, you will need to edit the job
submit script for your local batch system in
(e.g., if your local batch system is Slurm, edit
This file is sourced during submit time and anything printed to stdout is appended to the generated batch system job
ClassAd attributes can be passed from the routed job to the local submit attributes script via
default_CERequirements attribute, which takes a comma-separated list of other attributes:
SET foo "X" SET bar "Y" SET default_CERequirements = "foo,bar"
set_foo = "X"; set_bar = "Y"; set_default_CERequirements = "foo,bar";
foo to the string
bar to the string
Y in the environment of the local submit attributes script.
The following example sets the maximum walltime to 1 hour and the accounting group to the
attribute of the job submitted to a PBS batch system:
JOB_ROUTER_ROUTE_Slurm_Cluster @=jrt GridResource = "batch slurm" TargetUniverse = 9 SET Walltime 3600 SET AccountingGroup x509UserProxyFirstFQAN SET default_CERequirements "WallTime,AccountingGroup" @jrt JOB_ROUTER_ROUTE_NAMES = Slurm_Cluster
JOB_ROUTER_ENTRIES @=jre [ GridResource = "batch slurm"; TargetUniverse = 9; name = "Slurm_Cluster"; set_Walltime = 3600; set_AccountingGroup = x509UserProxyFirstFQAN; set_default_CERequirements = "WallTime,AccountingGroup"; ] @jre JOB_ROUTER_ROUTE_NAMES = Slurm_Cluster
#!/bin/bash echo "#PBS -l walltime=$Walltime" echo "#PBS -A $AccountingGroup"
This results in the following being appended to the script that gets submitted to your batch system:
#PBS -l walltime=3600 #PBS -A <Incoming job's x509UserProxyFirstFQAN attribute>
If you have any questions or issues with configuring job routes, please contact us for assistance.