PBS Default number of nodes and number of cpus


#1

Trying to find out if it 's possible to set both below in qmgr for default batch queue…i.e, if user does not specify node/ppn settings in pbs script to be run…

set queue batch resources_default.nodes = 5
set queue batch resources_default.ncpus = 10

it looks like if I set above, and run qstat -n shows it assigned 5 nodes under NDS but assigned 5 CPU under TSK. so it assigned 5cpus total…I would have thought it would say 50 under TSK …5nodesx10cpu.

basically I want to test with setting maximum number of cpus per node…5 nodes x 10 cpus… below is my (default unchanged) qmgr server output:

Create queues and set their attributes.

Create and define queue batch

create queue batch
set queue batch queue_type = Execution
set queue batch Priority = 50
set queue batch resources_max.cput = 999:00:00
set queue batch resources_max.walltime = 999:00:00
set queue batch resources_default.walltime = 168:00:00
set queue batch resources_default.nodes = 1
set queue batch acl_group_enable = False
set queue batch disallowed_types = interactive
set queue batch keep_completed = 3600
set queue batch enabled = True
set queue batch started = True

Create and define queue interactive

create queue interactive
set queue interactive queue_type = Execution
set queue interactive resources_max.cput = 24:00:00
set queue interactive resources_max.walltime = 24:00:00
set queue interactive resources_default.nodes = 1
set queue interactive acl_group_enable = False
set queue interactive disallowed_types = batch
set queue interactive keep_completed = 3600
set queue interactive enabled = True
set queue interactive started = True

Set server attributes.

set server scheduling = True
set server acl_host_enable = False
set server acl_hosts = amedpbswrair000.amed.ds.army.mil
set server managers = root@amedpbswrair000.amed.ds.army.mil
set server operators = root@amedpbswrair000.amed.ds.army.mil
set server default_queue = batch
set server log_events = 511
set server mail_from = adm
set server query_other_jobs = True
set server scheduler_iteration = 600
set server node_check_rate = 150
set server tcp_timeout = 300
set server node_pack = False
set server job_stat_rate = 300
set server poll_jobs = True
set server down_on_error = True
set server mom_job_sync = True
set server mail_domain = none
set server kill_delay = 10
set server keep_completed = 300
set server next_job_number = 15528
set server job_log_keep_days = 30
set server moab_array_compatible = True
set server nppcu = 1
set server timeout_for_job_delete = 120
set server timeout_for_job_requeue = 120
set server note_append_on_error = True


#2

Hello zanyviper. Based on your output of qmgr, I am concluding that you are using TORQUE/Moab. This website is for discussions about PBS Professional. Are you attempting to migrate from TORQUE/Moab to PBS Professional, and you are asking how to achieve a similar configuration?


#3

Hi Scott apologies, I am not familiar with PBS Professional, but yes we are using Torque/PBS. If this is the wrong forum for my question I apologize. Regards,


#4

So a little history for your knowledge.

PBS was originally developed for NASA under a contract project. Altair Engineering acquired the rights to all the PBS technology and intellectual property from Veridian in 2003. Altair Engineering currently owns and maintains the intellectual property associated with PBS, and also employs the original development team from NASA.

The following versions of PBS are currently available:

OpenPBS — original open source version released by MRJ in 1998 (not actively developed)
TORQUE — a fork of OpenPBS that is maintained by Adaptive Computing Enterprises, Inc. (formerly Cluster Resources, Inc.)
PBS Professional (PBS Pro) — the version of PBS offered by Altair Engineering that is dual licensed under an open source and a commercial license.

PBS Professional has a more modern language specification for job submission, which is called select/place. If using PBS Professional, I would suggest using queuejob hook to evaluate the user’s job submission and modify the select/place requirements to meet your combination check.


How to get accounting information of Opeb PBS?
Installation of torque in single node - ubuntu 14.04
#5

Scott thank you, I’ll experiment further with what’s available.Thanks for the history also…