HTCondor High Throughput Computing

How To Admin Recipes

Browse
Help
Home
Login
Reports
Search
Timeline
Wiki

Contents
Diff
Text

Page History

Turn Off History

This is a collection of how-to recipes.

What recipes are missing from this page?

What recipes aren't here that you want to see?
FAQs about Pool Administration
How to add automatic job requirements
How to adjust the job's environment for the execute machine
How to allow some jobs to claim the whole machine instead of one slot
How to ban a machine from executing jobs
How to ban a user from submitting jobs
How to allow only one user, or a small set of users to run on a given machine.
How to configure a user's fair share of the pool
How to configure backfill tasks such as BOINC
How to configure MPI on Windows
How to configure multi-tier collectors
How to configure priorities/quotas for groups of users
How to configure pseudo-interactive job monitoring/debugging
How to configure HTCondor on a worker node to run one job and then exit
How to disable fair sharing
How to disable preemption
How to have execute machines belong to multiple pools
How to insert custom ClassAd attributes into a job
How to insert custom ClassAd attributes into a machine ad
How to reserve a slot or machine for special jobs
How to limit disk usage of jobs
How to limit memory usage of jobs
How to manage a large HTCondor pool
How to monitor HTCondor pool usage
How to scavenge cycles from PBS
How to set up a large pool of EC2 nodes
How to set user priority factors automatically by domain or other username pattern
How to shut down HTCondor without killing jobs
How to steer jobs towards more desirable machines
How to suspend jobs in place of preemption
How to suspend jobs with an administative command
How to upgrade HTCondor gracefully
How to manage GPUs (OpenCL, CUDA)
How to debug complicated ClassAd expressions
How to schedule parallel universe jobs to use the minimum number of physical machines
How to enable IPv6 in the 7.7.x release series
How to run services in HTCondor
How to use pool passwords and CCB for cloud startds.
How to make Cloud or Glidein startds disappear from the collector faster.
How to make HTCondor and Firewalls get along.
How to run jobs ona subset of machines that have some required software preinstalled.
How to ensure that many machines do not try to start a checkpoint at the same time.

FAQs about Job Submission

How to do remote IO for vanilla universe jobs
How to checkpoint vanilla universe jobs
How to write a condor_q wrapper
How to run a command on each machine within a pool
How to automate Excel calculations in HTCondor
Jobs for R: How to automate R jobs in HTCondor
How to run Matlab jobs
How to avoid sending jobs to Black Hole nodes
How to avoid jobs being restarted - Run once and only once; one; single
How to run Hadoop MapReduce jobs with HTCondor
How to get USE_VISIBLE_DESKTOP to work on Vista/Win7
How to submit dagman itself as a HTCondor-c job
A batch script that can run on any platform enables heterogeneous submission of jobs
How to query transfer stats from the SCHEDD
How to edit a running DAGMan job
How to prevent HTCondor from sending you one email for every job you run.
Why are my jobs only running on the submit machine, and not on any remote machines?
Why is my job running on an execute machine, then preempted off of the machine?
Why do my jobs have enormous ImageSize and refuse to run?
How to render Maya projects

Specific Issues with Windows

Why does my Windows program run fine outside HTCondor, but not when submitted to HTCondor?
Why does my submit machine only run about 120 concurrent jobs?
Why do Windows daemons exit with 10038 (WSAENOTSOCK) error
Why do floating point numbers on Windows fail to parse?
Why do jobs submitted from windows have credential errors?
Why does my job exit right away with error code 128?
Why can't condor_off find my host and condor_status does not give complete hostnames?
Why does condor_store_cred fail even with correct password
Why do daemons exit on Windows with "Unexpected Performance counter size"?
Why does the Windows installer fail with Error 2728. Could not access VBScript run time?

This work is supported by NSF under Cooperative Agreement OAC-2030508 as part of the PATh Project. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the NSF. Site built using CVSTrac.