HTCondorWiki: Bat Lab Build

Page History

See NmiBuild for the old BATLab (nmi-s00#). It also has information not yet verified as working in the new BATLab and copied here.

Building a Condor workspace in NMI

Here is a common scenario: You would like to do a build on some platform or set of platforms in order to ensure that you haven't broken the build process. What are your options? You could check in the code and wait for the nightly builds, but you may well break the build and receive fifty lashes with a wet noodle. A better solution is to not check in your code, but use NMI to build it on any platform that you like.

Before you start, make sure that you have an account on submit-2.batlab.org.

From your usual machine,

  % ssh submit-2.batlab.org mkdir workspace
  % cd path-to-git-dir
  % tar cf - * | ssh submit-2.batlab.org cd workspace '&&' tar xf -

Then, log into submit-2.batlab.org, and run the following commands

  % cd workspace
  # Note: this next git line is no longer necessary on the current (7.7.x) master
  % git --git-dir=/space/git/CONDOR_DOC.git archive origin/master | tar xf -
  % cd nmi_tools
  % ./condor_nmi_submit --build --git --workspace=../ --platforms=x86_64_macos_10.7,x86_64_rhap_5.7,x86_64_rhap_6.2,x86_winnt_5.1 --notify-fail-only --use-externals-cache --desc="A Description"

Note that you probably only need the git archive operation the first time you do this.

Some important options:

--without-tests suppresses the automatic submission of tests when the build is done.
--platforms takes a comma separated list of platforms. For a list of available platforms, see "Platforms" below. You must specify the platforms you want. (This is a change from the old BATLab.) You can find a list of available platforms at http://submit-2.batlab.org/nmi/pool/status , look for "Pool usage by platform" in the left column.
--use-externals-cache uses cached externals to speed the build. If you're testing a new external, do not use this option.
--release-only builds the dynamic binaries, but doesn't package or return them. If you're just doing a compile test and don't need the binaries, this will speed the build by about 45 minutes. If you need to generate a package to give to a user (or to submit for testing), omit this option.
--desc specifies a description that appears in the NMI web pages and can help identify your build.
--workspace=../ is the location of your workspace. Warning: due to a bug in condor_nmi_submit, as of 2006-02-14 the only valid option is "../" as given in the example.
--append 'append_requirements=Machine!="exec3.batlab.org"' Blacklist exec3 from the hosts you will build on. {endcode}

The script has a couple of other options. run condor_nmi_submit without options for a summary.

Checking your build's status

Condor-specific status page (Maintained by at (Maintained by Scot K. as of 2012-01).
Metronome status page (Maintained by Todd M. as of 2012-01.)

Attachments:

submit-workspace 1821 bytes added by adesmet on 2014-Nov-18 19:30:15 UTC.
Script to automatically submit a workspace build to BaTLab