Page History
- 2020-Jan-22 11:56 tim
- 2015-Sep-24 13:31 nehag
- 2015-Mar-30 12:36 bt
- 2014-Nov-18 13:28 adesmet
- 2014-Oct-30 11:56 adesmet
- 2014-Oct-30 11:55 adesmet
- 2014-Oct-30 11:54 adesmet
- 2014-Sep-17 15:49 adesmet
- 2014-Apr-01 14:24 adesmet
- 2014-Apr-01 14:22 adesmet
- 2013-Nov-14 14:01 adesmet
- 2013-Mar-29 14:07 samf
- 2012-Nov-13 15:16 adesmet
- 2012-Aug-15 11:21 kronenfe
- 2012-Mar-26 13:40 adesmet
- 2012-Feb-01 11:37 adesmet
- 2012-Feb-01 11:25 adesmet
- 2012-Feb-01 11:23 adesmet
- 2012-Feb-01 11:23 adesmet
Building a HTCondor workspace in NMI
Here is a common scenario: You would like to do a build on some platform or set of platforms in order to ensure that you haven't broken the build process. What are your options? You could check in the code and wait for the nightly builds, but you may well break the build and receive fifty lashes with a wet noodle. A better solution is to not check in your code, but use NMI to build it on any platform that you like.
Before you start, make sure that you have an account on submit-3.batlab.org.
From your usual machine,
% ssh submit-3.batlab.org mkdir workspace % cd path-to-git-dir % tar cf - * | ssh submit-3.batlab.org cd workspace '&&' tar xf -
Then, log into submit-3.batlab.org, and run the following commands
% cd workspace % cd nmi_tools % ./condor_nmi_submit --build --git --workspace=../ --platforms=x86_64_macos_10.7,x86_64_rhap_5.7,x86_64_rhap_6.2,x86_winnt_5.1 --notify-fail-only --desc="A Description"
If you're trying to build something older than 7.7, you'll need to do the following before the condor_nmi_submit. It's not necessary for 7.7 and later.
% git --git-dir=/space/git/CONDOR_DOC.git archive origin/master | tar xf -
Some important options:
--without-testssuppresses the automatic submission of tests when the build is done.--platformstakes a comma separated list of platforms. For a list of available platforms, see "Platforms" below. You must specify the platforms you want. (This is a change from the old BATLab.) You can find a list of available platforms at http://submit-3.batlab.org/nmi/pool/status , look for "Pool usage by platform" in the left column. At the moment (2014-10-30) the set of platforms that we do nightly and rolling builds on is:- x86_64_Debian0,x86_64_Debian6,x86_64_Debian7,x86_64_Fedora19,x86_64_Fedora20,x86_64_MacOSX7,x86_64_MacOSX8,x86_64_RedHat5,x86_64_RedHat6,x86_64_RedHat7,x86_64_SL6,x86_64_Solaris11,x86_64_Ubuntu10,x86_64_Ubuntu12,x86_64_Ubuntu14,x86_64_Windows7,x86_64_Windows8,x86_RedHat5,x86_RedHat6,x86_SL5
--use-externals-cacheuses cached externals to speed the build. May not work in new BATLab. If you're testing a new external, do not use this option.--release-onlybuilds the dynamic binaries, but doesn't package or return them. If you're just doing a compile test and don't need the binaries, this will speed the build by about 45 minutes. If you need to generate a package to give to a user (or to submit for testing), omit this option.--descspecifies a description that appears in the NMI web pages and can help identify your build.--workspace=../is the location of your workspace. Warning: due to a bug in condor_nmi_submit, as of 2006-02-14 the only valid option is "../" as given in the example.--append 'append_requirements=Machine!="exec3.batlab.org"'Blacklist exec3 from the hosts you will build on. {endcode}
The script has a couple of other options. run condor_nmi_submit without options for a summary.
Checking your build's status
- HTCondor-specific status page (Maintained by at (Maintained by Scot K. as of 2012-01).
- Metronome status page (Maintained by Todd M. as of 2012-01.)
Attachments:
- submit-workspace 1821 bytes added by adesmet on 2014-Nov-18 19:30:15 UTC.
Script to automatically submit a workspace build to BaTLab