Story #8005

[Documentation] Install guide documents where to get newer software for CentOS 6

Added by Brett Smith over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Brett Smith
Category:
Documentation
Target version:
Start date:
01/08/2016
Due date:
% Done:

71%

Estimated time:
(Total: 0.00 h)
Story points:
0.5

Description

Known packages:

  • Nginx and Phusion Passenger (via their own repository, I believe)
  • PostgreSQL 9.x (via Software Collections)

Packages we know we need, but don't yet have a good source for:

  • Git 1.7.10+
  • runit
  • SLURM (you can reasonably get this from upstream but it'd be really nice to have it prepackaged somehow)

Neither of these are available through either EPEL, Software Collections, or RepoForge.


Subtasks

Task #8167: Update install guideResolvedBrett Smith

Task #8165: Build and publish MUNGE RPMsResolvedBrett Smith

Task #8143: Build and publish SLURM RPMsResolvedBrett Smith

Task #8166: Test new packages with a bare Docker container and createrepoResolvedBrett Smith

Task #8142: Build and publish runit RPMsResolvedBrett Smith

Task #8168: Publish all RPMs and SRPMsResolvedBrett Smith

Task #8135: Review 8005-centos-3rdparty-installs-wipResolvedBrett Smith

Associated revisions

Revision bbd84f0a
Added by Brett Smith over 3 years ago

Merge branch '8005-centos-3rdparty-installs-wip'

Closes #8005, #8135.

Revision 179b6580 (diff)
Added by Brett Smith over 3 years ago

8005: Install guide suggests slurm-munge on Red Hat SLURM nodes.

This package includes the SLURM plugins that talk to MUNGE.
Refs #8005.

History

#1 Updated by Brett Smith over 3 years ago

  • Description updated (diff)

#2 Updated by Brett Smith over 3 years ago

  • Target version set to Arvados Future Sprints

#3 Updated by Brett Smith over 3 years ago

  • Description updated (diff)

#4 Updated by Brett Smith over 3 years ago

  • Description updated (diff)
  • Category set to Documentation

#5 Updated by Chen Chen over 3 years ago

git 1.7.12 is available in rpmforge-extras

[root]# yum info git --enablerepo=rpmforge-extras
Available Packages
Name : git
Arch : x86_64
Version : 1.7.12.4
Release : 1.el6.rfx
Size : 7.6 M
Repo : rpmforge-extras
Summary : Git core and tools
URL : http://git-scm.com/
License : GPL
Description : GIT comes in two layers. The bottom layer is merely an extremely
: fast and flexible filesystem-based database designed to store
: directory trees with regard to their history. The top layer is a
: SCM-like tool which enables human beings to work with the database
: in a manner to a degree similar to other SCM tools (like CVS,
: BitKeeper or Monotone).

Also, I can help create a SRPM for runit. It's really simple.

#6 Updated by Chen Chen over 3 years ago

#7 Updated by Brett Smith over 3 years ago

  • Target version changed from Arvados Future Sprints to 2016-01-20 Sprint

#8 Updated by Brett Smith over 3 years ago

  • Assigned To set to Brett Smith

#9 Updated by Brett Smith over 3 years ago

  • Story points set to 1.0

#10 Updated by Brett Smith over 3 years ago

Thanks very much for both of those pointers, Chen. I independently found that runit-rpm repository too, but it's very reassuring it looks good to you—and that Git package wasn't on my radar at all. Our current plan is to use that to build our own RPMs, and make them available through our package repository as with other backports.

#11 Updated by Brett Smith over 3 years ago

  • Status changed from New to In Progress

#12 Updated by Brett Smith over 3 years ago

I have the packages built and tested, so now all that's left is uploading and documenting. For posterity, here's how I built each source, and then how I got recent Git, starting from arvados/build:centos6.

<https://codeload.github.com/dun/munge/legacy.tar.gz/2cab319856a11c5d314983345f91e3342fabb9fe>
    yum install bzip2-devel
    tar -xf munge-0.5.11.tar.gz
    mv dun-munge-2cab319/ munge-0.5.11
    tar -c munge-0.5.11 | bzip2 > munge-0.5.11.tar.bz2
    rpmbuild -tb munge-0.5.11.tar.bz2
    rpmbuild -ts munge-0.5.11.tar.bz2

<http://www.schedmd.com/download/latest/slurm-15.08.6.tar.bz2>
     yum install pam-devel
     rpm -ivh ~/rpmbuild/RPMS/x86_64/munge*.rpm
     rpmbuild -tb slurm-15.08.6.tar.bz2
     rpmbuild -ts slurm-15.08.6.tar.bz2

## runit
     yum -y install rpmdevtools git glibc-static
     git clone https://github.com/imeyer/runit-rpm runit-rpm
     cd runit-rpm/
     git checkout eefeaca0913638f375afe92d03c5b4c5f81128f2
     ./build.sh
     rpmbuild -bs ~/rpmbuild/SPECS/runit.spec

## git: <http://repoforge.org/use/>
     wget 'http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.3-1.el6.rf.x86_64.rpm'
     rpm -ivh rpmforge-release-0.5.3-1.el6.rf.x86_64.rpm
     yum install --enablerepo=rpmforge-extras git

#13 Updated by Brett Smith over 3 years ago

Everything was published following the same basic procedure the upload script uses. SPRMs went to /CentOS/6/os/Source.

#14 Updated by Brett Smith over 3 years ago

  • Target version changed from 2016-01-20 Sprint to 2016-02-03 Sprint
  • Story points changed from 1.0 to 0.5

#15 Updated by Tom Clegg over 3 years ago

8005-centos-3rdparty-installs-wip @ 9759b9d...

Found only one bug: Nit: in source:doc/install/install-api-server.html.textile.liquid the "Puma is already included" list item feels weird. Maybe better to delete that sentence and split "install runit" and "install the script below" into two list items, so we'd have
  1. Install Nginx and Phusion Passenger.
  2. Install runit.
  3. Install the script below as the run script for the puma service, modifying it as directed by the comments.
Happened to see a couple of previously existing bugs.
  • "tar" is still missing from the Centos6 dependencies in _includes/_install_ruby_and_bundler.liquid.
  • typo "envirnoment" is still present in install/install-keepproxy.html.textile.liquid.

Everything else LGTM, nice incidental bugfixes, thanks.

#16 Updated by Brett Smith over 3 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 57 to 100

Applied in changeset arvados|commit:bbd84f0a5594fdbf21a967572d4c2b33d7987f2b.

Also available in: Atom PDF