Install Fedora-9-x86_64 on Poweredge1950/2950
4xPoweredge 1950: Xeon L5420 16GB memory 450GB HD
1xPoweredge 2950: Xeon L5240 16GB memory 450GB HD + RAID1
Details on Xeon
http://en.wikipedia.org/wiki/Xeon
Download Fedora-9-x86_64 (ISO file for DVD) from anl.gov mirror site (dead) of Fedora
Where to get Fedora 7-10 at 300-350kB/sec
http://mirror.anl.gov/pub/fedora/linux/releases/
I downloaded Fedora 7, 8, 9 at the same time, each at the speed of 300-350kB/s
http://archives.fedoraproject.org/pub/archive/fedora/linux/releases/9/Fedora/x86_64/iso/
Linux 2.6.25 kernel
Restart computer with DVD in the drive
Install or upgrade an existing system: graphics mode is default
"Loading vmlinuz... "
"Anaconda 11.4.0.82 installer"
Media test if the DVD is used the first time
Installation language: English
Keyboard: English
eth0,1,2,3 active on boot; automatically via DHCP (can be revised later)
Time: US Los Angeles CA; uncheck UTC
Enter root password
Remove all linux partitions (default)
Format disk
Select "software development"; uncheck "Office..."; "customize later"(default)
A total of 1110 or 1111 packages will be installed in ~20 minutes
Note the gnome is the default desktop
gcc with gfortran will be installed
Installation done and DVD will be rejected
Reboot
Welcome --> License --> Create user account --> Current time --> Do not send profile
Done with localhost.localdomain
Log in as root (for convenience)
(the following need to be done only 1 time)
(Open firefox --> log in CWU network --> shutdown --> wait 5 minutes --> reboot)
Installation of softwares:
yum install ncompress
yum install csh
yum install tcsh
The above 2 commands install the same tcsh-6.15-4.fc9.x86_64 package
yum provides libstdc++.so.5 (this is for installation of Intel Fortran Compiler Professional)
yum install compat-libstdc++-33
yum install compat-libstdc++-33.i386
Both of the above packages need to be installed for Intel Fortran compiler
Now increase shmmax and shmall
vi /etc/sysctl.conf
# added by Yingbin Ge for 16 GB of SysV memory
kernel.shmmax = 17179869184
kernel.shmall = 4194304
Linux allows this parameter to be set on the fly, by
/sbin/sysctl -w kernel.shmmax=17179869184
/sbin/sysctl -w kernel.shmall=4194304
to avoid a reboot.
Temporarily change selinux=enforcing to selinux=permissive by
vi /etc/sysconfig/selinux
Change selinux=enforcing after the installation of Intel Fortran Compiler (ifort)
reboot; log in as root
Google "Intel Fortran Compiler" and download l_cprof_p_11.0.74.intel64.tgz from Intel website. It includes ifort, debugger and MKL (math kernel lib)
It is free for non-commercial use. Do not close the page with License number.
download l_cprof_p_11.0.74.intel64.tgz to /root/download
gunzip *gz and tar -xvf *tar
cd l_cprof_p_11.0.74.intel64
./install.sh
follow the instructions to install ifort
set path=(. $path /opt/intel/Compiler/11.0/074/bin/intel64)
log out root and log in as regular user
double check network
csh
make a .cshrc file same as /root/.cshrc
source ~/.cshrc
Obtain /u1/guest/gamess.tar.Z and tinker.tar.Z from si.msg
uncompress *.Z
tar xvf gamess.tar
No need to install tinker unless SIMOMM calculations need to be done
cd gamess
cd ddi
vi compddi
make changes
./compddi
mv ddikick.x ..
cd ../tools
cp actvte.code actvte.f
vi actvte.f
:%s/\*UNX/4SPC/g
:wq
ifort actvte.f -o actvte.x
cd ..
vi comp compall lked
set platform = linux-ia64 to use ifort
change paths
compall >& compall.log
lked
vi rungms runall
change paths to /home/yingbin
mkdir ~/scr
su
mkdir /scr
mkdir /scr/yingbin
chown yingbin !$
chgrp yingbin !$
exit
vi /etc/hosts
make changes to combine ip and hostname
127.0.0.1 hostname will do
rungms exam23 failed in the middle due to convergence problem; all others from 1-43 succeeded.
Configure network:
http://www.yolinux.com/TUTORIALS/LinuxTutorialNetworking.html
Log in as root and run .ssh-keygen on each slave node; the produced id_rsa.pub should be appended to the authorized_keys in the .ssh directory of the head node. This is to allow ssh without passwd as a superuser.
NFS on Fedora 9 (PowerEdge 2950 + 1950)
ON THE HEAD NODE (192.168.2.101 or 192.168.2.102)
1. vi /etc/exports
TYPE the following compute nodes in /etc/exports.
# Allow rw access from compute nodes to server in a synchronized mode.
# Since no_root_squash is put in the parentheses,
# the remote root user will not be treated as a root but as a default nfs user.
/home 192.168.2.111(rw,sync,no_root_squash)
/home 192.168.2.112(rw,sync,no_root_squash)
/home 192.168.2.121(rw,sync,no_root_squash)
/home 192.168.2.122(rw,sync,no_root_squash)
/home 192.168.2.131(rw,sync,no_root_squash)
/home 192.168.2.132(rw,sync,no_root_squash)
/home 192.168.2.141(rw,sync,no_root_squash)
/home 192.168.2.142(rw,sync,no_root_squash)
/home 192.168.2.151(rw,sync,no_root_squash)
/home 192.168.2.152(rw,sync,no_root_squash)
2. /usr/sbin/exportfs -a
This command is to export file system as described in /etc/exports.
3. service nfs restart; service nfslock restart
These commands are to restart nfs and nfslock.
4. chkconfig nfs on; chkconfig nfslock on
These commands are to auto-run nfs and nfslock after reboot.
5. vi /etc/hosts.allow
ALL: .cwu.edu
ALL: 127.0.0.1
This /etc/hosts.allow file is to allow all access from *.cwu.edu
The second line is important to allow loopback to start NFS server.
6. vi /etc/hosts.deny
ALL: ALL
This /etc/hosts.deny file is to deny all access from all IP except from *.cwu.edu
ON EVERY COMPUTE NODE
7. mount -t nfs ge1:/home /home
This command is to mount the ge1:/home on server to a local directory on the compute node.
Then add this following line in /etc/fstab to let the compute node mount master automatically after reboot.
ge1:/home /home nfs hard,intr,rw 0 0
/etc/fstab:
< partition >< mount point >< file system >< mount options >< dump >< fsck order >
/etc/mtab handles the mounted devices and is automatically updated by the mount command. And it looks a bit similar to fstab but not the 100% same ( notice rw and ro for read/write and read only ) And it does only lists the mounted devices !
8. /sbin/chkconfig sendmail off (for security reasons)
/sbin/chkconfig network on (for network on reboot)
9. Set selinux=enforcing on the head node and selinux=disabled on the compute nodes
On the head node: chkconfig iptables on (to turn on the firewall) remember to allow "ssh" using the admin tools on the head node.
On the compute node: chkconfig iptables off
10. to reboot all computers
ssh ge1
su
reboot
ssh ge1
su
ssh na1
reboot
ssh mg1
reboot
ssh al1
reboot
ssh si1
reboot
ssh p1
reboot
How to create a user account (yyyy) to run GAMESS
su
useradd yyyy
passwd yyyy
chsh -s /bin/csh yyyy
chown yyyy /home/yyyy
chgrp yingbin /home/yyyy
mkdir /scr/yyyy
chown yyyy /scr/yyyy
chgrp yingbin /scr/yyyy
ssh yyyy@ge1
cp ~yingbin/.cshrc .
vi .cshrc
ssh-keygen
cd .ssh
cp id_rsa.pub authorized_keys
ssh yyyy@ge1
ln -s ~yingbin/gamess ~yyyy/gamess
ssh yyyy@p1
mkdir /scr/yyyy
chown yyyy /scr/yyyy
chgrp yingbin /scr/yyyy