Skip Nav

High Performance Computing Systems

Builder Builder


Builder is a single-node Aspen Systems Linux Gigabyte server intended primarily to provide a platform for building and sharing Singularity software containers. The system is populated with AMD 7742 processors and Nvidia V100 graphics processing units. Builder uses Intel Gigabit Ethernet as its high-speed network for I/O traffic. Builder uses AVAGO MegaRAID to manage its local file system that targets 130 TB of disk storage. Builder is equipped with two 64-core processors (128 total cores) running the RHEL 8 operating system, two GPUs, 1024 gigabytes of memory, with no user-accessible swap space.

Node Configuration
Login/Compute 1
Total Nodes 1
Operating System RedHat Linux 8
Cores/Nodes 128
Core Type AMD EPYC 7742 + 2x NVIDIA V100
Core Speed 2.25 GHz
Memory/Node 1024 GBytes +64 GBytes HBM
User Accessible Memory/Node 1000GBytes
Memory Model Shared on node
Interconnect Type XL710 for 40GbE QSFP+ to cwfs, I350 Gigabit Network Connection to DREN

File Systems on Builder
File System System Type
/home ($HOME) User Quota  1.5TB local ssd, xfs, 50GB
/raid/projdir ($PROJECTS_HOME) 80TB local raid, xfs
/raid/workdir ($WORKDIR) User Quota 51TB local raid, xfs, 14 day min file retention, 200GB
/ssd 3TB Singularity scratch disk
/p/cwfs ($CENTER) nfs, 120 day min file retention

Reef Reef


Reef is an Aspen Systems Linux Cluster. The login and compute nodes are populated with Intel 2.5-Ghz Cascade Lake processors. Reef has 5 CPU-only and 11 GPU compute nodes. Each compute node has two 20-core processors, sharing 768 GBytes of DDR4 memory, with no user accessible swap space. Reef has 109 TBytes (formatted) of disk storage. Reef is intended to be used as a batch scheduled HPC system.
Node Configuration
  Login Nodes Compute Nodes
    Standard
Memory
Telsa V100 GPU
Accelerated
Quadro RTX 8000 GPU
Accelerated
Total Cores | Nodes 40 Cores | 1 Nodes 200 Cores | 5 Nodes 360 Cores | 9 Nodes 80 Cores | 2 Nodes
Operating System RHEL 7 RHEL 7 RHEL 7 RHEL 7
Cores/Nodes 38 Core 38 Core 38 Cores 38 Cores
Processor Type Dual Intel Xeon Gold 6248 Cascade Lake
(20 cores/socket)
Dual Intel Xeon Gold 6248 Cascade Lake
(20 cores/socket)
Dual Intel Xeon Gold 6248 Cascade Lake
(20 cores/socket)
Dual Intel Xeon Gold 6248 Cascade Lake
(20 cores/socket)
Processor Speed 2.5 GHz 2.5 GHz 2.5 GHz 2.5 GHz
Memory/Node 768GB 768GB 768GB 768GB
Usable Memory/Node 640GB 640GB 640GB 640GB
Interconnect Type Mellanox HDR100, EDR InfiniBand Mellanox HDR100, EDR InfiniBand Mellanox HDR100, EDR InfiniBand Mellanox HDR100, EDR InfiniBand

File Systems on Reef
Path Capacity Type User Quota Minimum File
Retention Time
/work1/scratch ($WORKDIR) User Quota 138 TBytes Luster None 30 days
/work2/home ($HOME) 108 TBytes Ceph 50 GBytes None
/p/cwfs ($CENTER) 753 TBytes NFS None 120 days