Demo customer portal
Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Back to homepage

Cluster Information

Alt text


FortiGate

Your cluster’s firewall appliance. It provide network protection and remote access services. All traffic into and out of your cluster is mediated by the FortiGate firewall appliance.

SSL-VPN web portal

Endpoint: https://127.0.0.1:10443/
Username: rakuten
Password: provided by Lambda during hand-off

This portal provides a simple way of directly accessing your cluster from your browser.

Admin web portal

Endpoint: https://10.148.0.200
Username: admin
Password: provided by Lambda during hand-off

This portal enables you to do various administrative tasks, including user management. Note that the admin web portal has two endpoints for high availability. If you want to do administrative tasks, first try using gi-primary; if it’s down, try gi-secondary.


Networking

Subnets

CIDR Use cases
In-band 10.141.0.0/24 Accessing Ubuntu OS on GPU nodes and head nodes
Out-of-band 10.148.0.0/24
  • Accessing BMC dashboards of GPU nodes and CPU nodes
  • Accessing FortiNet admin web portal
  • Managing PDUs
  • Managing network devices

Network devices

Hostname Role IP address
lambda-1g-leaf-01 Out-of-band switch 10.148.0.202
lambda-10g-leaf-01 In-band switch 10.148.0.203
slc-xen-ndrsw-01 InfiniBand switch 10.148.0.210

Primary PDUs

Username: admn
Password: provided by Lambda during hand-off

PDU number Admin endpoint MAC address
1 https://10.148.0.191 00:0A:9C:66:8F:40
2 https://10.148.0.192 00:0A:9C:66:85:F2

CPU nodes

Specs

  • Software: Ubuntu 22.04
  • Chassis: Supermicro A+ Server 1114CS-TNR
  • CPU: AMD EPYC 7513 (32 cores, 2.6 GHz)
  • Memory: 256 GB (8 x 32 GB 3200 MHz ECC RAM)
  • OS storage: 1.92 TB SATA SSD
  • Extra storage: 1.92 TB NVMe SSD
  • NIC: ConnectX-6 VPI, dual-port, 200 gbps

Network information

Hostname In-band MACs In-band IP address IPMI MACs IPMI endpoint
slc-xen-headnode-1
  • 7C:C2:55:9D:BE:86
  • 7C:C2:55:9D:BE:87
10.141.0.254 3C:EC:EF:D8:7F:B4 https://10.148.0.254
slc-xen-login-01
  • 7C:C2:55:9D:BE:68
  • 7C:C2:55:9D:BE:69
10.141.0.251 3C:EC:EF:E0:E0:FC https://10.148.0.251
slc-xen-login-02
  • 7C:C2:55:9F:12:58
  • 7C:C2:55:9F:12:59
10.141.0.252 3C:EC:EF:E0:ED:30 https://10.148.0.252

GPU nodes

Specs

  • Software: Ubuntu 22.04, OFED, Lambda Stack (PyTorch, TensorFlow, NVIDIA drivers, CUDA, cuDNN)
  • Chassis: AS-8125GS-TNHR
  • CPU: AMD EPYC 9654 (96 cores, 2.4 GHz)
  • GPUs: 8x NVIDIA H100 GPUs, SXM5, NVLink and NVSwitch connected
  • Memory: 1.5 TB (24 x 64 GB 3200 MHz DDR4 ECC RAM)
  • Storage: 1x 3.84 TB NVMe, 2x 7.68 TB NVMes
  • NICs: 8x ConnectX-7, single-port, 400 gbps

Network information

Hostname In-band MACs In-band IP address IPMI MACs IPMI endpoint
slc-xen-h100-001
  • 3C:EC:EF:AB:FA:5C
  • 3C:EC:EF:AB:FA:5D
10.141.0.101 7C:C2:55:5F:06:13 https://10.148.0.101
slc-xen-h100-002
  • 3C:EC:EF:AB:F4:D6
  • 3C:EC:EF:AB:F4:D7
10.141.0.102 7C:C2:55:5F:0C:B5 https://10.148.0.102
slc-xen-h100-003
  • 3C:EC:EF:AC:04:00
  • 3C:EC:EF:AC:04:01
10.141.0.103 7C:C2:55:5E:F5:79 https://10.148.0.103
slc-xen-h100-004
  • 3C:EC:EF:AB:F8:B4
  • 3C:EC:EF:AB:F8:B5
10.141.0.104 7C:C2:55:5E:F5:7C https://10.148.0.104
slc-xen-h100-005
  • 3C:EC:EF:AC:0A:64
  • 3C:EC:EF:AC:0A:65
10.141.0.105 7C:C2:55:5E:F5:76 https://10.148.0.105