What a slot gets

A slot gives you one GPU instance for the booked window, and nobody else uses it. You pay for the booked hours, including GST, from prepaid credit.

The block sets the GPU type and the GPU count. Every slot line prints them. A job always uses the hardware it was booked on.

The instance

Instance typeGPUsvCPUMemoryLocal NVMeNetwork
p5.4xlarge1 × NVIDIA H100, 80 GB HBM316256 GiB1 × 3.84 TB100 Gbps EFA, without GPUDirect RDMA [verify]
p5.48xlarge8 × NVIDIA H100, 80 GB HBM3 each, NVLink1922,048 GiB8 × 3.84 TB3,200 Gbps EFA, with GPUDirect RDMA [verify]

On p5.4xlarge, NCCL over EFA needs FI_HMEM_DISABLE_P2P=1 in the job's environment.

What each job gets inside the slot

Resourcep5.4xlargep5.48xlarge
Memory limit (memory.max)240 GiB: the instance's memory less 16 GiB for the host2,032 GiB
/dev/shm64 GiB, a quarter of memory512 GiB
SwapOffOff
Locked memoryUnlimitedUnlimited
Transparent huge pagesOn request (madvise)On request (madvise)
Image sizeUp to 200 GB compressedUp to 200 GB compressed
Working diskThe local NVMe, encrypted with a key held only in memoryAll eight NVMe devices as one encrypted volume

Paths inside the container

Time

The job receives SIGTERM 60 seconds before the slot ends, and SIGKILL at the end. If the job saves to /hangar/checkpoints on SIGTERM, it resumes from there in your next slot.

If a job reaches a memory or disk limit, the job ends abnormally. The certificate gives the reason, and Hangar keeps the last checkpoint.

Network

A job reaches the names on the account's egress allowlist over HTTPS (port 443). Hangar stages the job's data from Sydney storage before the job starts.

Inside the slot, the worker looks up each listed name and passes the job's connection to that name unchanged. The connection stays encrypted from the job to the service.

Hangar refuses each name lookup or connection outside the list, and records the refusal on the job certificate. Allowlist entries are host names, such as huggingface.co. Set them in the account policy.

Read this page as Markdown