Knowledge Hub · Sovereign AI

Can I get dedicated GPU capacity in South Africa from FirstNet's InfraAI service?

GPU & Inference · Answered by FirstNet Technology Services

Short answer

Yes. InfraAI, the GPU and inference service from FirstNet's AI business unit FirstCoreAI, offers both dedicated and shared GPU capacity on the AI Factory, sized to the workload and billed in rand.

In detail

The AI Factory runs current-generation NVIDIA Blackwell-class GPUs with AMD EPYC processors and more than a terabyte of system RAM per node, in FirstNet's South African data centre. Run.ai handles GPU-aware scheduling and vLLM serves inference.

What InfraAI capacity includes:

  • Dedicated or shared GPU options, sized to your workload.
  • Dedicated capacity instead of a shared public queue.
  • Private inference endpoints hosted locally, with every inference inside the South African perimeter.
  • Support from the engineers who run the Factory.
  • Rand-denominated, forecastable commercials with no FX surprises.

InfraAI suits high-volume document and call processing, RAG and retrieval back-ends, internal assistants, classification and extraction. On the production cluster, FirstCoreAI measured 271 concurrent requests sustained at peak with zero errors across its stress tests.

To size capacity for your workload, book a demo or scoping call with FirstCoreAI.

Source: FirstNet GPU & Inference service page →

Didn’t answer your question?

Call