Knowledge Hub · Sovereign AI

Do I need to rewrite my application to use FirstNet's InfraAI GPU and inference service?

GPU & Inference · Answered by FirstNet Technology Services

Short answer

No. Every model on InfraAI, the GPU and inference service from FirstNet's AI business unit FirstCoreAI, is exposed through an OpenAI-compatible API, so any SDK that already works with OpenAI works with InfraAI. You only swap in the endpoint URLs and credentials issued at onboarding.

In detail

InfraAI runs on the AI Factory in FirstNet's South African data centre. Applications call standard endpoints:

  • /v1/chat/completions for chat and coding
  • /v1/embeddings for search and retrieval
  • /v1/audio/transcriptions for speech-to-text
  • /v1/rerank for retrieval reranking

Your application authenticates with OAuth2 client credentials and receives a short-lived bearer token. TLS terminates at the cluster edge and each request is validated. Your token endpoint and URLs are issued at onboarding, and existing OpenAI SDKs work without code changes.

For an application already built on an OpenAI SDK, moving to InfraAI is a configuration change rather than a rebuild. The difference is where it runs: inference then happens in South Africa, on dedicated or shared GPU capacity sized to the workload, with rand-denominated billing.

Source: FirstNet GPU & Inference service page →

Didn’t answer your question?

Call