Platform Setup for KFServing¶

1. Create Kubernetes cluster¶

Create a local cluster using Kind, Minikube, or CodeReady Containers as follows, or use a managed Kubernetes cluster. Ensure that the cluster has sufficient resources, for example, 8 CPUs and 12GB of memory.

Kind

kind create cluster --wait 5m
kubectl cluster-info --context kind-kind

Ensuring your Kind cluster has sufficient resources

Your Kind cluster inherits the CPU and memory resources of its host. If you are using Docker Desktop, you can set its resources as shown below.

Resources

Minikube

minikube start --cpus 8 --memory 12288

CodeReady Containers

crc start --cpus 8 --memory 12288

2. Clone Iter8 repo¶

git clone https://github.com/iter8-tools/iter8.git
cd iter8
export ITER8=$(pwd)

3. Install KFServing, Iter8 and Telemetry¶

Setup KFServing, Iter8, a mock New Relic service, and Prometheus add-on within your cluster.

$ITER8/samples/kfserving/quickstart/platformsetup.sh