ML Frameworks¶

This tutorial provides examples of using the load-test-http experiment chart with various Kubernetes app/serverless/ML frameworks. Refer to load-test-http usage to learn more about this chart.

Dear Iter8 community

These examples are maintained by members of the Iter8 community, and may become outdated. If you find that something is not working, lend a helping hand and fix it in a PR. More examples are always welcome.

Knative¶

Before you begin

Install Iter8.
Install Knative and deploy your first Knative Service. As noted at the end of the Knative tutorial, when you curl the Knative service,
```
curl http://hello.default.127.0.0.1.sslip.io
```
you should see the expected output as follows.
```
Hello World!
```

Download experiment chart.

iter8 hub -e load-test-http
cd load-test-http

1. Run experiment¶

We will load test and validate SLOs for the Knative HTTP service using by running an Iter8 experiment.

The iter8 run command combines an experiment chart with values, generates the experiment.yaml file, runs the experiment, and writes results into the result.yaml file. Run the experiment as follows.

iter8 run --set url=http://hello.default.127.0.0.1.sslip.io \
          --set SLOs.error-rate=0 \
          --set SLOs.latency-mean=50 \
          --set SLOs.latency-p90=100 \
          --set SLOs.latency-p'97\.5'=200

In the above experiment, the following SLOs are validated for the Knative service. - error rate is 0 - mean latency is under 50 msec - 90^th percentile latency is under 100 msec - 97.5^th percentile latency is under 200 msec

2. Assert outcomes¶

Assert that the experiment completed without any failures and SLOs are satisfied.

iter8 assert -c completed -c nofailure -c slos

3. View report¶

View a report of the experiment in HTML or text formats as follows.

HTMLText

iter8 report -o html > report.html
# open report.html with a browser. In MacOS, you can use the command:
# open report.html

iter8 report -o text