Skip to content

Commit

Permalink
Merge pull request opendatahub-io#119 from leseb/standalone-req-doc
Browse files Browse the repository at this point in the history
docs: more explicit serving endpoint requirement
  • Loading branch information
tumido authored Oct 22, 2024
2 parents 18cf4a6 + 4cd6754 commit 5fc496b
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion standalone/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -156,7 +156,11 @@ The `standalone.py` script is designed to run within a Kubernetes environment. T
* A [StorageClass](https://kubernetes.io/docs/concepts/storage/storage-classes/) that supports dynamic provisioning with [ReadWriteMany](https://kubernetes.io/docs/concepts/storage/persistent-volumes/#access-modes) access mode.
* A Kubernetes configuration that allows access to the Kubernetes cluster.
* Both cluster and in-cluster configurations are supported.
* SDG data generated and uploaded to an object store.
* SDG data [generated](https://docs.instructlab.ai/adding-data-to-model/creating_new_knowledge_or_skills/#generate-a-synthetic-dataset) and uploaded to an object store.
* Serving endpoint available for the
[evaluation](https://docs.instructlab.ai/adding-data-to-model/creating_new_knowledge_or_skills/#evaluate-the-newly-trained-model)
phase (judge model). Using
[prometheus-8x7b-v2.0](https://huggingface.co/prometheus-eval/prometheus-8x7b-v2.0) as a model is recommended.

> [!NOTE]
> The script can be run outside of the cluster from the command-line, but it requires that the user is currently logged into a Kubernetes cluster.
Expand Down

0 comments on commit 5fc496b

Please sign in to comment.