Skip to content

Commit

Permalink
Bump inference image 0.1.40 (#435)
Browse files Browse the repository at this point in the history
0.1.40
  • Loading branch information
margaretqian committed Sep 6, 2023
1 parent f5f0e36 commit 1813eaf
Show file tree
Hide file tree
Showing 6 changed files with 6 additions and 6 deletions.
2 changes: 1 addition & 1 deletion examples/inference-deployments/mpt/mpt_30b.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name: mpt-30b
compute:
gpus: 2
gpu_type: a100_40gb
image: mosaicml/inference:0.1.37
image: mosaicml/inference:0.1.40
replicas: 1
default_model:
model_type: mpt-30b
2 changes: 1 addition & 1 deletion examples/inference-deployments/mpt/mpt_30b_chat.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name: mpt-30b-chat
compute:
gpus: 2
gpu_type: a100_40gb
image: mosaicml/inference:0.1.37
image: mosaicml/inference:0.1.40
replicas: 1
default_model:
model_type: mpt-30b-chat
2 changes: 1 addition & 1 deletion examples/inference-deployments/mpt/mpt_30b_instruct.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name: mpt-30b-instruct
compute:
gpus: 2
gpu_type: a100_40gb
image: mosaicml/inference:0.1.37
image: mosaicml/inference:0.1.40
replicas: 1
default_model:
model_type: mpt-30b-instruct
2 changes: 1 addition & 1 deletion examples/inference-deployments/mpt/mpt_7b.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name: mpt-7b
compute:
gpus: 1
instance: oci.vm.gpu.a10.1
image: mosaicml/inference:0.1.37
image: mosaicml/inference:0.1.40
replicas: 1
default_model:
model_type: mpt-7b
2 changes: 1 addition & 1 deletion examples/inference-deployments/mpt/mpt_7b_instruct.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name: mpt-7b-instruct
compute:
gpus: 1
instance: oci.vm.gpu.a10.1
image: mosaicml/inference:0.1.37
image: mosaicml/inference:0.1.40
replicas: 1
default_model:
model_type: mpt-7b-instruct
2 changes: 1 addition & 1 deletion examples/inference-deployments/mpt/mpt_7b_storywriter.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name: mpt-7b-storywriter
compute:
gpus: 1
instance: oci.vm.gpu.a10.1
image: mosaicml/inference:0.1.37
image: mosaicml/inference:0.1.40
replicas: 1
default_model:
model_type: mpt-7b-storywriter

0 comments on commit 1813eaf

Please sign in to comment.