diff options
| author | aura <nw@moneybot.cc> | 2026-02-17 22:39:42 +0100 |
|---|---|---|
| committer | aura <nw@moneybot.cc> | 2026-02-17 22:39:42 +0100 |
| commit | 636b0323075225c584b62719ed51e75521bb7ffb (patch) | |
| tree | 61b02271b6d0695a4beffc23fb6eb062a7da22c3 /modelfiles/mistral-small.modelfile | |
push source
Diffstat (limited to 'modelfiles/mistral-small.modelfile')
| -rw-r--r-- | modelfiles/mistral-small.modelfile | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/modelfiles/mistral-small.modelfile b/modelfiles/mistral-small.modelfile new file mode 100644 index 0000000..0843cc7 --- /dev/null +++ b/modelfiles/mistral-small.modelfile @@ -0,0 +1,18 @@ +FROM mistral-small:22b-instruct-2409-q4_0 + +TEMPLATE """{{- range $i, $_ := .Messages }} +{{- if eq .Role "system" }} +[INST]{{ .Content }} +[/INST] +{{- else if eq .Role "user" }} +[INST]{{ .Content }} +[/INST] +{{- else if eq .Role "assistant" }} +{{- if .Content }} {{ .Content }} {{ if not (eq (len (slice $.Messages $i)) 1) }}</s>{{ end }}{{ end }} +{{- else if eq .Role "tool" }}[TOOL_RESULTS] {"content": {{ .Content }}} [/TOOL_RESULTS] +{{- end }} +{{- end }}""" +PARAMETER stop [INST] +PARAMETER stop [/INST] +PARAMETER stop </s> + |