Skip to content

upgrade to llama b11321 #1002

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ramon-reichert merged 1 commit into from
Oct 1, 2026
Merged

upgrade to llama b11321 #1002

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .manual/chapter-02-installation.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -314,7 +314,7 @@ kronk libs --list-installs

# Install the supported version using its exact release manifest pin.
kronk libs --local \
--version=b11256@sha256:75a055b5c166996523aaf233925be283ff1c4ed54645866ecbc2994f540607b4
--version=b11321@sha256:e3866933604dd02ae45e0b20e802a75f6053fcd2abc12d01b48d4bcffaa33923

# Explicitly select CPU instead of an available GPU.
KRONK_PROCESSOR=cpu kronk libs --local
Expand Down
4 changes: 2 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -116,13 +116,13 @@ Here are some of the known compatible versions:

| kronk | yzma | llama.cpp | bucky | whisper.cpp | malina | stable-diffusion.cpp |
| --------- | ------- | --------- | ------ | ----------- | ------ | -------------------- |
| 1.32.7-rc | 0af2b85 | b11256 | v1.1.3 | v1.9.4 | v1.1.5 | master-929-3f8527a |
| 1.32.7-rc | daaa4da | b11321 | v1.1.3 | v1.9.4 | v1.1.5 | master-929-3f8527a |
| 1.32.6 | ece4890 | b10896 | v1.1.2 | v1.9.3 | v1.1.0 | master-849-d04e895 |
| 1.32.5 | v1.26.0 | v0.4.0 | v1.1.2 | v1.9.3 | v1.0.8 | master-841-6b3edaa |
| 1.32.4 | 6bd0208 | b10785 | v1.1.1 | v1.9.3 | v1.0.6 | master-841-6b3edaa |

Kronk 1.32.7-rc pins the llama.cpp manifest as
`b11256@sha256:75a055b5c166996523aaf233925be283ff1c4ed54645866ecbc2994f540607b4`.
`b11321@sha256:e3866933604dd02ae45e0b20e802a75f6053fcd2abc12d01b48d4bcffaa33923`.
The manifest authenticates the platform-specific archives selected by the downloader,
so the default installation verifies both the manifest and the downloaded libraries.
Malina v1.1.5 pins stable-diffusion.cpp as
Expand Down
38 changes: 34 additions & 4 deletions cmd/server/api/frontends/bui/package-lock.json
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion cmd/server/api/frontends/bui/src/components/DocsManual.tsx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -324,7 +324,7 @@ kronk libs --list-installs

# Install the supported version using its exact release manifest pin.
kronk libs --local \\
--version=b11256@sha256:75a055b5c166996523aaf233925be283ff1c4ed54645866ecbc2994f540607b4
--version=b11321@sha256:e3866933604dd02ae45e0b20e802a75f6053fcd2abc12d01b48d4bcffaa33923

# Explicitly select CPU instead of an available GPU.
KRONK_PROCESSOR=cpu kronk libs --local`}</code></pre>
Expand Down
2 changes: 1 addition & 1 deletion cmd/server/api/frontends/bui/src/components/DocsSDKModel.tsx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ export default function DocsSDKModel() {
<div className="doc-section" id="func-inityzmaworkarounds">
<h4>InitYzmaWorkarounds</h4>
<pre className="code-block">
<code>func InitYzmaWorkarounds(_ string) error</code>
<code>func InitYzmaWorkarounds(libPath string) error</code>
</pre>
<p className="doc-description">InitYzmaWorkarounds initializes Kronk-specific Yzma compatibility code.</p>
</div>
Expand Down
180 changes: 90 additions & 90 deletions cmd/server/api/services/kronk/static/assets/index.js
View file
Open in desktop

Large diffs are not rendered by default.

8 changes: 4 additions & 4 deletions examples/go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ require (
github.com/ardanlabs/kronk v1.32.7
github.com/duckdb/duckdb-go/v2 v2.10506.0
github.com/gen2brain/malgo v0.11.26
github.com/hybridgroup/yzma v1.28.1-0.20260928145547-0af2b85d4102
github.com/hybridgroup/yzma v1.28.1-0.20261001182953-daaa4da3a5f3
golang.org/x/image v0.46.0
)

Expand All @@ -21,7 +21,7 @@ require (
cloud.google.com/go/compute/metadata v0.10.0 // indirect
cloud.google.com/go/iam v1.14.0 // indirect
cloud.google.com/go/monitoring v1.31.0 // indirect
cloud.google.com/go/storage v1.68.0 // indirect
cloud.google.com/go/storage v1.69.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/detectors/gcp v1.38.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/metric v0.62.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/internal/resourcemapping v0.62.0 // indirect
Expand Down Expand Up @@ -67,7 +67,7 @@ require (
github.com/go-viper/mapstructure/v2 v2.5.0 // indirect
github.com/goccy/go-json v0.11.2 // indirect
github.com/google/flatbuffers v25.12.19+incompatible // indirect
github.com/google/s2a-go v0.1.10 // indirect
github.com/google/s2a-go v0.1.11 // indirect
github.com/google/uuid v1.6.0 // indirect
github.com/googleapis/enterprise-certificate-proxy v0.3.22 // indirect
github.com/googleapis/gax-go/v2 v2.26.2 // indirect
Expand Down Expand Up @@ -120,7 +120,7 @@ require (
golang.org/x/sys v0.48.0 // indirect
golang.org/x/text v0.42.0 // indirect
golang.org/x/time v0.16.0 // indirect
google.golang.org/api v0.299.0 // indirect
google.golang.org/api v0.300.0 // indirect
google.golang.org/genproto v0.0.0-20260928230214-8a89bd6388cc // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20260928230214-8a89bd6388cc // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20260928230214-8a89bd6388cc // indirect
Expand Down
20 changes: 10 additions & 10 deletions examples/go.sum
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@ cloud.google.com/go/longrunning v1.3.0 h1:lZ6c8SJJBmILp/Wnr3vGnBLa0q+cYfSHRCcUfV
cloud.google.com/go/longrunning v1.3.0/go.mod h1:wpgLxCn+UA3/TZ1bj/fW39mfDpwVlMPu1xKJyoMt7V0=
cloud.google.com/go/monitoring v1.31.0 h1:LCuAoYiq8snyL/eDAG/VC73uWFXeax8+YEfmoNGJUrY=
cloud.google.com/go/monitoring v1.31.0/go.mod h1:7uk2dIJIf7ra64dI1VuQ0ttoFqvtKjdzq46u6zNP1hU=
cloud.google.com/go/storage v1.68.0 h1:gqrAMJ51OZjYgU6AJ2U60um90YQhSjq8HEIQNtJ4C/8=
cloud.google.com/go/storage v1.68.0/go.mod h1:UsS9OgFg/XHOSYakQ8ZtLWWeyGkk1WnmD/GsGfN0BHM=
cloud.google.com/go/storage v1.69.0 h1:jAAMC1411HEh78nKsU0Zns+eFj3TnhjAWIhg5Ud/XBM=
cloud.google.com/go/storage v1.69.0/go.mod h1:PELYsxTYm2peE4mwLEC1+mS1dA/kUSRUxNv56rOy44g=
cloud.google.com/go/trace v1.16.0 h1:GmQovzFc5F0CNfl0VLgL64aoTtu7xsM0YajW2GlG9+E=
cloud.google.com/go/trace v1.16.0/go.mod h1:r+bdAn16dKLSV1G2D5v3e58IlQlizfxWrUfjx7kM7X0=
github.com/GoogleCloudPlatform/opentelemetry-operations-go/detectors/gcp v1.38.0 h1:rmzbFS2CkHq0y2L5LkMVWm+QXjjNEXxjmhrJqga/QGk=
Expand Down Expand Up @@ -133,8 +133,8 @@ github.com/google/go-cmp v0.7.0 h1:wk8382ETsv4JYUZwIsn6YpYiWiBsYLSJiTsyBybVuN8=
github.com/google/go-cmp v0.7.0/go.mod h1:pXiqmnSA92OHEEa9HXL2W4E7lf9JzCmGVUdgjX3N/iU=
github.com/google/martian/v3 v3.3.3 h1:DIhPTQrbPkgs2yJYdXU/eNACCG5DVQjySNRNlflZ9Fc=
github.com/google/martian/v3 v3.3.3/go.mod h1:iEPrYcgCF7jA9OtScMFQyAlZZ4YXTKEtJ1E6RWzmBA0=
github.com/google/s2a-go v0.1.10 h1:EMp+aOuXN6l8cE/gjF5Bt+vyZxsUuyCWe9chDWR/+uU=
github.com/google/s2a-go v0.1.10/go.mod h1:pz4tyvwXvJLLbyrkh6FW1eS2zPUXMaTmyNhYtyP2tNw=
github.com/google/s2a-go v0.1.11 h1:7v1V1TraNGP63WptsAkNqr2w8jgm4vM6A6qx6Lsw9iM=
github.com/google/s2a-go v0.1.11/go.mod h1:pz4tyvwXvJLLbyrkh6FW1eS2zPUXMaTmyNhYtyP2tNw=
github.com/google/uuid v1.6.0 h1:NIvaJDMOsjHA8n1jAhLSgzrAzy1Hgr+hNrb57e+94F0=
github.com/google/uuid v1.6.0/go.mod h1:TIyPZe4MgqvfeYDBFedMoGGpEw/LqOeaOT+nhxU+yHo=
github.com/googleapis/enterprise-certificate-proxy v0.3.22 h1:NU4XpII6jD+Dxcot94fqjE+AfJoE/lQP9q3faYGzC/c=
Expand All @@ -154,8 +154,8 @@ github.com/hashicorp/go-getter v1.8.9 h1:1AOTMUmz/S/GuqOTE6+bg6nwPXTEbKr3Tc/T/lV
github.com/hashicorp/go-getter v1.8.9/go.mod h1:qI7vH/m552bXutKe4UkWptOJl4bo2KeO/CSOoh4s0ps=
github.com/hashicorp/go-version v1.9.0 h1:CeOIz6k+LoN3qX9Z0tyQrPtiB1DFYRPfCIBtaXPSCnA=
github.com/hashicorp/go-version v1.9.0/go.mod h1:fltr4n8CU8Ke44wwGCBoEymUuxUHl09ZGVZPK5anwXA=
github.com/hybridgroup/yzma v1.28.1-0.20260928145547-0af2b85d4102 h1:gO7iUuD/V5Uam5S1HffjKVhXp3d4Ix8IVD2HvM24qQA=
github.com/hybridgroup/yzma v1.28.1-0.20260928145547-0af2b85d4102/go.mod h1:ovV3WQ5v3X53vqo9Izg/28QHEXaVasW9b4Kgkhk05T0=
github.com/hybridgroup/yzma v1.28.1-0.20261001182953-daaa4da3a5f3 h1:KY8+vu7tQipRSq7piiSSLu1pGAjb5+ymKTAXuC034aA=
github.com/hybridgroup/yzma v1.28.1-0.20261001182953-daaa4da3a5f3/go.mod h1:ovV3WQ5v3X53vqo9Izg/28QHEXaVasW9b4Kgkhk05T0=
github.com/icza/bitio v1.1.0 h1:ysX4vtldjdi3Ygai5m1cWy4oLkhWTAi+SyO6HC8L9T0=
github.com/icza/bitio v1.1.0/go.mod h1:0jGnlLAx8MKMr9VGnn/4YrvZiprkvBelsVIbA9Jjr9A=
github.com/icza/mighty v0.0.0-20180919140131-cfd07d671de6 h1:8UsGZ2rr2ksmEru6lToqnXgA8Mz1DP11X4zSJ159C3k=
Expand Down Expand Up @@ -216,8 +216,8 @@ go.opentelemetry.io/otel/exporters/otlp/otlptrace v1.46.0 h1:OFnwLJr+pF3iHrlGSzb
go.opentelemetry.io/otel/exporters/otlp/otlptrace v1.46.0/go.mod h1:716wFneO0ov19A2beH5hjfh9AK5z/VWNAtDijp1Y0/g=
go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc v1.46.0 h1:w53CDeOA/Kurp7yRsegSr6pbbr759dOvJ+yNmWM6Hxs=
go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc v1.46.0/go.mod h1:BOmGMCbAtvcJiSJ+hLuhgPLdDbimnraSl8irz3iY8sY=
go.opentelemetry.io/otel/exporters/stdout/stdoutmetric v1.44.0 h1:hqxVTu/GtBF+vJ8d1fzW7fRxZFvgoDjWcxwwCaFDYpU=
go.opentelemetry.io/otel/exporters/stdout/stdoutmetric v1.44.0/go.mod h1:z5fVEF4X5v0ESvlJqBrrFlBVoj5EQuefZpzsu7R+x5Q=
go.opentelemetry.io/otel/exporters/stdout/stdoutmetric v1.45.0 h1:dm9iyzn6tioYZtwqaiBSU0TSI8Yu/8dTIbfG0+B49DY=
go.opentelemetry.io/otel/exporters/stdout/stdoutmetric v1.45.0/go.mod h1:xAvxYjYK28qvt+yu4BYZ/zMmAjwMXINXD6JiMyeB8iI=
go.opentelemetry.io/otel/metric v1.46.0 h1:yBnkXvgV7AXFILZc5K6IZe/CBFF3OS7BJ8ov6/lj0K8=
go.opentelemetry.io/otel/metric v1.46.0/go.mod h1:iPmdWqifKUdzziPkvvzIJXITl56fQx2mGM/DHLB3/2o=
go.opentelemetry.io/otel/metric/x v0.68.0 h1:TA/cBT23D3MnxYPwHL7YFOdYGdx0A0v+s7Mzotpd1dU=
Expand Down Expand Up @@ -257,8 +257,8 @@ golang.org/x/time v0.16.0 h1:vMb6ptszcQMkcwiRTAuNNU50gom6++Q/6gY2hDM6VDE=
golang.org/x/time v0.16.0/go.mod h1:rVKOqvZeKvrDKTQiAHJ7wmwP0RzleSphoEA9RcdLA0s=
gonum.org/v1/gonum v0.17.0 h1:VbpOemQlsSMrYmn7T2OUvQ4dqxQXU+ouZFQsZOx50z4=
gonum.org/v1/gonum v0.17.0/go.mod h1:El3tOrEuMpv2UdMrbNlKEh9vd86bmQ6vqIcDwxEOc1E=
google.golang.org/api v0.299.0 h1:b3K+ydSMd0kh6TQI6bJyApRQfqQX2MfSOaVkpM59mJw=
google.golang.org/api v0.299.0/go.mod h1:zlR3GVA8b2R5nv5Ij9UWe37StVB3cxDD7DBFi4ZFsHw=
google.golang.org/api v0.300.0 h1:2rvPV2bqnPuHOaF4gGOBiT1IIc6JVXYyHCkZeqdzjNk=
google.golang.org/api v0.300.0/go.mod h1:tKfTSDfK+0FlOVl8N30VL5fU5TuaEkJjvdyTIKNwzPg=
google.golang.org/genproto v0.0.0-20260928230214-8a89bd6388cc h1:MBreUmlUQ+UROuto7tVQeNrZxy9ZxJsajKJQwWa8mLE=
google.golang.org/genproto v0.0.0-20260928230214-8a89bd6388cc/go.mod h1:JUQe2nbekxMCka0JpW+abO6SMvrY4Gk3+Cnl84QtcCg=
google.golang.org/genproto/googleapis/api v0.0.0-20260928230214-8a89bd6388cc h1:rZHRz0ogq4Pid1IKtA/ivHi8XONVF5tqUQXA2TtgpkE=
Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step1/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -190,7 +190,9 @@ func initYzma() error {
return fmt.Errorf("unable to load library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("unable to initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())

return nil
Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step2/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -429,7 +429,9 @@ func initYzma() error {
return fmt.Errorf("unable to load library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("unable to initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())

return nil
Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step3/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -766,7 +766,9 @@ func initYzma() error {
return fmt.Errorf("unable to load library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("unable to initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())

return nil
Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step4/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -271,7 +271,9 @@ func initYzma() error {
return fmt.Errorf("unable to load mtmd library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("unable to initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())
mtmd.LogSet(llama.LogSilent())

Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step5/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -558,7 +558,9 @@ func initYzma() error {
return fmt.Errorf("unable to load yzma speculative bindings: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("unable to initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())
mtmd.LogSet(llama.LogSilent())

Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step6/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,9 @@ func initYzma() error {
return fmt.Errorf("unable to load library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("unable to initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())

return nil
Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step7/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -366,7 +366,9 @@ func initYzma() error {
return fmt.Errorf("unable to load library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("unable to initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())

return nil
Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step8/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -386,7 +386,9 @@ func initYzma() error {
return fmt.Errorf("load library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())

return nil
Expand Down
4 changes: 3 additions & 1 deletion examples/yzma/step9/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -238,7 +238,9 @@ func initYzma() error {
return fmt.Errorf("load library: %w", err)
}

llama.Init()
if err := llama.Init(); err != nil {
return fmt.Errorf("initialize llama: %w", err)
}
llama.LogSet(llama.LogSilent())

return nil
Expand Down
10 changes: 5 additions & 5 deletions go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,8 +13,9 @@ require (
github.com/google/go-cmp v0.7.0
github.com/hashicorp/go-getter v1.8.9
github.com/hashicorp/go-version v1.9.0
github.com/hybridgroup/yzma v1.28.1-0.20260928145547-0af2b85d4102
github.com/hybridgroup/yzma v1.28.1-0.20261001182953-daaa4da3a5f3
github.com/icza/mjpeg v0.0.0-20230330134156-38318e5ab8f4
github.com/jupiterrider/ffi v0.8.0
github.com/maypok86/otter/v2 v2.3.0
github.com/modelcontextprotocol/go-sdk v1.8.0
github.com/open-policy-agent/opa v1.21.1
Expand Down Expand Up @@ -44,7 +45,7 @@ require (
cloud.google.com/go/compute/metadata v0.10.0 // indirect
cloud.google.com/go/iam v1.14.0 // indirect
cloud.google.com/go/monitoring v1.31.0 // indirect
cloud.google.com/go/storage v1.68.0 // indirect
cloud.google.com/go/storage v1.69.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/detectors/gcp v1.38.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/metric v0.62.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/internal/resourcemapping v0.62.0 // indirect
Expand Down Expand Up @@ -86,7 +87,7 @@ require (
github.com/goccy/go-json v0.11.2 // indirect
github.com/google/flatbuffers v25.12.19+incompatible // indirect
github.com/google/jsonschema-go v0.4.3 // indirect
github.com/google/s2a-go v0.1.10 // indirect
github.com/google/s2a-go v0.1.11 // indirect
github.com/google/uuid v1.6.0 // indirect
github.com/googleapis/enterprise-certificate-proxy v0.3.22 // indirect
github.com/googleapis/gax-go/v2 v2.26.2 // indirect
Expand All @@ -97,7 +98,6 @@ require (
github.com/hashicorp/go-cleanhttp v0.5.2 // indirect
github.com/icza/bitio v1.1.0 // indirect
github.com/inconshreveable/mousetrap v1.1.0 // indirect
github.com/jupiterrider/ffi v0.8.0 // indirect
github.com/klauspost/compress v1.20.1 // indirect
github.com/lestrrat-go/blackmagic v1.0.4 // indirect
github.com/lestrrat-go/dsig v1.4.0 // indirect
Expand Down Expand Up @@ -140,7 +140,7 @@ require (
golang.org/x/net v0.59.0 // indirect
golang.org/x/oauth2 v0.37.0 // indirect
golang.org/x/time v0.16.0 // indirect
google.golang.org/api v0.299.0 // indirect
google.golang.org/api v0.300.0 // indirect
google.golang.org/genproto v0.0.0-20260928230214-8a89bd6388cc // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20260928230214-8a89bd6388cc // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20260928230214-8a89bd6388cc // indirect
Expand Down
Loading
Loading