Pipeline: Add Runpod docker configuration (#222)

* Begin work on Runpod docker config

* Reduce docker image size

* Create .dockerignore
This commit is contained in:
2026-05-12 00:44:09 -04:00
committed by GitHub
parent 26635ace84
commit b8ebe03921
17 changed files with 425 additions and 90 deletions

View File

@@ -89,6 +89,7 @@ LlamaGenerator::LlamaGenerator(
}
n_ctx_ = sampling.n_ctx;
n_gpu_layers_ = options.generator.n_gpu_layers;
this->Load(model_path);
}