Kohya LoRA on RunPod

Kohya LoRA on RunPod
Photo by Antoine Beauvillain / Unsplash

Our good friend SECourses has made some amazing videos showcasing how to run various genative art projects on RunPod. His latest video, titled "Kohya LoRA on RunPod", is a great introduction on how to get into using the powerful technique of LoRA (Low Rank Adaptation). Here's the paper if you're into that kind of stuff: https://arxiv.org/abs/2106.09685.

LoRA is a very valuable technique because it allows one to create a relatively lightweight file to apply on top of existing models that augment the output. This is similar to the concept of textual inversion, but can achieve some very impressive results without having to resort to generating an entirely new model. A full model can be anywhere from 2-8GB, but a LoRA file is usually less than 100MB! The Kohya project has been very popular for investigating LoRA, but it is fairly difficult to install correctly on some machines. This excellent SECourses video walks through the installation step-by-step.

We hope you enjoy and make sure to share anything cool you make in our discord channel!