News - RunPod Blog

RunPod Blog

Sign in Subscribe

News

A collection of 18 posts

Run Larger LLMs on RunPod Serverless Than Ever Before - Llama-3 70B (and beyond!)

Language Models

Run Larger LLMs on RunPod Serverless Than Ever Before - Llama-3 70B (and beyond!)

Up until now, RunPod has only supported using a single GPU in Serverless, with the exception of using two 48GB cards (which honestly didn't help, given the overhead involved in multi-GPU setups for LLMs.) You were effectively limited to what you could fit in 80GB, so you would

Save the Date October 11th, 2:00 PM EST: Fireside Chat With RunPod CEO Zhen Lu And Data Science Dojo CEO Raja Iqbal On GPU-Powered AI Transformation

Join us for an engaging fireside chat with RunPod on the cutting-edge GPU solutions that are revolutionizing the ML landscape and driving seamless AI transformation. RunPod and Data Science Dojo are excited to collaborate in this fireside chat and provide insights into the cutting-edge GPU solutions reshaping the ML landscape

RunPod Partners With RandomSeed to Provide Accessible, User-Friendly Stable Diffusion API Access

RunPod is delighted to collaborate with RandomSeed by providing the serverless compute power required to create generative AI art through their API access. The mission of RandomSeed is to help developers build AI image generators by providing a hosted AUTOMATIC1111 API that can create images on-demand through API calls, saving

RunPod Partners with Data Science Dojo To Provide Compute For LLM Bootcamps

RunPod Partners with Data Science Dojo To Provide Compute For LLM Bootcamps

RunPod is delighted to collaborate with Data Science Dojo to offer a robust computing platform for their Large Language Model bootcamps. Leveraging our cutting-edge cloud services, RunPod empowers DSD's boot camp participants with a high-performance computing environment, enhancing the efficacy and competitiveness of their learning experience. You can

RunPod and Klangio Partner To Bring Music Transcription to Learners and Professionals Alike

RunPod and Klangio Partner To Bring Music Transcription to Learners and Professionals Alike

RunPod is pleased to be the service provider for Klangio, an up-and-coming name in audio space within the artificial intelligence community. Klangio leverages AI to automatically transcribe musical notes to human-readable notation, greatly accelerating the pace of music projects while seamlessly capturing every spontaneous facet of a live musical improvisation.

RunPod Roundup 4 - Open Source LLM Evaluators, 3D Scene Reconstruction, Vector Search

RunPod Roundup 4 - Open Source LLM Evaluators, 3D Scene Reconstruction, Vector Search

Welcome to the Runpod Roundup for the week ending August 19, 2023. In this issue, we'll be discussing the newest advancements in AI models over the past week, with a focus on new offerings that you can run in a RunPod instance right this second. In this issue,

RunPod RoundUp 3 - AI Music and Stock Sound Effect Creation

RunPod RoundUp 3 - AI Music and Stock Sound Effect Creation

Welcome to the Runpod Roundup for the week ending August 05, 2023. In this issue, we'll be discussing the newest advancements in AI models over the past week, with a focus on new offerings that you can run in a RunPod instance right this second. In this issue,

RunPod RoundUp 2 - 32k Token Context LLMs and New StabilityAI Offerings

RunPod RoundUp 2 - 32k Token Context LLMs and New StabilityAI Offerings

Welcome to the Runpod Roundup for the week ending July 29, 2023. In this issue, we'll be discussing the newest advancements in AI models over the past week, with a focus on new offerings that you can run in a RunPod instance right this second. In this issue,

Stable Diffusion XL 1.0 Released And Available On RunPod

Stable Diffusion

Stable Diffusion XL 1.0 Released And Available On RunPod

As discussed in the RunPod Roundup, Stable Diffusion XL is now available for the public and we've got you covered if you'd like to give it a shot. The Fast Stable Diffusion Template in RunPod has already been updated to take advantage of SDXL. Getting up

RunPod Partners With OpenCV To Provide GPU Power To Students

RunPod Partners With OpenCV To Provide GPU Power To Students

The next generation of AI-powered solutions is going to require processing power – and lots of it. OpenCV is a non-profit organization centered around the Open Source Computer Vision Library, which is devoted to driving computer vision applications in the world at large. OpenCV was one of the original pioneering groups

RunPod Roundup 1 - Inaugural Issue

RunPod Roundup 1 - Inaugural Issue

Welcome to the RunPod Roundup! In this week we'll be discussing new text and image generation models, including an exciting new Stable Diffusion model. The goal of RunPod Roundup is to keep you abreast of new developments over the week that you might have missed, with a focus

RunPod Partners With Defined.ai To Democratize and Accelerate AI Development

Runpod Platform

RunPod Partners With Defined.ai To Democratize and Accelerate AI Development

RunPod is excited to announce its partnership with Defined.ai, the world's largest marketplace of ethically sourced training datasets for AI models. This collaboration seeks to provide AI developers working with text-to-speech, speech-to-text models, and those fine-tuning LLMs the opportunity to access enterprise-grade conversational speech and text datasets.

Savings Plans Are Here For Secure Cloud Pods- How To Purchase a Monthly Plan And Save Big

Runpod Platform

Savings Plans Are Here For Secure Cloud Pods- How To Purchase a Monthly Plan And Save Big

If you are a frequent RunPod customer, you may be interested in our latest feature, Savings Plans. These plans allow you to invest in an up-front payment in a specific pod type that saves you more money the more you use you pod. For individuals with high workloads that anticipate

Run huggingface spaces on RunPod!

Run huggingface spaces on RunPod!

You can run any Huggingface space on Runpod! As every Huggingface space has options to run it with docker now this gives the option of running the space locally, which we can use to run the image with runpod here, 1. 7860 is the port being forwarded here in the

Pygmalion-7b from PygmalionAI has been released, and it's amazing

Text Generation

Pygmalion-7b from PygmalionAI has been released, and it's amazing

Last month, the latest iteration of the Pygmalion model was released. Although it is not that much larger as it is still only a 7b model compared to the commonly used 6b version, what it does with that parameter space has also been improved by leaps and bounds, especially with

Four Reasons To Set Up A Network Volume In the RunPod Secure Cloud

Four Reasons To Set Up A Network Volume In the RunPod Secure Cloud

Network Storage is a new RunPod feature (currently in beta) that works with our Secure Cloud data center-hosted pods. Normally, volumes for pods are destroyed irrecoverably after you terminate the pod, but this allows storage to persist and even be reassigned to different pods if needed. Here are several reasons

Ada Architecture Pods Are Here - How Do They Stack Up Against Ampere?

Ada Architecture Pods Are Here - How Do They Stack Up Against Ampere?

The Ada architecture is the latest architecture developed by Nvidia that is capable of achieving vastly improved performance on AI and HPC workloads compared to previous Nvidia GPU architectures. Ada also comes equipped with a new generation of Tensor Cores, which greatly accelerate matrix operations commonly used in deep learning

Spin up a Text Generation Pod with Vicuna And Experience a GPT-4 Rival

Spin up a Text Generation Pod with Vicuna And Experience a GPT-4 Rival

Why use Vicuna? The primary benefit of Vicuna is that it has a level of performance rivaled only by ChatGPT and Google Bard. The model has been tested across a wide variety of scenarios, including Fermi problems, roleplay scenarios, and math tasks, and a framework graded by GPT-4 showed that