RunPod Blog (Page 3)

RunPod Blog

Sign in Subscribe

Configurable Endpoints for Deploying Large Language Models

Configurable Endpoints for Deploying Large Language Models

RunPod introduces Configurable Templates, a powerful feature that allows users to easily deploy and run any large language model. With this feature, users can provide the Hugging Face model name and customize various template parameters to create tailored endpoints for their specific needs. Why Use Configurable Templates? Configurable Templates offer

Orchestrating RunPod's Workloads Using dstack

Orchestrating RunPod's Workloads Using dstack

Today, we're announcing the integration between Runpod and dstack, an open-source orchestration engine, that aims to simplify the development, training, and deployment of AI models while leveraging the open-source ecosystem. What is dstack? While dstack shares a number of similarities with Kubernetes, it is more lightweight and focuses

Revolutionizing Real Estate: Virtual Staging AI's Success Story with RunPod

Revolutionizing Real Estate: Virtual Staging AI's Success Story with RunPod

Virtual Staging AI, an innovative startup from the Harvard Innovation Lab, is transforming the real estate industry by leveraging cutting-edge AI technology and RunPod's powerful GPU infrastructure. Their state-of-the-art solution enables realtors to virtually stage properties in just 30 seconds at a fraction of the cost of traditional

Generate Images with Stable Diffusion on RunPod

Generate Images with Stable Diffusion on RunPod

💡RunPod is hosting an AI art contest, find out more on our Discord in the #art-contest channel. In this tutorial, you will learn how to generate images using Stable Diffusion, a powerful text-to-image model, on the RunPod platform. By following the step-by-step instructions, you'll set up the prerequisites,

Announcing RunPod’s Integration with SkyPilot

Announcing RunPod’s Integration with SkyPilot

RunPod is excited to announce its latest integration with SkyPilot, an open-source framework for running LLMs, AI, and batch jobs on any cloud. This collaboration is designed to significantly enhance the efficiency and cost-effectiveness of your development process, particularly for training, fine-tuning, and deploying models. What is SkyPilot? SkyPilot is

Elevating Veterinary Care: A Customer Success Story with ScribbleVet and RunPod

Customer Success

Elevating Veterinary Care: A Customer Success Story with ScribbleVet and RunPod

Discover how ScribbleVet transformed veterinary care with RunPod's AI technology, showcasing our commitment to empowering businesses and enhancing service quality.

Introducing the A40 GPUs: Revolutionize Machine Learning with Unmatched Efficiency

Introducing the A40 GPUs: Revolutionize Machine Learning with Unmatched Efficiency

In the rapidly evolving world of artificial intelligence and machine learning, the need for powerful, cost-effective hardware has never been more critical. The launch of the A40 GPUs marks a significant milestone in this journey, offering unparalleled performance and affordability. These GPUs are designed to cater to the needs of

RunPod's Latest Innovation: Dockerless CLI for Streamlined AI Development

RunPod's Latest Innovation: Dockerless CLI for Streamlined AI Development

Discover the future of AI development with RunPod's Dockerless CLI tool. Experience seamless deployment, enhanced performance, and intuitive design, revolutionizing how you bring AI projects from concept to reality.

Embracing New Beginnings: Welcoming Banana.dev Community to RunPod

Runpod Platform

Embracing New Beginnings: Welcoming Banana.dev Community to RunPod

RunPod extends a warm welcome to the Banana.dev community, offering a supportive transition to our platform. Honoring the path paved by Banana.dev, we commit to empowering developers with innovative serverless solutions.

Maximizing AI Efficiency on a Budget: The Unbeatable Value of NVIDIA A40 and A6000 GPUs for Fine-Tuning LLMs

Maximizing AI Efficiency on a Budget: The Unbeatable Value of NVIDIA A40 and A6000 GPUs for Fine-Tuning LLMs

Harnessing Power and Economy in AI Hardware In the dynamic world of AI, the balance between cutting-edge performance and cost-effectiveness is a crucial consideration for those fine-tuning large language models (LLMs). While the allure of NVIDIA's flagship H100 and A100 GPUs is undeniable, the focus of this exploration

A Fresh Chapter in RunPod's Documentation Saga: Embracing Docusaurus for Enhanced User Experience

DocumentationOverhaul

A Fresh Chapter in RunPod's Documentation Saga: Embracing Docusaurus for Enhanced User Experience

Discover RunPod's revamped documentation, now more intuitive and user-friendly. Our recent overhaul with Docusaurus offers a seamless, engaging experience, ensuring easy access to our comprehensive GPU computing resources. Explore at docs.runpod.io

New Navigational Changes To RunPod UI

Runpod Platform

New Navigational Changes To RunPod UI

Today, we are releasing a brand new look to the RunPod control panel, resulting in saved clicks and faster navigation through the platform. A few key changes will need some attention as you get acclimated. Here's a quick rundown of what has changed! GPU Cloud Secure and Community

Serverless | Migrating and Deploying Cog Images on RunPod Serverless from Replicate

Serverless | Migrating and Deploying Cog Images on RunPod Serverless from Replicate

Switching cloud platforms or migrating existing models can often feel like a Herculean task, especially when it necessitates additional developmental efforts. This guide aims to simplify this process for individuals who have deployed models via replicate.com or utilized the Cog framework. Through a few straightforward steps, you'll

Use alpha_value To Blast Through Context Limits In LLaMa-2 Models

Use alpha_value To Blast Through Context Limits In LLaMa-2 Models

With 4k context being the norm for Llama-2 and its finetunes, it's a far cry from the "bad old days" of the 2k limits found in Pygmalion-6b and other previous landmark models. But what if I told you that you could just set an arbitrarily high

Save the Date October 11th, 2:00 PM EST: Fireside Chat With RunPod CEO Zhen Lu And Data Science Dojo CEO Raja Iqbal On GPU-Powered AI Transformation

Join us for an engaging fireside chat with RunPod on the cutting-edge GPU solutions that are revolutionizing the ML landscape and driving seamless AI transformation. RunPod and Data Science Dojo are excited to collaborate in this fireside chat and provide insights into the cutting-edge GPU solutions reshaping the ML landscape

How To Manage Funding Your RunPod Account

Runpod Platform

How To Manage Funding Your RunPod Account

At RunPod, we want to be wholly transparent about how how we manage billing clients, since we know that discussing financial matters can be a very charged conversation. We want to equip you with every tool available to ensure that your pods run smoothly without interruption due to a low

RunPod Partners With RandomSeed to Provide Accessible, User-Friendly Stable Diffusion API Access

RunPod is delighted to collaborate with RandomSeed by providing the serverless compute power required to create generative AI art through their API access. The mission of RandomSeed is to help developers build AI image generators by providing a hosted AUTOMATIC1111 API that can create images on-demand through API calls, saving

RunPod Partners with Data Science Dojo To Provide Compute For LLM Bootcamps

RunPod Partners with Data Science Dojo To Provide Compute For LLM Bootcamps

RunPod is delighted to collaborate with Data Science Dojo to offer a robust computing platform for their Large Language Model bootcamps. Leveraging our cutting-edge cloud services, RunPod empowers DSD's boot camp participants with a high-performance computing environment, enhancing the efficacy and competitiveness of their learning experience. You can

RunPod Serverless Pricing Update

RunPod Serverless Pricing Update

We have some good news! We're revamping Serverless pricing to improve our user experience for individuals, startups, and enterprises. The bad news is that if you haven't moved your cloud compute workloads to RunPod yet, that decision might keep you up at night! With new price

What You'll Need to Run Falcon 180B In a Pod

Text Generation

What You'll Need to Run Falcon 180B In a Pod

September 6th was a momentous day in large language model history, as Falcon-180 was released by the Technology Innovation Institute. To date, this is the single largest open-source LLM released to the public (edging out BLOOM-176b from 2022.) For quite some time, whether it was technical concerns or simply market

RunPod and Klangio Partner To Bring Music Transcription to Learners and Professionals Alike

RunPod and Klangio Partner To Bring Music Transcription to Learners and Professionals Alike

RunPod is pleased to be the service provider for Klangio, an up-and-coming name in audio space within the artificial intelligence community. Klangio leverages AI to automatically transcribe musical notes to human-readable notation, greatly accelerating the pace of music projects while seamlessly capturing every spontaneous facet of a live musical improvisation.

Lessons While Using Generative Language and Audio For Practical Use Cases

Text Generation

Lessons While Using Generative Language and Audio For Practical Use Cases

Generative AI makes developers lives much easier - but by how much? I have been learning German for the past year, and one of the things I thought would be personally useful would be to generate many conversations in German - via voice, which be extremely useful for me to

RunPod Roundup 5 - Visual/Language Comprehension, Code-Focused LLMs, and Bias Detection

RunPod Roundup 5 - Visual/Language Comprehension, Code-Focused LLMs, and Bias Detection

Welcome to the Runpod Roundup for the week ending August 26, 2023. In this issue, we'll be discussing the newest advancements in AI models over the past week, with a focus on new offerings that you can run in a RunPod instance right this second. In this issue,