TrueFoundry Blog (Page 2)

TrueFoundry Blog

TrueFoundry supports LLMs

Engineering and Product

TrueFoundry Now Deploys and Fine-tunes Open Source LLMs With a Few Clicks!

TrueFoundry offers an intuitive solution for LLM deployment and fine-tuning. With our Model Catalogue, companies can self-host LLMs on Kubernetes, reducing inference costs by 10x in just one click. Discover how to deploy a Dolly-v2-3b model and fine-tune a Pythia-70m using TrueFoundry in our blog.

TrueFoundry with Cofounder of LLama-Index

True ML Talks #12 - Cofounder @ Llama-Index

We are back with another episode of True ML Talks. In this, we dive deep into Llama-Index, and we are speaking with Jerry Liu. Jerry Liu is the creator and co-founder of LlamaIndex. He brings his expertise in ML research and engineering from esteemed companies like Uber, Quora, and Robust

TrueFoundry with CTO of Greenhouse discussing about LLMs and GenAI

True ML Talks #11 - LLMs, LLMops and GenAI CTO @ Greenhouse

We are back with another episode of True ML Talks. In this, we again dive deep into LLMs, LLMops and Generative AI, and we are speaking with Michael Boufford. Michael is the CTO of Greenhouse who joined as the first employee about 11 years ago, and so wrote the first

Open Source LLMs

Engineering and Product

Open Source LLMs: Embrace or Perish

We speak with many enterprises and business leaders who are trying to figuring out their strategy for using LLMs in this pedestal of AI - should we go OpenAI or OpenSource LLMs? There are many good blogs that showcase the pros and cons of different approaches with neutral sentiment. We

Innovating with LLMS: Anant, Engineering Director at Meta

True ML Talks #10 - LLMs and GenAI with engineering director @ Meta

We are back with another episode of True ML Talks. In this, we dive deep into LLM's and Generative AI's, and we are speaking with Anant. Anant is an engineering leader. Currently, an engineering director at Meta, working on some of the smart glasses product experiences. He started as an

Prompt Engineering

Prompt Engineering: Learning to Interact with LLMs

The emergence of ChatGPT / OpenAI and other Large Language Models (LLMs) has revolutionized the world and is one of the most significant technological advancements of the past decade. With the help of AI, we can now automate numerous day-to-day tasks that were once mundane and time-consuming. However, to fully leverage

TrueFoundry with Head of ML Platform at DoorDash

True ML Talks #9 - Machine Learning Platform @ DoorDash

We are back with another episode of True ML Talks. In this, we dive deep into DoorDash's ML Platform, and we are speaking with Hien Luu. Hien Luu is the Senior Engineering Manager at DoorDash, building the build out of DoorDash's ML platform. DoorDash, as everyone knows, is one of

TrueFoundry with ALops platform prinicipal engineer from Intuit

True ML Talks #8 - Machine Learning Platform @ Intuit

We are back with another episode of True ML Talks. In this, we dive deep into Intuit's ML Platform NumaFlow, and we are speaking with Vigith Maurice. Vigith is the principal engineer at Intuit for the AI ops platform. As anyone who has used TurboTax, Credit Karma, Mint, QuickBooks and

Engineering and Product

Application Development With Kubernetes

Kubernetes is widely regarded as the ideal platform for teams in large and mid-size organizations with high availability and autoscaling requirements. However, it has also added friction to existing developer workflows. This change can be understood as part of a broader push towards the adoption of the micro-service paradigm and

Machine Learning Platform integrations #1: Weights & Biases

Machine Learning Platform Integrations #1: Weights & Biases

Experimentation tracking is a critical aspect of machine learning development, enabling practitioners to manage and track the progress of their experiments efficiently. Experimentation tracking involves recording and monitoring various factors, such as model performance, hyperparameters, and training data, to gain insights into the performance of the machine learning model. Challenges

Engineering and Product

Authenticated gRPC service on Kubernetes

Adding basic authentication to a service hosted on Kubernetes

Commercial LLMs

Engineering and Product Featured

Large Language Models for Commercial Use

This blog explains what a license is for LLM models and why it is important. We resolve any doubts that you might have about the licensing of these models so that you do not run into legal troubles while using, modifying, or sharing them.

TrueFoundry with Head of Data Science and ML from Edge

True ML Talks #7 - Machine Learning Platform @ Edge

We are back with another episode of True ML Talks. In this, we dive deep into Edge ML Platform, and we are speaking with Rahul Kulhari. Introducing Rahul Kulhari, the co-founder and head of data science at Edge. With a strong background in AI and machine learning, Rahul is responsible

TrueFoundry with Nomad CTO discussing ML in Healthcare

True ML Talks #6 - Machine Learning Platform @ °Nomad Health

We are back with another episode of True ML Talks. In this, we dive deep into °Nomad Health's ML Platform, and we are speaking with Liming Zhao. Liming Zhao, is the CTO at °Nomad Health, a technology company revolutionizing the healthcare staffing industry. With clinicians in short supply, particularly in

Understanding ChatGPT plugins

Engineering and Product

Understanding ChatGPT plugins

ChatGPT is a powerful language model that can understand and respond to user inputs. It has many useful features built-in, but sometimes users need additional functionality that isn't available out of the box. That's where plugins come in. Plugins are add-ons that extend the capabilities of ChatGPT. They allow users

TrueFoundry discussing about Machine Learning Operations at Simpl, a fintech startup

True ML Talks #5 - Machine Learning Platform @ Simpl

We are back with another episode of True ML Talks. In this, we dive deep into Simpl's ML Platform, and we are speaking with Sheekha. Sheekha is the Director of Data Science at Simpl. Simpl is building India's leading first tap checkout network where they provide merchants with an entire

TrueFoundry with Salseforce Einstein AI and Skiff Engineer

True ML Talks #4 - Machine Learning Platform @ Salesforce

We are back with another episode of True ML Talks. In this, we dive deep into Salesforce's ML Platform, and we are speaking with Arpeet Kale. Arpeet was part of the engineering team at Salesforce that built the entire ML platform. He is one of the founders of Builders Fund,

The Nvidia GPU stack on Kubernetes

Engineering and Product

Enabling the Large Language Models Revolution: GPUs on Kubernetes

🚀 Why GPUs? Large language models like ChatGPT and diffusion models like Stable Diffusion have taken the world by storm in just under a year. More and more organisations are now beginning to leverage Generative AI for their existing and exciting new use cases. While most companies can directly start using

Building MLOps platform at Facebook

True ML Talks #3 - Machine Learning Platform @ Facebook

We are back with another episode of True ML Talks. In this, we dive deep into Facebook's FBLearner Flow, Facebook's AI backbone and we are speaking with Aditya Kalro. Aditya is currently a Senior Engineering Manager at Google in the Identity team, and prior to this, Aditya was at Facebook,

Machine Learning on Kubernetes #2: Kubernetes Architecture for MLOps

Engineering and Product

Machine Learning on Kubernetes #2: Kubernetes Architecture for MLOps

Machine learning operations (MLOps) is a critical component of modern data science workflows. MLOps involves the development, deployment, and management of machine learning models and associated infrastructure. One of the key challenges of MLOps is the need for scalable and flexible infrastructure that can accommodate the unique requirements of ML

TrueFoundry with CEO of DAGworks and ex ML Lead at Stitch Fix

True ML Talks #2 - Machine Learning Workflow @ Stitch Fix

We received a very encouraging response to our first episode of True ML Talks. In this series, we dive deep into the ML pipeline of a few leading ML companies, and in today's episode, we are speaking with Stefan Krawczyk. Stefan is building DAGWorks, a collaborative open-source platform for data

MLOps on Kubernetes

Machine Learning on Kubernetes #1 - Introduction to Scalable MLOps on Kubernetes

Welcome to this series on building and setting up scalable Machine Learning infrastructure on a Kubernetes environment. In this series, we will cover various topics related to the development, deployment, and management of machine learning models on a Kubernetes cluster. Building a Scalable Machine Learning Infrastructure Machine Learning Operations, commonly

Evaluating Production Readiness and Technical Debt of ML Systems

Thought Leadership

Evaluating Production Readiness and Technical Debt of ML Systems

Machine learning (ML) is revolutionising various industries and applications, ranging from healthcare and finance to self-driving cars and fraud detection. However, deploying ML systems in production environments is challenging due to various factors, such as technical debt and the lack of production readiness. Technical debt is an ongoing concern for

TrueFoundry with Noam Lotner from Gong

True ML Talks #1 - Machine Learning Workflow @ Gong

Today, TrueFoundry is launching a Machine Learning Deep Dive Series where we talk to ML and Data Science Leaders across Companies using ML to dive into the usecases and workflows of ML within their organizations. As part of this series, we will be hosting and diving deeper into the ML

Fine Tuning: OpenAI Models + Your Confluence Data

If ChatGPT is the iPhone, then the AppStore is yet to be built- and that will be a suite of vertical applications built on top of it. Every industry, every business, and every individual is going to build these applications in small and big ways. Starting from building a healthcare