Truefoundry - TrueFoundry Blog

TrueFoundry Blog

Truefoundry

Benchmarking Llama-2-7B

Benchmarking Llama-2-7B

This blog captures Llama 2 7B benchmarks - where a model excels and the areas where it struggles. Make informed decisions about its practical deployment. In this blog, we have benchmarked the Llama-2-7B model from NousResearch on huggingface.

AI Center of Excellence

AI Center of Excellence: Future-proof your business

In this blog we cover what is an Artificial Intelligence (AI) center of excellence and how it is important for companies to meaningfully explore AI/ML use cases which can impact both their bottom-line and top-line effectively. Artificial Intelligence (AI) is no longer a futuristic concept that belongs in science

Training Machine Learning Models using TrueFoundry's Jobs

Engineering and Product

Training Machine Learning Models using TrueFoundry's Jobs

Introduction In this blog, we will introduce you to training machine learning models on the TrueFoundry Platform. We will discuss how we can run training jobs on TrueFoundry. We will also see how you can perform hyperparameter tuning easily for your machine-learning models, and run your jobs on GPUs. Problem

How to Fine-Tune a Llama-2 (7B) to Beat ChatGPT

How to Fine-Tune a Llama-2 (7B) to Beat ChatGPT

Large language models (LLMs) are becoming increasingly powerful, and they are being used for a variety of tasks, including chatbots, text generation, and question-answering. However, LLMs can be expensive and resource-intensive to train. In this blog post, we will show you how to fine-tune a smaller LLM (7B) to perform

ML Machine Learning Platform Slack LLM SlackGPT MLOps

True ML Talks #17 - ML Platforms @ Slack, LLMs and SlackGPT

We are back with another episode of True ML Talks. In this, we dive deep into Slack's Recommend API, SlackGPT and LLM's and we are speaking with Katrina Ni. Katrina Ni is a senior ML engineer as well as a lead member of the technical staff at Slack. She has

LLMOps CoE: The next frontier in the MLOps Landscape

LLMOps CoE: The next frontier in the MLOps Landscape

In this blog, we will explore the importance of LLMOps and how it tackles the challenges associated with LLMs, such as iteration, prompt management and testing complexities. We also go a step further and suggest how you can get started on your LLMOps journey. Large language models (LLMs) have caused

Hosted Jupyter Notebooks and VS Code on Kubernetes

Engineering and Product

Hosted Jupyter Notebooks and VS Code on Kubernetes

Jupyter notebooks are a powerful and popular tool that provides an interactive computing environment, combining code, data visualization, and explanatory text, making it easier to work with data and share insights. Data scientists use Jupyter notebooks for various tasks throughout the data analysis and machine learning lifecycle like exploratory data

TrueFoundry's team offsite and hackathon

Unleashing Innovation: Highlights from TrueFoundry's Internal Hackathon

At TrueFoundry, we are dedicated to developing an integrated platform solution that empowers data scientists to experiment, version, fine-tune and deploy their ML/LLM models with ease. Alongside our customer-focused endeavours, we believe in fostering a culture of innovation and providing our team with the opportunity to explore their ideas

True ML Talks #14 - LLMs and Reinforcement Learning Co-founder @ CX Score

True ML Talks #14 - LLMs and Reinforcement Learning Co-founder @ CX Score

We are back with another episode of True ML Talks. In this, we again dive deep into LLMs, Reinforcement Learning, and CX Score and we are speaking with Ashwin Rao. Ashwin Rao is a distinguished professional with a diverse background in academia, industry leadership, and entrepreneurship. He is currently a

Machine Learning Tool Integrations #2 DVC for your Data Versioning

Engineering and Product

Machine Learning Tool Integrations #2 DVC for your Data Versioning

Data version control (DVC) is a powerful tool for managing and versioning large datasets and models in machine learning projects. DVC is an open-source tool that works with a wide range of storage options, including local disk, network file systems, Amazon S3, Google Cloud Storage, and many others. DVC can

TrueFoundry with ML Platform Lead of Cookpad

True ML Talks #13 - ML Platform @ Cookpad

We are back with another episode of True ML Talks. In this, we'll delve deep into the ML architecture at Cookpad, one of the world's largest recipe service platforms. We will also cover the challenges of building a successful machine learning platform, how they use Nvidia triton inference server to

TrueFoundry supports LLMs

Engineering and Product

TrueFoundry Now Deploys and Fine-tunes Open Source LLMs With a Few Clicks!

TrueFoundry offers an intuitive solution for LLM deployment and fine-tuning. With our Model Catalogue, companies can self-host LLMs on Kubernetes, reducing inference costs by 10x in just one click. Discover how to deploy a Dolly-v2-3b model and fine-tune a Pythia-70m using TrueFoundry in our blog.

TrueFoundry with Cofounder of LLama-Index

True ML Talks #12 - Cofounder @ Llama-Index

We are back with another episode of True ML Talks. In this, we dive deep into Llama-Index, and we are speaking with Jerry Liu. Jerry Liu is the creator and co-founder of LlamaIndex. He brings his expertise in ML research and engineering from esteemed companies like Uber, Quora, and Robust

TrueFoundry with CTO of Greenhouse discussing about LLMs and GenAI

True ML Talks #11 - LLMs, LLMops and GenAI CTO @ Greenhouse

We are back with another episode of True ML Talks. In this, we again dive deep into LLMs, LLMops and Generative AI, and we are speaking with Michael Boufford. Michael is the CTO of Greenhouse who joined as the first employee about 11 years ago, and so wrote the first

Open Source LLMs

Engineering and Product

Open Source LLMs: Embrace or Perish

We speak with many enterprises and business leaders who are trying to figuring out their strategy for using LLMs in this pedestal of AI - should we go OpenAI or OpenSource LLMs? There are many good blogs that showcase the pros and cons of different approaches with neutral sentiment. We

Innovating with LLMS: Anant, Engineering Director at Meta

True ML Talks #10 - LLMs and GenAI with engineering director @ Meta

We are back with another episode of True ML Talks. In this, we dive deep into LLM's and Generative AI's, and we are speaking with Anant. Anant is an engineering leader. Currently, an engineering director at Meta, working on some of the smart glasses product experiences. He started as an

TrueFoundry with Head of ML Platform at DoorDash

True ML Talks #9 - Machine Learning Platform @ DoorDash

We are back with another episode of True ML Talks. In this, we dive deep into DoorDash's ML Platform, and we are speaking with Hien Luu. Hien Luu is the Senior Engineering Manager at DoorDash, building the build out of DoorDash's ML platform. DoorDash, as everyone knows, is one of

TrueFoundry with ALops platform prinicipal engineer from Intuit

True ML Talks #8 - Machine Learning Platform @ Intuit

We are back with another episode of True ML Talks. In this, we dive deep into Intuit's ML Platform NumaFlow, and we are speaking with Vigith Maurice. Vigith is the principal engineer at Intuit for the AI ops platform. As anyone who has used TurboTax, Credit Karma, Mint, QuickBooks and

Machine Learning Platform integrations #1: Weights & Biases

Machine Learning Platform Integrations #1: Weights & Biases

Experimentation tracking is a critical aspect of machine learning development, enabling practitioners to manage and track the progress of their experiments efficiently. Experimentation tracking involves recording and monitoring various factors, such as model performance, hyperparameters, and training data, to gain insights into the performance of the machine learning model. Challenges

TrueFoundry with Head of Data Science and ML from Edge

True ML Talks #7 - Machine Learning Platform @ Edge

We are back with another episode of True ML Talks. In this, we dive deep into Edge ML Platform, and we are speaking with Rahul Kulhari. Introducing Rahul Kulhari, the co-founder and head of data science at Edge. With a strong background in AI and machine learning, Rahul is responsible

TrueFoundry with Nomad CTO discussing ML in Healthcare

True ML Talks #6 - Machine Learning Platform @ °Nomad Health

We are back with another episode of True ML Talks. In this, we dive deep into °Nomad Health's ML Platform, and we are speaking with Liming Zhao. Liming Zhao, is the CTO at °Nomad Health, a technology company revolutionizing the healthcare staffing industry. With clinicians in short supply, particularly in

Understanding ChatGPT plugins

Engineering and Product

Understanding ChatGPT plugins

ChatGPT is a powerful language model that can understand and respond to user inputs. It has many useful features built-in, but sometimes users need additional functionality that isn't available out of the box. That's where plugins come in. Plugins are add-ons that extend the capabilities of ChatGPT. They allow users

TrueFoundry discussing about Machine Learning Operations at Simpl, a fintech startup

True ML Talks #5 - Machine Learning Platform @ Simpl

We are back with another episode of True ML Talks. In this, we dive deep into Simpl's ML Platform, and we are speaking with Sheekha. Sheekha is the Director of Data Science at Simpl. Simpl is building India's leading first tap checkout network where they provide merchants with an entire

TrueFoundry with Salseforce Einstein AI and Skiff Engineer

True ML Talks #4 - Machine Learning Platform @ Salesforce

We are back with another episode of True ML Talks. In this, we dive deep into Salesforce's ML Platform, and we are speaking with Arpeet Kale. Arpeet was part of the engineering team at Salesforce that built the entire ML platform. He is one of the founders of Builders Fund,

The Nvidia GPU stack on Kubernetes

Engineering and Product

Enabling the Large Language Models Revolution: GPUs on Kubernetes

🚀 Why GPUs? Large language models like ChatGPT and diffusion models like Stable Diffusion have taken the world by storm in just under a year. More and more organisations are now beginning to leverage Generative AI for their existing and exciting new use cases. While most companies can directly start using