Podcast: Best Practices for Generative AI Production Deployment with Lukas Biewald

ODSC - Open Data Science
3 min readAug 26, 2024

--

Learn about cutting-edge developments in AI and data science from the experts who know them best on ODSC’s Ai X Podcast. Each week, we release an interview with a leading expert, core contributor, experienced practitioner, or acclaimed instructor who is helping to shape the future of the AI industry through their work or research.

In this episode, Lukas Biewald, the founder and CEO of Weights & Biases, joins us to discuss the best practices for generative AI in production and his experience as an entrepreneur and investor.

Prior to founding Weights & Biases, one of the go-to platforms for machine learning, Lukas co-founded Figure Eight (formerly CrowdFlower), a pioneer in the ML data-labeling space that was subsequently acquired by Appen in 2019.

In this discussion, Lukas covers the best practices for integrating GenAI into production, with a particular focus on the importance of robust evaluation frameworks and key metrics for tracking performance. He also shares insights on using Weights & Biases and the newest platform, Weave, for model evaluation and strategies for effective model monitoring.

Finally, he touches on the non-deterministic nature of GenAI models and shares his perspective on the current AI landscape.

Then get ready to switch gears and explore the current landscape of startups and investment. Check out the Podcast topics below,

Topics:

– Introduction

– Tell us about your journey

Best practices for getting GenAI into Production

– Set the context. Tell us about WandB

– What are some of the best practices for getting into GenAI right now?

– How are companies handling model evaluation?

– Tell us about Weave

– What about model monitoring?

– How are companies handling the non-deterministic nature of GenAI models?

– What part of GenAI is overhyped?

– What is underhyped?

– Is the stack going to get more complex and are better tools needed?

Startups and Investing

– What are some of the biggest lessons you’ve learned as a successful entrepreneur?

– What do you look for in startups?

– When founders ask you for advice, what questions should they ask more?

– How do you hire great engineering talent in a very competitive market?

– What do you like to read in your downtime?

– How can people follow your work?

Show Notes

Learn more about the platforms:

Weave: https://wandb.github.io/weave/

Weights and Bias: https://github.com/wandb

Blog: https://wandb.ai/fully-connected

Listen to Lukas’ Podcast: https://podcasts.apple.com/us/podcast/gradient-dissent-conversations-on-ai/id1504567418

Learn more about the Guardrails project:

https://github.com/outlines-dev/outlines

https://github.com/guardrails-ai/guardrails

Learn more about Edward Rutherfurd’s Books:

https://www.edwardrutherfurd.com/edward-rutherfurd-books.html

Start listening now to get the full impact of Lukas’ extensive knowledge and expertise and don’t forget to subscribe to ODSC’s Ai X Podcast to ensure you never miss an episode. Finally, like what you hear? Leave a review or share it with a friend! You can listen on Spotify, Apple, and SoundCloud.To take an even deeper dive into AI topics and tools, and their effects on society at large, join us at one of our upcoming conferences, ODSC APAC (August 13th, Free Virtual), ODSC Europe (September 5–6, Hybrid, or ODSC West (October 29–31, Hybrid).

Originally posted on OpenDataScience.com

Read more data science articles on OpenDataScience.com, including tutorials and guides from beginner to advanced levels! Subscribe to our weekly newsletter here and receive the latest news every Thursday. You can also get data science training on-demand wherever you are with our Ai+ Training platform. Interested in attending an ODSC event? Learn more about our upcoming events here.

--

--

ODSC - Open Data Science
ODSC - Open Data Science

Written by ODSC - Open Data Science

Our passion is bringing thousands of the best and brightest data scientists together under one roof for an incredible learning and networking experience.

No responses yet