This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

In this episode of the Eye on AI podcast, join us as we dive into the realm of AI quality assurance with Mohamed Elgendy, CEO and co-founder of Kolena.

Discover the intricacies of ensuring robust AI performance as Mohamed shares his journey from a software engineer to leading an AI quality platform. Kolena is setting new standards in AI testing, addressing the non-deterministic nature of machine learning models with a systematic framework for validation.

The conversation navigates the challenges of AI testing, the importance of structured quality assurance, and the collaboration with industry bodies to shape the future of AI standards. Mohamed elaborates on Kolena's innovative approach to both human and automated evaluations, providing comprehensive testing solutions tailored to diverse customer needs.

We also explore real-world use cases and the platform's future plans to make AI testing more accessible and reliable. Mohamed's insights illuminate the path toward achieving high-quality AI systems, ensuring they perform as intended across various applications.

Tune in to understand the advancements propelling AI quality forward and how Kolena is pioneering the way in this crucial aspect of AI development.

Don't forget to like, subscribe, and hit the notification bell for more insights into the technologies driving the AI revolution.

This episode is sponsored by Shopify. Shopify is a commerce platform that allows anyone to set up an online store and sell their products. Whether you’re selling online, on social media, or in person, Shopify has you covered on every base. With Shopify you can sell physical and digital products. You can sell services, memberships, ticketed events, rentals and even classes and lessons.

Sign up for a $1 per month trial period at http://shopify.com/eyeonai

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting and resetting passwords. A single data breach costs millions of dollars. 1Password secures every sign-in to save you time and money.

Right now, my listeners get a free 2-week trial at: https://www.1password.com/eyeonai

In this episode of Eye on AI, join us as we explore the cutting-edge world of GPU optimization with Ronen Dar, CTO and co-founder of Run:ai.

Delve into the intricacies of managing and maximizing GPU utilization in an era marked by a severe GPU shortage. Ronen shares his insights on how Run:ai's innovative software is revolutionizing AI infrastructure, making GPU resources more efficient and accessible.

The conversation spans the technical challenges of scaling AI models, the evolution of GPU demands from basic algorithms to complex systems like GPT-4, and the strategic innovations helping enterprises overcome these hurdles. Ronen also reflects on the future of AI development, predicting an exponential increase in demand for computational power and the innovative solutions poised to meet these needs.

Tune in to uncover the technological advancements that are propelling AI capabilities forward and shaping the future of AI deployment across industries.

Don't forget to like, subscribe, and hit the notification bell for more deep dives into the technologies that are transforming our digital landscape.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview

(02:46) Introducing Ronen Dar

(04:00) Ronen's background and RunAI's origins

(09:13) The need for efficient GPU utilization in AI

(13:14) RunAI's core value proposition

(15:33 RunAI's deployment model

(18:55) The growing demand for compute power and GPUs

(22:08) Challenges in scaling models beyond 70 billion parameters

(27:52) RunAI's open platform approach

(31:00) Addressing latency and throughput challenges in inference

(34:36) RunAI's integration with AI tools and frameworks

(39:37) Reducing the cost of inference with GPU virtualization

(43:54) Challenges in auto-scaling for large language models

(47:06) The future of the GPU market and demand

(50:49) NVIDIA's dominance and the role of competitors like Cerebras

(54:20) RunAI's global customer base and demand patterns

(57:52) NVIDIA's vision and the evolution of GPU architectures

(01:01:25) Compute requirements for the metaverse and future AI applications

(01:03:56) Concerns about power consumption and carbon footprint

This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.

NetSuite is offering a one-of-a-kind flexible financing program. Head to https://netsuite.com/EYEONAI to know more.

Unlock the secrets of clinical trial predictions with Saurabh Jain and Damon Rasheed from Opyl & TrialKey.ai on this episode of Eye on AI.

In today’s discussion, delve into how TrialKey's pioneering AI model can predict the success of clinical trials with astonishing accuracy—about 90%. Learn about the innovative use of over 400,000 past trials to enhance the precision and efficiency of new pharmaceutical trials. Saurabh and Damon share how their technology not only predicts outcomes but also optimizes trial design, saving substantial time and resources in the drug development process.

The episode also covers the sophisticated data processing techniques employed by TrialKey, including natural language processing to extract vital variables from complex datasets, and the strategic use of these insights to improve trial designs. Discover the implications of poorly designed trials and how AI can revolutionize their structure for better success rates.

Tune in to gain a deeper understanding of how AI and machine learning are transforming the pharmaceutical landscape, making clinical trials more predictive and efficient. Saurabh and Damon’s expertise offers a glimpse into the future of medical research and investment, emphasizing the role of AI in enhancing decision-making and resource allocation in healthcare.

Remember to like, subscribe, and hit the notification bell to keep up with the latest innovations and discussions reshaping the future of artificial intelligence and healthcare.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI