10 ways to succeed at ML according to the data superstars

Bailey Seybolt

Recently, Tribe co-founder Jaclyn Rice Nelson got together with some of our favorite ML and data leaders at the Scale TransformX conference to dig into the question: why do businesses fail at machine learning? And, more importantly, to define how companies can build higher-performing teams and operationalize ML projects to drive success.

In this panel, you'll hear from:

Read on for a recap of the main ideas from the conversation or watch the recording on demand. 



10 way to succeed at ML according to the data superstars

1. Be clear on what kind of ML you need from the beginning.

“Don’t confuse the research side of ML with the applied side of ML. You’ll hire the wrong experts and solve the wrong problem.”
Cassie Kozyrkov

Companies need to ask themselves: are we building newer and better algorithms? Or are we innovating in what we use these algorithms for? Are there algorithms out there that already meet our needs? Don’t build something bespoke when the tools you need already exist.

For more on this, check out Cassie’s post on a tale of two machine learnings.

2. Don’t jump to the technical solution.


“You have to define the problem before you go to the tools and the solution. Then let the experts you hire define what to build out in order to solve that problem.”
Deepna Devkar

Within research and applied ML, you have to define the business problem first. Too many companies go immediately to the technical solutions and say, “We’re looking to build a recommendation engine” or “We're looking to build a fraud detection system.” These are solutions, not problems. And so, they go out and hire someone who’s an expert at building those technical capabilities without ever realizing that was never the best solution to the business problem they’re trying to solve.

3. Don’t assume ML is the solution.


“Data and AI can be fetishized. It’s really painful to watch people misuse it. At best you’re wasting a lot of time, at worst you’re creating new problems.”
Cassie Kozyrkov

Don’t just assume ML is the solution. This is why the scoping phase of any project is vital. You need to make sure you have a technical team in place that can deeply understand your problem and identify the right tools to solve it in the right way. And, yes, sometimes that’s not ML at all. Simple analytics or exploratory data analysis often serve the business need, but at the very least, they are a prerequisite to identifying the appropriate ML models.

4. Design with the end user in mind.

“If you don’t figure out the most minimally invasive way to present information to the end user in a way that integrates seamlessly into the process, the cost of change is almost always too high.”
Drew Conway

It’s not enough to understand the business problem. It’s not even enough to solve it with ML if you don’t take the actual user behavior and existing processes into account. The question business leaders need to be asking themselves is: how do you actually get people to implement the change in behavior that the data has identified as a need? You can’t just parachute into an organization with new technology and expect everyone to adopt it.

5. Always have someone in the room who understands what’s worth doing.


“Data scientists don’t always have the skill of understanding what’s worth doing and what success looks like. You need someone in the room who does.”
Cassie Kozyrkov

If you hire a data scientist, you have no guarantee this person is going to understand the business or the politics of decision making in your company. Or how the market or prioritization works. You have to find the person who has that skill and let them kick off the projects. Do as much analytics as you want. But everything is analytics until proven otherwise. If you want to do ML or AI you need someone with a deep understanding of what’s worth doing.

6. Train your data scientists to build business acumen.

“Make them understand the ways that they’ll be judged as a data scientist. That it’s about how they were able to solve the problem for that business and how effective that business was at adopting their solution. Not by the depth of their neural network or the complexity of the tools they used.”
Drew Conway

“When you’re building data products you need a holistic view into the business," Deepna agrees. "That means someone who can understand the business problem, the user requirements, and define success metrics. Then they need to actually do the technical work and circle back on the delivery portion of it to stay with users until they’ve adopted the tool.” 


So how do we train the next generation of data scientists to be the kind of hybrid talents that are crucial to making ML work for businesses? Or, as Jaclyn asked during the panel, “How do we get more Deepna, Cassie, and Drews?” 


According to our panel, the key is about asking data scientists the right questions at every step in their journey – pushing them to think outside the technical toolbox. You have to seek out data scientists who want to work this way – because not everyone does. Then give them agency. “Let’s train a new breed of thinker,” Cassie said, “the decision-maker who has the skills to make data science teams successful.”


For more strategies around this topic, hear from R. Martin Chavez, former CIO and CFO of Goldman Sachs, on how he paired AI experts with domain subject-matter experts for maximum effect.

7. When it comes to building teams, skills are more important than job titles.

“There’s a lot of pressure for people in these nebulously defined job roles to claim that they can do it all while quietly dying of imposter syndrome.”
Cassie Kozyrkov 

Data scientist can mean a hundred different things at a hundred different companies. And there are too many job descriptions out there that are so broad they might as well be for the “everything in data scientist.” We can’t expect any single human to be and do it all. (If you’re wondering what flavor of data professional you need, check out Cassie’s essay on the topic.)

We need to better define what skills are needed to get the job done. And, conversely, what skills the people on your team actually have, versus what their job title is. 

This changes your approach to hiring by defining teams holistically based on skills rather than a checklist of prior experience. It frees you to have a wider requirement for what it means to be creative with data when hiring and also to know what specialists you need to bring in for distinct projects from outside your organization. “We often work with clients that have their own in-house ML team, but might need a specialist to unblock a problem or do the technical scoping for a new project,” Jaclyn said. “Businesses need to think of new ways of hiring that give them the skills they need when they need them.”

8. Invest in counterparts to your technical talent. 

“We found, early on at Tribe, that staffing a PM on every project made a huge difference. It allowed our engineers to focus on what they do best while keeping the project oriented around strategic business goals.”
Jaclyn Rice Nelson

As Deepna says: “Product managers are the unsung heroes of ML projects.” PMs make technology packageable and user friendly for a business, which is ultimately what makes a project successful. By pairing technical talent with a product manager, you’re making sure everyone on the team is focused on the areas where they can add the most value. 


This is doubly true for machine learning. ML is experimental in nature, so you have to be comfortable with a certain amount of uncertainty going into any project. And sometimes the outcome is measured in the quality of learning and the insights you get into your business rather than a finished product.

“We’ve found that it’s vital to have someone who can put everything into a framework that a non-technical audience can use to make decisions and understand opportunities,” says Jaclyn. “At Tribe, that’s the role of an ML product manager, but other businesses may have a different way to build that bridge.”

9. Focus on your data early. 

“Building the right team means: defining the right problem, focusing on the data early, and investing the time to find the right skills.”
Deepna Devkar

Deepna shared earlier the importance of defining the right business problem. In addition to that, few things are as defining in terms of what makes a good problem for ML than the quality and availability of data. This is also a stage where organizations should explore partners like Scale AI, which can help companies deliver value from AI investments faster with better data.



“Starting projects with a deep dive into that data to figure out whether it’s even possible to get the answers you want is going to set you up for success,” Deepna says. “I also cannot emphasize enough the strength of diverse teams – diverse people with diverse backgrounds and training. Oftentimes the job descriptions you see across companies are too generalized or too specific. Investing the time upfront in hiring for the right skills pays huge dividends later on.”

10. Get excited about the boring stuff. 

“The reality is the things that drive impact are often boring. Their novelty is in how existing off-the-shelf tools are stitched together, not in the creation of new tools. Chasing the sci-fi brand of novelty for its own sake can sound cool but it’s best to focus on value.”
Cassie Kozyrkov


There was this feeling early on that in order to get people excited about ML we had to make it futuristic, so they’d care. And then there were the people who claimed AI was a fad. But the reality, we’ve all seen, is that the things that move the needle for a business don’t usually sound like the plot of a sci-fi movie. They’re things like data driven pricing, reducing compute costs, or named entity resolution so you can get better answers from your data. They seem boring and obvious in hindsight, but the implications for a business can be enormous. 

Want more? You can read the full transcript from the panel.



Related Stories

Applied AI

8 Ways AI for Healthcare Is Revolutionizing the Industry

Applied AI

Thoughts from AWS re:Invent

Applied AI

Leveraging Data Science – From Fintech to TradFi with Christine Hurtubise

Applied AI

Welcome to Tribe House New York 👋

Applied AI

The Secret to Successful Enterprise RAG Solutions

Applied AI

How to Build a Data-Driven Culture With AI in 6 Steps

Applied AI

10 Common Mistakes to Avoid When Building AI Apps

Applied AI

Understanding MLOps: Key Components, Benefits, and Risks

Applied AI

7 Key Benefits of AI in Software Development

Applied AI

AI Consulting in Healthcare: The Complete Guide

Applied AI

How to Reduce Costs and Maximize Efficiency With AI in Insurance

Applied AI

5 machine learning engineers predict the future of self-driving

Applied AI

AI in Banking and Finance: Is It Worth The Risk? (TL;DR: Yes.)

Applied AI

AI for Cybersecurity: How Online Safety is Enhanced by Artificial Intelligence

Applied AI

10 Expert Tips to Improve Patient Care with AI

Applied AI

How AI is Cutting Healthcare Costs and Streamlining Operations

Applied AI

Top 9 Criteria for Evaluating AI Talent

Applied AI

A Guide to AI in Insurance: Use Cases, Examples, and Statistics

Applied AI

AI Consulting in Finance: Benefits, Types, and What to Consider

Applied AI

Top 10 Common Challenges in Developing AI Solutions (and How to Overcome Them)

Applied AI

The Hitchhiker’s Guide to Generative AI for Proteins

Applied AI

Key Takeaways from Tribe AI’s LLM Hackathon

Applied AI

No labels are all you need – how to build NLP models using little to no annotated data

Applied AI

How to Seamlessly Integrate AI in Existing Finance Systems

Applied AI

7 Effective Ways to Simplify AI Adoption in Your Company

Applied AI

An Actionable Guide to Conversational AI for Customer Service

Applied AI

How to Evaluate Generative AI Opportunities – A Framework for VCs

Applied AI

Generative AI: Powering Business Growth across 7 Key Operations

Applied AI

Navigating the Generative AI Landscape: Opportunities and Challenges for Investors

Applied AI

Making the moonshot real – what we can learn from a CTO using ML to transform drug discovery

Applied AI

How to Optimize Supply Chains with AI

Applied AI

How AI Enhances Real-Time Credit Risk Assessment in Lending

Applied AI

AI Consulting in Insurance Industry: Key Considerations for 2024 and Beyond

Applied AI

How to Use Generative AI to Boost Your Sales

Applied AI

7 Strategies to Improve Customer Care with AI

Applied AI

Best Practices for Integrating AI in Healthcare Without Disrupting Workflows

Applied AI

AI in Customer Relationship Management

Applied AI

Machine Learning in Healthcare: 7 real-world use cases

Applied AI

Key Generative AI Use Cases From 10 Industries

Applied AI

Self-Hosting Llama 3.1 405B (FP8): Bringing Superintelligence In-House

Applied AI

Everything you need to know about generative AI

Applied AI

AI in Construction in 2024 and Beyond: Use Cases and Benefits

Applied AI

How AI Improves Knowledge Process Automation

Applied AI

Write Smarter, Not Harder: AI-Powered Prompts for Every Product Manager

Applied AI

How to Measure ROI on AI Investments

Applied AI

How to Enhance Data Privacy with AI

Applied AI

7 Prerequisites for AI Tranformation in Healthcare Industry

Applied AI

How the U.S. can accelerate AI adoption: Tribe AI + U.S. Department of State

Applied AI

Tribe welcomes data science legend Drew Conway as first advisor 🎉

Applied AI

Announcing Tribe AI’s new CRO!

Applied AI

Common Challenges of Applying AI in Insurance and Solutions

Applied AI

What our community of 200+ ML engineers and data scientist is reading now

Applied AI

AI in Private Equity: A Guide to Smarter Investing

Applied AI

10 AI Techniques to Improve Developer Productivity

Applied AI

How AI for Fraud Detection in Finance Bolsters Trust in Fintech Products

Applied AI

A Gentle Introduction to Structured Generation with Anthropic API

Applied AI

Current State of Enterprise AI Adoption, A Tale of Two Cities

Applied AI

Top 5 AI Solutions for the Construction Industry

Applied AI

Advanced AI Analytics: Strategies, Types and Best Practices

Applied AI

How to Improve Sales Efficiency Using AI Solutions

Applied AI

Top 8 Generative AI Trends Businesses Should Embrace

Applied AI

AI in Portfolio Management

Applied AI

A primer on generative models for music production

Applied AI

Segmenting Anything with Segment Anything and FiftyOne

Applied AI

AI and Predictive Analytics in Investment

Applied AI

What the OpenAI Drama Taught us About Enterprise AI

Applied AI

AI and Blockchain Integration: How They Work Together

Applied AI

From PoC to Production: Scaling Bright’s Training Simulations with Tribe AI & AWS Bedrock

Applied AI

AI in Finance: Common Challenges and How to Solve Them

Applied AI

How to Reduce Costs and Maximize Efficiency With AI in Finance

Applied AI

Scalability in AI Projects: Strategies, Types & Challenges

Applied AI

AI Implementation: Ultimate Guide for Any Industry

Applied AI

Tribe's First Fundraise

Applied AI

How to build a highly effective data science program

Applied AI

AI Diagnostics in Healthcare: How Artificial Intelligence Streamlines Patient Care

Applied AI

Why do businesses fail at machine learning?

Applied AI

AI-Driven Digital Transformation

Applied AI

How data science drives value for private equity from deal sourcing to post-investment data assets

Applied AI

AI Implementation in Healthcare: How to Keep Data Secure and Stay Compliant

Applied AI

AI in Construction: How to Optimize Project Management and Reducing Costs

Applied AI

How to Measure and Present ROI from AI Initiatives

Applied AI

Using data to drive private equity with Drew Conway

Applied AI

A Deep Dive Into Machine Learning Consulting: Case Studies and FAQs

Applied AI

How AI Enhances Hospital Resource Management and Reduces Operational Costs

Applied AI

AI and Predictive Analytics in the Cryptocurrency Market

Applied AI

How 3 Companies Automated Manual Processes Using NLP

Applied AI

3 things we learned building Tribe and why project-based work will change AI

Applied AI

8 Prerequisites for AI Transformation in Insurance Industry

Applied AI

AI Security: How to Use AI to Ensure Data Privacy in Finance Sector

Get started with Tribe

Companies

Find the right AI experts for you

Talent

Join the top AI talent network

Close
Head of Content
Bailey Seybolt
Bailey got her start in storytelling as a journalist, before pivoting to tech content development for unicorn startups from Montreal to San Francisco – helping build brands and shape stories to drive business results.