How to choose the right AI Product in L&D (Step-by-step guide)

Step 1: Understand What You REALLY Need

Before looking at AI tools, figure out what problem you’re trying to solve. Ask yourself:

• What’s the gap in your current L&D setup? Are you struggling with scaling content, tracking learner progress, or creating personalised learning paths?
• What’s the goal? Faster onboarding? Better engagement? Improved learning outcomes?

👉 Pro Tip: Write down a clear problem statement. For example: “We need an AI solution to streamline onboarding for new hires across global offices.”

This three-step framework will help you avoid "shiny new object"-ism which is prevalent in AI today.

1. Understand the business problems your organisation is facing
2. Align your learning strategy to these problems
3. Uncover what technology will solve your learning problem at hand, which again is aimed at solving the wider business problem.

More info on this? See article below.

Step 2: Learn the Basics of AI in L&D

You don’t need a degree in AI, but a little understanding goes a long way. Here’s the quick-and-easy rundown:

• AI Models: These process data to do things like predict learner behaviour or generate quiz questions.
• AI Agents: These are interactive systems, like chatbots, that respond to learners and adapt based on their inputs.

👉 Pro Tip: Look for tools that match your goals. If you want interactive learning, focus on AI agents. If you need better analytics, prioritise AI models.

Want more info on this? I created a playlist of resources for L&D teams on AI.

Step 3: Ask the Right Questions

When evaluating vendors, don’t be afraid to dig deep. Here are some questions to keep handy:

1. What problem does this tool solve for us?
2. How will it fit into our current workflow?
3. Who owns and manages the data?
4. Can we inspect and override AI decisions?
5. How does the tool support learning outcomes?

👉 Pro Tip: Get answers in writing! If a vendor can’t provide clear documentation, that’s a sign to move on.

Step 4: Be Aware of Bias

AI isn’t magic—it’s trained on data, and sometimes that data has issues like bias. Imagine a hiring bias creeping into your AI tool or learners getting irrelevant content recommendations. Yikes!

Here’s what to look for:

• Training Data Bias: Is the AI built on diverse data that reflects your learners?
• Algorithmic Bias: Can vendors demonstrate unbiased decision-making?
• User Feedback Loops: How does the tool prevent errors from compounding over time?

👉 Pro Tip: Ask vendors to explain how they deal with bias. If they can’t answer, it’s a red flag.

Step 5: Get Your Data in Order

AI tools live and breathe data. To get the most out of them, you need solid data on:

• Learner Profiles: Things like job roles, goals, and skills.
• Interaction Data: How learners are engaging with content.

👉 Checklist for Data Prep:

1. Audit your current learner data—what do you have, and what’s missing?
2. Work with your IT or data team to ensure your data is clean and structured.
3. Check the tool’s integration capabilities—can it connect with your LMS or HR system?

Step 6: Choose Tools with Clear Frameworks

Not all AI tools are created equal. The good ones follow frameworks that ensure they’re reliable and user-friendly:

• Inspectable, Explainable, Overridable: Can you see how the AI makes decisions? Does it let you step in and make changes?
• Human-in-the-Loop Systems (HILT): Does the tool combine AI insights with human oversight?

👉 Pro Tip: Ask for a demo and play around with the tool. See if it feels intuitive or overly complicated.

Step 7: Prioritise Pedagogy

At its core, L&D is about helping people learn. AI tools should align with teaching principles to ensure the content is engaging and effective.

Checklist for Pedagogical Tools:

• Does the tool create personalised learning paths?
• Are there metrics to track learner progress?
• Does it include feedback loops to refine content?

👉 Pro Tip: Look for tools that are flexible enough to adapt to different learner needs.

Step 8: Start Small and Scale

Don’t try to overhaul your entire L&D system at once. Pick one area—like onboarding or compliance training—and pilot the AI tool there.

Step-by-Step Pilot Plan:

1. Define a clear scope and success criteria.
2. Train your team on the new tool.
3. Collect feedback from learners and managers.
4. Refine the process before scaling to other areas.

👉 Pro Tip: Vendors often provide pilot support—take advantage of it!

Conclusion

Choosing your first AI tool for L&D doesn’t have to be daunting. Start by understanding your needs, asking the right questions, and focusing on tools that are transparent, reliable, and pedagogically sound.

Remember, AI isn’t here to replace you—it’s here to help. With the right tool, you can focus on the big picture while letting AI handle the heavy lifting. Follow these steps, and you’ll be well on your way to creating smarter, more scalable learning experiences.

Good luck, and happy AI shopping! 🎉

P.S - if you want my help or learn more about Docebo, book an appointment with me (Calendar link is on my LinkedIn profile).