What are the most effective methods for expert reviews in IA evaluation?

Expert reviews are a common and cost-effective way to evaluate the information architecture (IA) of a website, app, or system. IA is the organization, labeling, and navigation of information to help users find and use it. Expert reviews involve having one or more experts assess the IA against a set of criteria, such as usability, consistency, clarity, and relevance. In this article, you will learn about the most effective methods for expert reviews in IA evaluation, and how to choose and apply them for your project.

Find expert answers in this collaborative article

Selected by the community from 3 contributions. Learn more

1 Heuristic evaluation

Heuristic evaluation is a method where experts use a predefined set of heuristics, or general principles of good design, to identify and rate the severity of IA problems. Heuristics can be derived from established sources, such as Nielsen's 10 usability heuristics, or customized for specific domains or contexts. Heuristic evaluation is useful for finding common and obvious IA issues, such as broken links, unclear labels, or inconsistent navigation. However, it may not capture the users' needs, preferences, or expectations, or the nuances of complex IA scenarios.

Add your perspective

Raza Habib

🔹Management Consultant 🔹HCI Expert 🔹Information Architect 🔹Digital Innovation Leader 🔹Senior Technical Product Manager 🔹Software Developer 🔹Coffee Aficionado
Report contribution
As an expert, I've found heuristic evaluation to be a handy tool for spotting glaring IA issues, like broken links or confusing labels. It's like having a checklist to ensure the basics are covered. But let's be honest, it's not a magic wand. It won't magically reveal the deepest desires of our users or uncover the hidden complexities of their mental models. Sometimes, I feel like heuristic evaluation is like a strict teacher, enforcing rules and guidelines. It's great for keeping things in order, but it can also stifle creativity and innovation. We need to balance the order and structure of heuristics with the flexibility and adaptability that real-world IA demands.

Like

2 Cognitive walkthrough

Cognitive walkthrough is a method where experts simulate how users would perform a specific task or goal on the IA, and evaluate how easy or difficult it is. Experts use a set of questions to guide their analysis, such as "Will the user notice the correct option?", "Will the user understand what the option means?", or "Will the user know what to do next?". Cognitive walkthrough is useful for testing the learnability and intuitiveness of the IA, and how well it supports the users' tasks and goals. However, it may not account for the variability and diversity of users, or the influence of external factors, such as motivation or distraction.

Add your perspective

3 Content inventory and audit

Content inventory and audit is a method where experts collect and analyze the existing content on the IA, and evaluate its quality, relevance, accuracy, and consistency. Content inventory is the process of creating a spreadsheet or database that lists all the content items on the IA, along with their attributes, such as title, URL, format, type, or owner. Content audit is the process of reviewing and assessing each content item against a set of criteria, such as purpose, audience, tone, style, or metadata. Content inventory and audit is useful for identifying and removing outdated, redundant, or irrelevant content, and improving the content strategy and governance. However, it may not address the user experience or interaction design of the IA, or the alignment with the business goals and brand identity.

Add your perspective

Raza Habib

🔹Management Consultant 🔹HCI Expert 🔹Information Architect 🔹Digital Innovation Leader 🔹Senior Technical Product Manager 🔹Software Developer 🔹Coffee Aficionado
Report contribution
I love the idea of stepping into a user's shoes and "living" their experience with the IA. It's like a mental dress-up game, only for usability. But, hold on a minute! We experts are not our users. Sure, we can try to predict their every move, but wouldn't it be a bit presumptuous? What about those unpredictable humans who click on things just for fun, or get distracted by a notification mid-task? Are we accounting for them? I think not. So yeah, cognitive walkthroughs are great for getting a feel for the IA, but let's not forget they're just a piece of the puzzle. Real user testing is still essential to truly understand how everyone interacts with the interface.

Like

4 Card sorting

Card sorting is a method where experts sort a set of cards, each representing a content item or category, into groups and labels that make sense to them. Card sorting can be done either physically or online, and either individually or collaboratively. Card sorting is useful for generating insights into how experts structure and label the information on the IA, and how they relate different concepts and themes. However, it may not reflect how the actual users would sort or search for the information, or how the IA would function in a real environment.

Add your perspective

Raza Habib

🔹Management Consultant 🔹HCI Expert 🔹Information Architect 🔹Digital Innovation Leader 🔹Senior Technical Product Manager 🔹Software Developer 🔹Coffee Aficionado
Report contribution
Card sorting: a technique where experts get their hands dirty, crafting a taxonomy that's oh-so-neat. But hold your horses, isn't this a bit like asking the chef to design the restaurant? Experts might be masters of their domain, but understanding user behavior is a whole different ball game. Let's not forget, the IA's not a museum exhibit, it's a living, breathing entity, shaped by the whims and fancies of real users. So, before we get too chummy with our expert-curated categories, let's give the real folks a chance to have their say.

Like

5 Tree testing

Tree testing is a method where experts test the effectiveness of the hierarchical structure and labels of the IA, without the influence of the visual design or navigation. Experts are given a task or question, and asked to find the answer by clicking through a text-based tree of the IA. Tree testing is useful for measuring the findability and usability of the information on the IA, and identifying any gaps, ambiguities, or redundancies. However, it may not capture the user satisfaction or engagement with the IA, or the impact of the visual design or navigation on the user behavior.

How to choose and apply expert review methods

There is no single best method for expert reviews in IA evaluation. The choice and application of the methods depend on several factors, such as the scope, stage, and objectives of the project, the availability and expertise of the reviewers, the resources and time constraints, and the expected outcomes and deliverables. Generally, it is advisable to use a combination of methods that complement each other, and to involve multiple experts with different perspectives and backgrounds. Moreover, it is important to plan and prepare the review process carefully, such as defining the criteria, tasks, and questions, selecting and briefing the reviewers, collecting and analyzing the data, and reporting and communicating the results. Finally, it is essential to validate and iterate the findings from the expert reviews with other methods, such as user testing, surveys, or analytics, to ensure the IA meets the needs and expectations of both the users and the stakeholders.

Add your perspective

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?

Add your perspective

What are the most effective methods for expert reviews in IA evaluation?

1

2

3

4

5

6

1 Heuristic evaluation

2 Cognitive walkthrough

3 Content inventory and audit

4 Card sorting

5 Tree testing

6 Here’s what else to consider

Information Architecture

Rate this article

Thanks for your feedback

More articles on Information Architecture

More relevant reading

What are the most effective methods for expert reviews in IA evaluation?

1

2

3

4

5

6

1 Heuristic evaluation

2 Cognitive walkthrough

3 Content inventory and audit

4 Card sorting

5 Tree testing

6 Here’s what else to consider

Information Architecture

Rate this article

Thanks for your feedback

Explore Other Skills