What goes with what? Which of these things is not like the others? What order should these go in?
Whiteboards and multi-colored Post-it Notes are common tools for answering these kinds of questions.
Content Management Systems can automate the collection of much of this kind of metadata.
Feedback refers to user-perceptions. It can only be acquired by talking (questionnaires, ineterviews, in situ observations) with people and it is both subjectively derived and subjectively understood.
You can get data from a user without them knowing you did, but you can't get feedback that way.
Finally, in lieu of a dedication, which would be presumptuous, I would like merely to mention the name of the man, nowhere cited in the body of the text, who has had no direct connection to it or me, but whose work has served as its governing inspiration at almost every point: Kenneth Burke.
Heuristic analysis is the practice of having informed users -- people who know the 10 heuristics -- use a product to see where it fails to conform. It's a quick and typically cheap kind of quality control. If you pattern what you make after industry standards, you can presume you're designs conform, though you should verify.
From ChatGPT:
In a User Experience (UX) setting, a good hypothesis serves as a valuable tool for guiding research, design, and evaluation efforts. Here are some characteristics of a good hypothesis in a UX context:
1. Clear and Specific: A good hypothesis should be clear, specific, and focused on a particular aspect of the user experience. It should leave no room for ambiguity and clearly state what you aim to test or investigate.
2. Testable: Your hypothesis should be testable, meaning that it can be proven true or false through research or experimentation. It should be framed in a way that allows you to collect data and evidence to support or reject it.
3. Based on User Insights: A strong UX hypothesis is often informed by user research and insights. It should reflect a deep understanding of your target users, their needs, behaviors, and pain points.
4. Linked to a Goal: A UX hypothesis should align with broader project or product goals. It should help you move closer to achieving those goals by addressing a specific aspect of the user experience.
5. Measurable and Quantifiable: To assess the validity of your hypothesis, it should include measurable variables or metrics. This allows you to quantify the impact of your proposed changes or interventions.
6. Time-Bound: A hypothesis should have a clear timeframe or duration for testing. This helps in planning and executing research and evaluation activities efficiently.
7. Hypothesis Statement: It's often helpful to structure your hypothesis as a statement that follows the "If-Then-Because" format. For example, "If we improve the checkout process by reducing the number of steps, then we expect to see an increase in the conversion rate, because it will be more user-friendly."
8. Grounded in Prior Knowledge: Your hypothesis should be informed by existing knowledge, whether it's from prior research, best practices, or industry benchmarks. It should build upon what is already known or assumed.
9. Focused on Impact: A good hypothesis should address a problem or opportunity that, if solved or leveraged, would have a meaningful impact on the user experience and, by extension, on the success of the product or project.
10. Open to Revision: Hypotheses are not set in stone. They should be flexible and open to revision based on the findings and insights obtained during the research or testing phase. You should be willing to adjust your hypothesis if the data doesn't support it.
11. Ethical: It's important that your hypothesis respects ethical considerations, especially when conducting user research. Ensure that you are not causing harm or discomfort to users and that you have obtained proper consent.
12. Relevant to the Target Audience: Your hypothesis should address issues or opportunities that are relevant and meaningful to your target users. It should enhance their experience or solve a problem they face.
In the UX field, hypotheses play a critical role in guiding the design and evaluation process, helping to ensure that your efforts are focused and data-driven. They serve as a foundation for creating user-centered solutions and improving the overall user experience.
George: Hey Claude, define information architecture for me
Claude: Information architecture is the structural design of a website, application, or other information system. It focuses on organizing, labeling, searching, and navigating content in an intuitive way that meets user needs. The main components of information architecture for web design include:
- Site structure - How the site's pages and sections are organized. A common structure is a hierarchical model with main sections and subpages.
- Navigation design - The interface to move between pages and sections. This includes menus, links, buttons, and other navigational elements. Effective navigation is intuitive and helps users find desired content.
- Taxonomy - A classification system to categorize and label content. This includes site-wide taxonomies for topics, as well as labeling schemes within content types.
- Search - Allowing users to find content by entering keywords. Search should be optimized to return relevant results.
- Metadata - Data that describes content, like page titles, descriptions, tags. This improves findability and search engine optimization.
- URLs - Unique web addresses that represent content pages and reflect the site hierarchy. Well-structured URLs improve usability.
- Labels - Descriptive text used to represent content, categories, and site sections. Clear, consistent labels help users know what content they will find.
The goal of information architecture is to create a structure optimized for usability. A solid IA allows users to efficiently navigate and digest content. It evolves over time as content and user needs change. Testing IA with real users reveals issues to improve. Overall, good information architecture is essential for an effective web presence.
For UX, interviews are neither interogations nor evaluations. The goal is to learn what a person is experiencing and why without judgement.
This concept highlights the importance of intuitive and error-tolerant design.
Example: On a scale of from 1 to 4 where 1 is not helpful and 4 is very helpful, how to do you rate this section of the book? 1------------------2------------------3-------------------4
To get truly insightful information from this method of subjective measurement you need to label each option: 1 = not helpful, 2 = somewhat helpful, 3 = helpful, 4=very helpful. You also need to know precisely what differentiates somewhat from not very. Thus Likert scales are often a good place to start dividing a population into segments, but a bad place to stop. You almost always need to follow up with a questionnaire to find out what didn't work for them that led them to say somewhat helpful, what worked what didn't. The only time a Likert scale is useful on its own is when the options are unambiguously different.
A classic example is the 😊 😞 you might see at the exit of a bathroom in an airport. Different cultures and different people within the same culture have different ideas of cleanliness, but there's enough overlap to make a simple yes or no useful, especially if you have more than just a few data points.
In other words, when you do a study, how statistically confident should you be that the numbers you gathered from your sample are representative of the entire population? The larger the percentage of the entire population you sample, the greater your confidence can be that any individual drawn from the population will display the attribute identified in the sample.
If you design things, you need to know how people expect them to work and accommodate those expectations in some way.
As a researcher, your goal is to discover users' mental models and to use that knowledge to design and test the usability of your products. It is important to remember that a mental model might have little to do with reality and still work for the person who thinks that way. Most of the time your goal is to enable the model rather than correct it, unless you are a teacher, of course.
One of UX's primary goals is to identify pain ponts so that designers or engineers can eliminate them.
Each persona has a name, biographical data, a photograph of someone who looks like what the data suggests, a context, a primary goal, a set of attitudes, beliefs, identifications, and mental models (how they think something works which may or may not resemble reality).
Businesses use personae to make sure that everyone writing for the company -- or designing for the company -- has a clear sense of who they are writing to and working for.
To some extent the object of analysis determines which method is best, but a researcher's skill-set often dtermines what kinds of objects they will choose to analyze.
From ChatGPT:
To identify a representative sample size for a population of N, you can use statistical formulas and calculators that help determine the required sample size based on your desired level of confidence and margin of error. One commonly used formula is:
n = (Z^2 * p * (1-p)) / E^2
Where:
- n is the required sample size.
- Z is the Z-score, which corresponds to your desired level of confidence (e.g., 1.96 for 95% confidence).
- p is the estimated proportion of the population with the attribute you're interested in.
- E is the desired margin of error (expressed as a decimal).
Here's how to use this formula:
- Determine your desired level of confidence (usually expressed as a percentage, such as 95% or 99%).
- Estimate the proportion (p) of the population that possesses the attribute you're interested in. If you don't have an estimate, you can use 0.5 for a conservative estimate, which will give you the largest required sample size.
- Decide on your desired margin of error (E), which represents the maximum acceptable difference between your sample estimate and the population parameter.
- Plug these values into the formula to calculate the required sample size (n).
Keep in mind that there are online sample size calculators and software tools available that can simplify this process for you. You can enter your specific values, and these tools will provide you with the recommended sample size.
Additionally, if you're working with complex survey designs or populations with specific characteristics, you may need to consider stratified sampling or other methods to ensure your sample is truly representative.
Always remember that the quality of your sample and the accuracy of your results depend on how well you select and collect your data, so careful planning and consideration of your research objectives are crucial.
Some examples of scenarios are:
Alice wants to book a flight to Paris for her vacation. She opens the travel app on her smartphone and searches for flights from New York to Paris on the dates she prefers. She filters the results by price, duration, and airline. She selects the best option and proceeds to the payment page. She enters her credit card details and confirms the booking. She receives a confirmation email with her itinerary and boarding pass.
Bob needs to write a report for his boss by tomorrow. He opens the word processor on his laptop and creates a new document. He types the title and the introduction. He inserts a table of contents and some headings. He copies and pastes some data from a spreadsheet and formats it. He adds some charts and images from the internet. He checks the spelling and grammar. He saves the document and exports it as a PDF. He attaches the PDF to an email and sends it to his boss.
Carol wants to watch a movie on her smart TV. She turns on the TV and browses the streaming service. She looks at the recommendations and the genres. She finds a movie that interests her and reads the synopsis and the reviews. She decides to watch the movie and presses the play button. She adjusts the volume and the brightness. She pauses the movie when she needs to go to the bathroom. She resumes the movie and enjoys it.
Research projects require a solid rational and this framework can be very useful.
From a UX perspective, a task analysis involves watching a person do what they do to accomplish a goal. While you can ask an informant to self-report, many tasks have implicit steps and so the informant may unintentionally leave some steps out.
Watching (while present or via recording) someone perform the task while they say what they are doing and thinking as they do each step can provide a much more precise description.
Task analysis should be done from observations in the client world rather than from how an engineer imagines an existing process is performed or thinks it should be because the imagined and the ideal may not serve a pre-existing reality. On the other hand, if the process doesn't already exist and users will learn to do it based on the steps provided, than an ideal representation will be necessary. It can then be validated via user observations.
From Claude:
The think aloud protocol is a method used in user experience (UX) research to gain insights into how users think and feel as they complete tasks on a product or service.
The key steps in the think aloud protocol are:
Limitations include possible interference with natural behavior, and difficulty interpreting complex cognitive processes. Overall, the think aloud protocol is a flexible UX research method to uncover insights from representative users.
- Researchers ask representative users to perform typical tasks while verbalizing their thoughts, feelings, questions etc. as they go. For example, a user might say "I'm clicking on this button because I want to see my account details".
- Sessions are recorded or observed, taking note of what users say and do. Researchers aim to avoid interfering with the participant's natural behavior.
- After the session, researchers analyze the notes and recordings to identify usability issues, confusion points and insights into the user's mental model.
- Feedback is used to iterate on the product design and make the user experience more intuitive. Key benefits of think aloud studies:
- Provides direct access to user thought processes, questions and emotions
- rather than having to infer them.
- Identifies usability issues and confusion points that may not be uncovered by observation alone.
- Useful early in design process to understand user expectations and mental models.
- Complements other UX research methods like surveys and analytics.
- Relatively quick and inexpensive to conduct.
- Can be done remotely via screensharing and video conferencing.
Feature creep, however, and project sprawl are to be avoided.