Points of Interest

Points of Interest

Points of Interest are the best way to reach important parts of your meeting recording.

Points of Interest are the best way to reach important parts of your meeting recording.

This feature highlights points or sections of a meeting recording that represent sections people might want to jump to and watch.

This feature highlights points or sections of a meeting recording that represent sections people might want to jump to and watch.

An example of some Points of Interest are mentions of the user, when a person relevant to the user spoke, when the screen was shared during the meeting, and more.

An example of some Points of Interest are mentions of the user, when a person relevant to the user spoke, when the screen was shared during the meeting, and more.

My Role

My Role

I performed user research for Points of Interest with a global cross-platform-team, and oversaw the design of AI-based Points of Interest.

I performed user research for Points of Interest with a global cross-platform-team, and oversaw the design of AI-based Points of Interest.

The project

The project

Finding the right parts

Finding the right parts

Finding the parts of a meeting recording you want to watch can be frustrating, especially if it's a long recording.

Finding the parts of a meeting recording you want to watch can be frustrating, especially if it's a long recording.

After extensive user research the conclusion was that watching a meeting recording at 2x speed and jumping through it is the most common behavior to find something interesting. This is a time consuming and frustrating experience.

After extensive user research the conclusion was that watching a meeting recording at 2x speed and jumping through it is the most common behavior to find something interesting. This is a time consuming and frustrating experience.

Through this user research, the moments people want to jump to or look for in their meeting recording were pinpointed.

Through this user research, the moments people want to jump to or look for in their meeting recording were pinpointed.

Each Point of Interest represents one of these sections that the user might find relevant and can easily jump to right away.

Each Point of Interest represents one of these sections that the user might find relevant and can easily jump to right away.

Small details and AI

Small details and AI

Small details can make or break user experience. When working with AI, design iterations might require working with data scientists to tweak the AI models and prompts.

Small details can make or break user experience. When working with AI, design iterations might require working with data scientists to tweak the AI models and prompts.

Perfecting the way we display captions rephrased by AI meant limiting the number of characters we ask the model to output, identifying and highlighting names (speaker and mentioned user) from the context.

Perfecting the way we display captions rephrased by AI meant limiting the number of characters we ask the model to output, identifying and highlighting names (speaker and mentioned user) from the context.

Feedback

Feedback

Feedback is an essential part of AI-powered features, it can't be an afterthought.

Feedback is an essential part of AI-powered features, it can't be an afterthought.

Without the proper feedback being collected data scientists have a hard time doing their work.

Without the proper feedback being collected data scientists have a hard time doing their work.

I entered the Points of Interest project, and realized that feedback was being implemented last minute for a specific scenario. This led me to design a modular feedback system that could be used for any past and future points of interest.

I entered the Points of Interest project, and realized that feedback was being implemented last minute for a specific scenario. This led me to design a modular feedback system that could be used for any past and future points of interest.

This feedback system was implemented for Points of Interest.

This feedback system was implemented for Points of Interest.

The results

The results

Points of Interest is used by millions of people globally in various Microsoft products.

Points of Interest is used by millions of people globally in various Microsoft products.

Points of Interest has the highest clickthrough rate of any artifact in OnePlayer.

Points of Interest has the highest clickthrough rate of any artifact in OnePlayer.