For information on creating and defining a metric, review the Metrics guide.
Per user metric calculations
When metrics are calculated per user, each user's individual contribution is calculated. Every user adds a single data point to the distribution of the user metric results, which means they all have the same weight in the result. We use the resulting distribution for statistical testing of the metrics described below.
Note: All the examples assume that users are used for the traffic type in the experiment and the users are exposed to a particular treatment of a particular feature flag version.
| Function | Description | Example |
|---|---|---|
| Count of events per user | For each user, the number of times they perform an event is calculated. | Measure the average number of times a user visits your website. Measure the average number of support tickets a user files with your support team. |
| Sum of event values per user | For each user, the sum of their event values is calculated. | Measure the total value of items purchased by a user. Measure the total number of minutes a user listened to media on your website. |
| Average of the event values per user | For each user, the average value of the user's events is calculated. | Measure the average value of items a user purchases. Measure the average page load time a user experiences. |
| Ratio of two events per user | For each user, the ratio of the number of times two different events are performed is calculated. | Measure the number of hotel searches that occur for a user to make a hotel booking. Measure the number of invites sent for a user to accept the invite. |
| Percent of unique users | The number of distinct users who performed the event as a percent of those in the sample is calculated. | Measure what percent of your sample size clicked the checkout button. Measure the percent of users who filed a support ticket. |
Comments
0 comments
Please sign in to leave a comment.