Note: This guide is for analyzing metric details and trends in Split Experimentation for Azure App Configuration, an Azure-native experience, currently available in public preview. For more information, see the Github documentation. For metric details in Split’s core offering, see the Metric details and trends guide.
The metric drill down page provides information about a metric’s values over time. You can launch this view by clicking into any metric from the experiment results table in App Configuration's feature manager. The chart displays metric values over time for the variants selected when loading the experiment results table.
On this page, you can:
-
Select a metric to analyze. By default, the metric you clicked in the experiment results table is selected. Once selected, Split also displays the metric aggregation and Azure Application Insights event used to define the metric.
-
Select an experiment version to analyze. By default, the latest experiment version is selected.
-
See the timestamp when results were last updated.
-
See the cumulative metric values over time between the start and end dates of the selected experiment version. The data is aggregated daily.
-
Hover over a data point to see more detail about the metric result at that point in time. This includes:
-
The metric value for both the baseline and comparison variants.
-
The confidence interval for the metric value, represented by the shaded region, outlining the noise or uncertainty in the data.
-
The observed impact and p-value for the comparison variant against the baseline. For more information on these data points, review the Statistical significance guide.
-
Troubleshooting
The metric chart isn’t displaying the comparison variant I selected.
The metric drill down currently supports analysis of two selected variants. If you have selected two or more comparison variants in the feature manager experiment results filters, we will select one comparison variant at random to display on the metric details charts. To resolve this issue, select only one comparison variant before navigating to the metric details.
I am receiving an error after navigating to the Split portal.
You may encounter issues accessing the Split portal if you have your browser configured to block third-party cookies. To resolve this, update your browser settings to allow third-party cookies.
Comments
0 comments
Please sign in to leave a comment.