Does changing a targeting rule's percentages alter existing treatment allocation?

Comments

4 comments

  • senright

    A bit more reading put me on to this article which sounds like I should actually be performing the larger rollout via the default rule: https://help.split.io/hc/en-us/articles/360030117011-Why-setting-the-order-of-treatments-matters

    Reading that suggests the % bucketing would be consistent as the on/off ratios are adjusted incrementally.

    0
    Comment actions Permalink
  • Dave Murphy

    Two things: 1) you don't need to exclude the users who are in the segment as long as that rule comes before the percentage rollout.  So, if you use the Default Rule for "everyone else', the segment will be set in a Whitelist or in a Targeting Rule.  That will get evaluated first, so you don't explicitly need to exclude those in the segment.  If you are going to put percentages on a Targeting Rule then make sure your segment is the first Targeting Rule.

    2) Users always stay in the same bucket every time they are evaluated.  So any user in bucket 15 will always be in bucket 15.  Thus, if they were getting on as being part of the first 20% they will continue to get on as you increase the percentage.  The only reason they would change to off is if you set the percentage down to 10:90, for example.

    Here's a brief article on how we bucket: https://help.split.io/hc/en-us/articles/360030024391-How-does-Split-ensure-a-consistent-user-experience-

    dave

    0
    Comment actions Permalink
  • Dave Murphy

    You are correct, that the Default Rule is probably the best way to do this (though not the only way).

    dave

    0
    Comment actions Permalink
  • senright

    Thanks for the clarification Dave!

    0
    Comment actions Permalink

Please sign in to leave a comment.