# A/B Test Advanced Settings

## A/B Test Advanced Settings

## **Advanced Settings**

In the "Settings" section marked with a gear icon, you can configure advanced settings such as traffic allocation, minimum test duration, significance threshold, and enabling the anti-flicker feature.

### Traffic Allocation

In traffic allocation, you can adjust the distribution ratio for each pattern. If distributing 50% to each pattern carries too much risk, you can set a smaller distribution ratio for the test pattern.

Additionally, in the test settings, you can customize the test duration and significance threshold. The default settings are recommended, but generally you can keep them as is without any issues.

**Equal Distribution**: Distributes traffic equally among each pattern.

**Custom**: Allocate the percentages so they total 100%. You can also use this to increase traffic to better-performing patterns after the A/B test begins.

### **Target Audience**

For instructions on configuring the target audience, please refer to [this](/en/experience/campaign/create-new-2/advanced-settings.md) article.

### **Experience Goal**

For instructions on setting goals, please refer to [this](/en/experience/campaign/create-new-2/advanced-settings.md) article.

### **Evaluation Criteria**

The duration of Ptengine A/B tests is determined by the thresholds of "significance threshold" and "minimum test duration". This allows you to control the accuracy and determination period of your test.

#### **Minimum Test Duration**

The minimum test duration setting prevents the test results from being determined within the period set after starting the test.

Considering the impact of day of week, the default recommended value is set to 7 days.

The minimum test duration can be changed between 3 and 14 days.

> **WARNING** **Tip: Configuration Examples for Significance Threshold and Minimum Test Duration**
>
> Set them according to your workflow and test importance as shown below.
>
> \<Want to run tests quickly! (Duration: Short / Accuracy: Low)>
>
> * Significance Threshold: 90%
> * Minimum Test Duration: 3 days
>
> \<Want to run on a weekly basis while maintaining accuracy (Duration: Standard / Accuracy: Recommended)>
>
> * Significance Threshold: 95%
> * Minimum Test Duration: 7 days
>
> \<Want to proceed with certainty even if it takes time (Duration: Long / Accuracy: High)>
>
> * Significance Threshold: 98%
> * Minimum Test Duration: 14 days

#### **Significance Threshold**

The significance threshold is the probability at which a version can be determined to be superior compared to other versions.

The default is set at 95% or higher. When the significance threshold exceeds 95%, the test winner is confirmed, and the determination result is displayed on the report screen, taking into account the minimum test duration.

The significance threshold determination interval can be changed from "95%" to either "90%" or "98%".

The lower the percentage, the shorter the test duration, but the accuracy decreases.

Conversely, the higher the percentage, the longer the test duration tends to be, and the accuracy increases.

### Anti-Flicker Feature

The anti-flicker feature covers the phenomenon where the original page briefly appears when editing a page by using a white-out.

The flickering phenomenon can be reduced through the implementation method of Ptengine's base tag.

It is disabled by default.

The usage of the anti-flicker feature differs depending on how the base tag is implemented. For more details, please check [this](/en/experience/campaign/create-new-2/advanced-settings.md) article.

### **Publishing Your Experience**

Finally, check the item "I have reviewed the experience I created and the settings" and click the publish button to publish.

After completing the A/B test, [analyze the A/B test results](/en/experience/campaign/create-new-2/advanced-settings.md).


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://helps.ptengine.com/en/experience/campaign/create-new-2/advanced-settings.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.