Test A/B

The A / B Test is a technique used by marketing and communication teams to optimize the content of a campaign before impacting the entire user base.

It consists of sending the same campaign with different formats to a small group of users (control group). After some time (approximately 24 hours) the results of all formats are compared, and the most successful one is sent to the entire user base (audience). Avoid sending the control group so that they do not receive the same campaign twice.

The indigitall platform offers this functionality so that this process is very simple and comfortable, so that you can use this A / B test technique regularly in your day to day, and that in this way you can optimize your campaigns based on real data of user response.

The creation form is very similar to creating a normal push campaign. The difference are:

You must upload at least 2 different creatives for the same campaign.
In the shipping methods tab you can find:

• Smart shipping: Automatic method
• Manual shipping: You must specify the number of devices that will be part of the control group. After a while (about 24 hours), you must enter the console to see which format has been more successful to send it to the rest of the unaffected audience.

Versions

The creation of each notification is the same as when you create a new campaign.

In the usage panel you will see that there are two options, A and B, although you have up to 5 options / versions C, D and E that you can use at the same time in the same campaign, just by clicking on the plus icon / symbol . To delete a version, the one you want to delete must be selected and then click on the minus symbol.

During the test each device receives only one notification, regardless of the number of versions. Some users will receive notification A, others B,…, but in no case two versions of the same campaign.
Versions can be shipped via manual delivery or smart sending.

During the test each device receives only one notification, regardless of the number of versions. Some users will receive notification A, others B,…, but in no case two versions of the same campaign.

Versions can be shipped via manual delivery or smart sending.

Filters

With the filters you can segment to whom to send notifications in a personalized way.
Choose the country or region, if they are users who have not entered your website or app for a long time, or by the type of device that subscribed to your notifications.

Filters affect the number of devices that will receive the final notification.

🚧

Exception

In the case of campaigns that are sent automatically, the counter will not show a result of the number of devices to which it will be sent.

Segments/Topics

Devices subscribed to: the campaign will be sent to devices that are subscribed to a specific topic.
Devices that are not subscribed: the campaign will be sent to devices that are not subscribed to the specific topics.

External Applications

Send campaigns to devices that have applications such as Facebook, Twitter or Spotify installed.

List of devices

You can establish a list of device IDs, so the campaign will be sent to the list made up of these devices.

You must upload a .csv file with the word deviceld in the first line and a deviceld for each line.

DeviceIds are device identifiers of end users. It is an anonymous data, generated by indigitall when a new device is registered. It looks like this: xxxxxxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx

Example:
list.csv
deviceId
6abcf613-e4e6-xxxx-a5d1-9533fe655e61
69b26254-aacd-xxxx-98c3-525fc7bff440
89b99158-2144-xxxx-b1df-d298649f934b
...

You can also use your own identifiers (for example, email, user ID in your CRM, etc) to create the list in .csv. In this case, you must load the .csv file with externalId as header (first line) and your identifiers in each of the other lines.

Statistics with Manual shipping

If you click on the statistics button, you will see the campaigns that have been sent and the number of clicks that have been made in each of them. You will be able to see which of the campaigns you have used for testing are the ones that have obtained the best results. Through CTR (Click Through Rate) with this metric we will be able to know how many clicks have been obtained from the total impressions launched and consequently which has been the campaign with the best data.

Choose the one you want to send to the rest of the users. On the left is a "Submit" button.

Status of an A/B Test

Created tests can be in one of these states:

Completed: Has been sent to all devices in the campaign.
Submitted: Manual submission of all versions is complete.
In Progress: The campaign is being sent by smart sending.
Canceled: the test has been canceled.
Error: An error has occurred.
Pending: the test has been created successfully but smart submission has not started yet.