When dealing with large datasets or external API calls, it’s often essential to process customer records in batches rather than all at once. Adobe Campaign doesn’t provide a direct activity to split and iterate over a dataset in defined batch sizes. However, with a smart configuration using out-of-the-box activities like Split, Complement, Test, and Wait, you can achieve this easily.
Business Scenario:
Imagine a case where you need to send personalized communications or trigger third-party calls for each customer—in fixed-size batches. You don’t know how many total records (X) you’ll have, but you do know that each batch should contain N records (e.g., 500).
Below is the basic approach we would be following to address the need:
Check Record Volume:
Use a Test activity to determine if the input record count (X) is greater than your desired batch size (N).
If X ≤ N, process the entire record set in one go.
If X > N, proceed to batch logic.
Split and Complement Logic:
Use a Split activity with Random Sampling to extract the first batch of size N.
Enable “Generate Complement” to create a second outbound transition with the remaining records.
Use this complement as the input for the next loop iteration.
Loop Continuously Until Complete:
Place a Wait activity (optional) before repeating the batch logic to space out processing.
Continue looping until the complement becomes zero (no records left to process).
This looping setup helps in optimizing performance, managing third-party rate limits, and preventing delivery overload.
Show time, try creating below configuration on Adobe Campaign Workflow to make it happen:
Configuration Highlights:
The batch size (N) can be configured dynamically using variables or constants.
Ideal for campaigns that need controlled, scheduled delivery or API-driven execution per batch.
Avoids timeout or performance issues common with large datasets.
Key Benefits:
Modular and scalable.
Reduces system load.
Works with native Adobe Campaign capabilities—no custom JavaScript needed.
Perfect for data export, API requests, or phased delivery.
Conclusion:
If you’re managing high-volume data operations in Adobe Campaign, using this batch-based loop processing technique gives you full control over execution. It’s particularly helpful for technical workflows, automated sends, or any task requiring precise segmentation and pacing.