How to iterate customer records in batches – AC

When dealing with large datasets or external API calls, it’s often essential to process customer records in batches rather than all at once. Adobe Campaign doesn’t provide a direct activity to split and iterate over a dataset in defined batch sizes. However, with a smart configuration using out-of-the-box activities like Split, Complement, Test, and Wait, you can achieve this easily.

Business Scenario:

Imagine a case where you need to send personalized communications or trigger third-party calls for each customer—in fixed-size batches. You don’t know how many total records (X) you’ll have, but you do know that each batch should contain N records (e.g., 500).

Below is the basic approach we would be following to address the need:

  1. Check Record Volume:

    • Use a Test activity to determine if the input record count (X) is greater than your desired batch size (N).

    • If X ≤ N, process the entire record set in one go.

    • If X > N, proceed to batch logic.

  2. Split and Complement Logic:

    • Use a Split activity with Random Sampling to extract the first batch of size N.

    • Enable “Generate Complement” to create a second outbound transition with the remaining records.

    • Use this complement as the input for the next loop iteration.

  3. Loop Continuously Until Complete:

    • Place a Wait activity (optional) before repeating the batch logic to space out processing.

    • Continue looping until the complement becomes zero (no records left to process).

This looping setup helps in optimizing performance, managing third-party rate limits, and preventing delivery overload.

Show time, try creating below configuration on Adobe Campaign Workflow to make it happen:

Batch-Processing-Detail

Configuration Highlights:

  • The batch size (N) can be configured dynamically using variables or constants.

  • Ideal for campaigns that need controlled, scheduled delivery or API-driven execution per batch.

  • Avoids timeout or performance issues common with large datasets.

Key Benefits:

  • Modular and scalable.

  • Reduces system load.

  • Works with native Adobe Campaign capabilities—no custom JavaScript needed.

  • Perfect for data export, API requests, or phased delivery.

Conclusion:

If you’re managing high-volume data operations in Adobe Campaign, using this batch-based loop processing technique gives you full control over execution. It’s particularly helpful for technical workflows, automated sends, or any task requiring precise segmentation and pacing.

(Visited 881 times, 1 visits today)