How can I limit and deduplicate results from multiple Data Sources within one Selection?

Advanced Source Limiting allows you to limit the number of records returned from each individual data source tab within a Selection, and apply deduplication across them, ensuring you keep the priority records for your Selection. This gives you more precise control over how much data is retrieved from each source, compared to the standard Source Limiting feature.

This feature is especially useful when working with multiple data sources and you want to include only a specific number of records from each, rather than applying a global limit across all sources.

How it works
When Advanced Source Limiting is enabled, each data source tab in your Selection will show a Limit field. This allows you to set a custom number of records to retrieve from each tab. You can choose to:

• Set a different limit for each data source.
• Just limit some sources, while leaving others uncapped
• Preview the total results and understanding where records are coming from

Once the limits are set and the Selection is executed, DESelect will apply the limits per source and combine the results accordingly, automatically applying deduplication across the different sources, and keeping the priorities you've set.

How to enable Advanced Source Limiting

1. In your Selection, go to Output Screen > Tools > Source Limiting > Enable
2. Enable the "Apply Deduplication Between Sources" toggle
3. You'll see a list of all the sources of your Selection, and you'll be able to limit the number of records you want to keep per Source, and determine the deduplication priority

After you run your Selection, you'll be able to see the number of records each source generated, so that you can determine if you need to further limit your sources or not.