Add Flow Action: Remove Duplicate Objects by Key

[isaac-vicentini]

This contribution adds a reusable Flow Action that removes duplicate objects from a JSON array based on a specified key. It is designed to simplify data cleanup and normalization in Flows and Subflows.

How It Works

The Flow Action accepts a JSON array of objects and removes duplicates according to a field specified by the user.
You can choose whether to keep the first or last occurrence, and optionally make the comparison case-insensitive and trim whitespace before evaluating duplicates.

Inputs

array: JSON string representing an array of objects to process.
Example:

[
  {"email":" [email protected] ","name":"A"},
  {"email":"[email protected]","name":"A-dup"},
  {"email":"[email protected]","name":"B"}
]

key: Object field name used to detect duplicates. Example: email.
keep: Determines whether to keep the first or last occurrence of duplicated entries.
case_insensitive: When true, treats field values as case-insensitive ([email protected] equals [email protected]).
trim: When true, trims whitespace before comparing values (e.g., " [email protected] " equals "[email protected]").

Outputs

JSON object containing the cleaned list and metadata:

{
  "success": true,
  "count_in": 3,
  "count_out": 2,
  "removed": 1,
  "items": [
    {"email":"[email protected]","name":"A"},
    {"email":"[email protected]","name":"B"}
  ]
}

Example Use Case

Use this Action to remove duplicate user records by email before performing bulk insert or update operations via Flow Designer.
This helps ensure data integrity, especially when processing large datasets or integrating external APIs.

[github-actions]

✅ Valid PR for ActionPack

Thank you for your contribution. This PR complies with the CONTRIBUTING.md.
A maintainer will review this shortly. In the meantime, Happy Hacking!

[SapphicFire]

Looks good to me! Thank you for your contribution