FMEPRD-306 Add Warehouse Native Experimentation Beta Documentation #11720

alai97 · 2025-10-09T18:26:47Z

Thanks for contributing to the Harness Developer Hub! Our code owners will review your submission.

Description

Please describe your changes: Adds beta documentation (a new doc set) for Warehouse Native Experimentation and a release note. Also adds tooltips (thanks Richard!) and diagrams (no screenshots yet).
Jira/GitHub Issue numbers (if any): https://harness.atlassian.net/browse/FMEPRD-306
Preview links/images (Internal contributors only): https://68f9247db33680be65638095--harness-developer.netlify.app/docs/feature-management-experimentation/warehouse-native

PR lifecycle

We aim to merge PRs within one week or less, but delays happen sometimes.

If your PR is open longer than two weeks without any human activity, please tag a code owner in a comment.

PRs must meet these requirements to be merged:

Successful preview build.
Code owner review.
No merge conflicts.
Release notes/new features docs: Feature/version released to at least one prod environment.

bot-gitexp-user · 2025-10-09T18:56:02Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68e804ec9c504d025149fd8a--harness-developer.netlify.app

docs/feature-management-experimentation/warehouse-native/setup/index.md

bot-gitexp-user · 2025-10-10T19:12:33Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68e95a4e78d7ceff0f777ea3--harness-developer.netlify.app

richardblack-Harness

A few nits around style guide adherence and strongly tab usage for less toil for users and sharability.

docs/feature-management-experimentation/warehouse-native/setup/index.md

docs/feature-management-experimentation/warehouse-native/index.md

docs/feature-management-experimentation/warehouse-native/setup/index.md

bot-gitexp-user · 2025-10-15T02:34:21Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68ef07bfcf6fbbeb55b93449--harness-developer.netlify.app

bot-gitexp-user · 2025-10-15T02:35:13Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68ef080cdc34b7ec83596126--harness-developer.netlify.app

bot-gitexp-user · 2025-10-15T18:56:45Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68efee17d5f88fb9e81c7ec1--harness-developer.netlify.app

docs/feature-management-experimentation/warehouse-native/setup/metric-sources.md

bot-gitexp-user · 2025-10-16T17:11:08Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f126d8d92a336832ffc049--harness-developer.netlify.app

richardblack-Harness · 2025-10-21T09:20:32Z

Checked the preview, the 'Connect your Data Warehouse items are empty'
Consider the DMS component for these to keep the content contained to one page: https://harness.atlassian.net/wiki/spaces/HDH/pages/22466920790/Dynamic+Markdown+Selector+Component

warehouse-native-experiments.mp4

release-notes/feature-management-experimentation.md

bot-gitexp-user · 2025-10-21T18:13:45Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f7cd04e34746fc57d2535b--harness-developer.netlify.app

bot-gitexp-user · 2025-10-21T18:16:50Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f7cdbe7f6647fba0b55e5b--harness-developer.netlify.app

bot-gitexp-user · 2025-10-21T18:17:38Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f7cdef1a0b7c95e042b463--harness-developer.netlify.app

richardblack-Harness

Approving with the understanding that we flesh out the empty "Connect your Data Warehouse" items in a subsequent PR.

Otherwise, looks great.

bot-gitexp-user · 2025-10-22T18:12:52Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f91e4e47c61632e06ca0a2--harness-developer.netlify.app

docs/feature-management-experimentation/warehouse-native/setup/configure-assignments.md

docs/feature-management-experimentation/warehouse-native/setup/configure-metrics.md

bot-gitexp-user · 2025-10-22T18:18:27Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f91f9e17e496140587a97d--harness-developer.netlify.app

bot-gitexp-user · 2025-10-22T18:26:33Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f9218247c6163e666c9dfd--harness-developer.netlify.app

audreydo1 · 2025-10-22T18:27:25Z

docs/feature-management-experimentation/warehouse-native/setup/metric-sources.md

+
+| **Example Raw Schema**                                                                                    | **Transformations**                                                                                                                                                                                                                |
+| --------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
+| `account_id`  <br /> `metric_type`  <br /> `metric_value`  <br /> `created_at` | • Map `account_id` → `user_id`. <br /> • Map `metric_type` → `event_name`. <br /> • Standardize `metric_value` → `event_value`. |


"Map account_id --> key"

mapping account to user may be confusing here, we just want them to identify it as the generic unique ID

Suggested change

| `account_id` `metric_type` `metric_value` `created_at` | • Map `account_id` → `user_id`. • Map `metric_type` → `event_name`. • Standardize `metric_value` → `event_value`. |

| `account_id` `metric_type` `metric_value` `created_at` | • Map `account_id` → `key`. • Map `metric_type` → `event_name`. • Standardize `metric_value` → `event_value`. |

audreydo1 · 2025-10-22T18:29:16Z

...0-experimentation/experiment-results/viewing-experiment-results/metric-details-and-trends.md

We don't support dimensional analysis for WHN yet, so we may want to take this part out

audreydo1 · 2025-10-22T18:31:23Z

docs/feature-management-experimentation/shared/metrics/index.md

Remove mentions of metrics impact tab

audreydo1 · 2025-10-22T18:31:54Z

...ation/warehouse-native/experiment-results/analyze-experiment-results/dimensional-analysis.md

Let's remove this from the WHN section because we don't support dimensional analysis yet

audreydo1 · 2025-10-22T18:34:42Z

...entation/warehouse-native/experiment-results/view-experiment-results/metrics-impact-cards.md

Remove metrics impact mentions

bot-gitexp-user · 2025-10-22T18:39:11Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f9247db33680be65638095--harness-developer.netlify.app

bot-gitexp-user · 2025-10-22T18:41:45Z

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://68f92516e7a9a46532411186--harness-developer.netlify.app

alai97 · 2025-10-22T18:42:23Z

docs/feature-management-experimentation/shared/metrics/index.md

+A metric measures [events](/docs/feature-management-experimentation/experimentation/events/) that are sent to Harness FME. Metrics can be defined to count the occurrence of events, measure event values, or measure event properties.

-Metric results are calculated for each treatment of a feature flag that shares the same traffic type as the metric and has a percentage targeting rule applied. Impact can be calculated between a selected comparison treatment and baseline treatment within a feature flag. Results are displayed on the [Metrics impact tab](https://help.split.io/hc/en-us/articles/360020844451) of the feature flag.
+Metric results are calculated for each treatment of a feature flag that shares the same traffic type as the metric and has a percentage targeting rule applied. Impact can be calculated between a selected comparison treatment and baseline treatment within a feature flag. Results are displayed on the [Metrics impact tab](/docs/feature-management-experimentation/experimentation/experiment-results/viewing-experiment-results/metrics-impact-cards) of the feature flag.


Suggested change

Metric results are calculated for each treatment of a feature flag that shares the same traffic type as the metric and has a percentage targeting rule applied. Impact can be calculated between a selected comparison treatment and baseline treatment within a feature flag. Results are displayed on the [Metrics impact tab](/docs/feature-management-experimentation/experimentation/experiment-results/viewing-experiment-results/metrics-impact-cards) of the feature flag.

Metric results are calculated for each treatment of a feature flag that shares the same traffic type as the metric and has a percentage targeting rule applied. Impact can be calculated between a selected comparison treatment and baseline treatment within a feature flag.

FMEPRD-306

efa51c7

alai97 requested review from dtk-DaveKarow, ivikramsahu, richardblack-Harness and wei-harness as code owners October 9, 2025 18:26

alai97 added 2 commits October 9, 2025 11:37

Fix Links

4169bab

More Links

58580a6

Merge branch 'main' into add-warehouse-native-docs

0e1da68

alai97 commented Oct 10, 2025

View reviewed changes

docs/feature-management-experimentation/warehouse-native/setup/index.md Outdated Show resolved Hide resolved

alai97 commented Oct 10, 2025

View reviewed changes

docs/feature-management-experimentation/warehouse-native/setup/index.md Outdated Show resolved Hide resolved

Wording Nit

11178c7

richardblack-Harness requested changes Oct 13, 2025

View reviewed changes

Add Beta Badge + Create Metrics Page

845c065

alai97 requested a review from pratmit as a code owner October 15, 2025 02:22

Merge branch 'main' into add-warehouse-native-docs

b182192

alai97 added 4 commits October 15, 2025 11:26

Replace Experiment Results + Add Integrations

687e4ed

Add Formatting

620f957

Update Tabs

be7fd4a

Fix Link

e6356a0

alai97 requested a review from richardblack-Harness October 15, 2025 18:49

alai97 commented Oct 16, 2025

View reviewed changes

docs/feature-management-experimentation/warehouse-native/setup/metric-sources.md Outdated Show resolved Hide resolved

Add Bullet

c481435

Remove BigQuery and Trino

84f4bc4

Add Redshift and Snowflake Content (#11757)

3c2e675

alai97 commented Oct 21, 2025

View reviewed changes

release-notes/feature-management-experimentation.md Outdated Show resolved Hide resolved

release-notes/feature-management-experimentation.md Outdated Show resolved Hide resolved

release-notes/feature-management-experimentation.md Outdated Show resolved Hide resolved

Bump Release Date

5760c2a

richardblack-Harness previously approved these changes Oct 21, 2025

View reviewed changes

Replace Experiment Results Screenshot + Remove CUPED

28755a5

alai97 dismissed richardblack-Harness’s stale review via 28755a5 October 22, 2025 18:05

Clarify FME Settings (or Admin?)

ffa6779

alai97 commented Oct 22, 2025

View reviewed changes

docs/feature-management-experimentation/warehouse-native/setup/configure-assignments.md Outdated Show resolved Hide resolved

alai97 commented Oct 22, 2025

View reviewed changes

docs/feature-management-experimentation/warehouse-native/setup/configure-metrics.md Outdated Show resolved Hide resolved

Update Navigation

b74ab51

alai97 added 2 commits October 22, 2025 11:33

Replace Analyze Results Screenshot

2b481b5

Swap Images

925b887

audreydo1 reviewed Oct 22, 2025

View reviewed changes

alai97 commented Oct 22, 2025

View reviewed changes

	\| `account_id` <br /> `metric_type` <br /> `metric_value` <br /> `created_at` \| • Map `account_id` → `user_id`. <br /> • Map `metric_type` → `event_name`. <br /> • Standardize `metric_value` → `event_value`. \|
	\| `account_id` <br /> `metric_type` <br /> `metric_value` <br /> `created_at` \| • Map `account_id` → `key`. <br /> • Map `metric_type` → `event_name`. <br /> • Standardize `metric_value` → `event_value`. \|

FMEPRD-306 Add Warehouse Native Experimentation Beta Documentation #11720

Are you sure you want to change the base?

FMEPRD-306 Add Warehouse Native Experimentation Beta Documentation #11720

Conversation

alai97 commented Oct 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

PR lifecycle

Uh oh!

bot-gitexp-user commented Oct 9, 2025

Uh oh!

Uh oh!

Uh oh!

bot-gitexp-user commented Oct 10, 2025

Uh oh!

richardblack-Harness left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bot-gitexp-user commented Oct 15, 2025

Uh oh!

bot-gitexp-user commented Oct 15, 2025

Uh oh!

bot-gitexp-user commented Oct 15, 2025

Uh oh!

Uh oh!

bot-gitexp-user commented Oct 16, 2025

Uh oh!

richardblack-Harness commented Oct 21, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

bot-gitexp-user commented Oct 21, 2025

Uh oh!

bot-gitexp-user commented Oct 21, 2025

Uh oh!

bot-gitexp-user commented Oct 21, 2025

Uh oh!

richardblack-Harness left a comment

Choose a reason for hiding this comment

Uh oh!

bot-gitexp-user commented Oct 22, 2025

Uh oh!

Uh oh!

Uh oh!

bot-gitexp-user commented Oct 22, 2025

Uh oh!

bot-gitexp-user commented Oct 22, 2025

Uh oh!

audreydo1 Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

alai97 Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

audreydo1 Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

audreydo1 Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

audreydo1 Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

audreydo1 Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

bot-gitexp-user commented Oct 22, 2025

Uh oh!

bot-gitexp-user commented Oct 22, 2025

Uh oh!

alai97 Oct 22, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

alai97 commented Oct 9, 2025 •

edited

Loading