# Prompt panel change worksheet

Panel changes and comparable observations

Record a prompt-panel change before comparing its results. Preserve the original observations, reconcile retained, changed, retired and added cells, then report a matched subset separately from a new full-panel series. Use the editable worksheet first and consult the complete fictional handoff and guide as you work.

Pack version 1.0 · 17 September 2026. Worksheet version 1.0.

Guide: https://rankecho.io/resources/prove/prompt-panel-drift

## Your panel change worksheet

Document what changed, reconcile the denominators, and give a client a clear comparison note. The completed fictional handoff includes the new-series decision and a separate matched result.

AI VISIBILITY PANEL CHANGE RECORD — version 1.0
Manual worksheet. Save each panel and its observations before changing the next version.

Decision and scope
Client / category:
Reason to update the panel and supporting buyer evidence:
Old panel version and saved location:
New panel version and approval date:
Old / new observation windows and collection schedule:
Owner and report reviewer:

Match specification — register before classifying results
Stable cell ID: prompt ID + named surface + repeat slot
Compare exact prompt text and revision, named surface, locale, session/account context, repeat slot and outcome/ownership rule.
Store the complete definitions behind context and rule labels.
State any unavailable model label and known provider changes.
Use equal cell weights in this worksheet; do not silently change weights.

Panel difference ledger — one row per union cell ID
ID | old wording/revision | new wording/revision | changed fields | retained/changed/retired/added | reason | original evidence

Observation ledger — one row per planned cell per window
Panel version | window | cell ID | observed/unavailable/failed | owned link true/false/null | raw-answer or failure-record pointer
An observed negative is false. Missing observations have null outcomes.

Reconciliation
Old planned = retained + changed + retired
New planned = retained + changed + added
For each window: planned = observed + unavailable + failed
Show positive / observed for each full panel as separate snapshots.
Match only retained cells observed in both windows.
Matched positive / matched observed for each window:
Matched coverage = common observed / retained eligible:
Gains / reversals / persisted positives / persisted negatives:
List every retained cell missing from the matched result.
Zero observed denominator = not available; never 0%.

Report decision
Start a new full-panel series when membership or a material field changes.
Publish the matched subset separately with its scope, missingness and limitations.
If no defensible common subset exists, report no matched comparison.
Do not recreate old answers by running new prompts today.
Next panel version / observation date / accountable owner:

COMPLETED FICTIONAL HANDOFF
Client: Northline onboarding analytics; no real client or provider was measured.
The panel is updated for an enterprise question and two branded support questions. This is a supplied teaching decision, not measured buyer demand.
Old: onboarding-v1, 10 August 2026, 10:00–11:00 UTC.
New: onboarding-v2, 10 September 2026, 10:00–11:00 UTC.
Preserve P01–P05; revise P06; retire P07–P08; add P09–P10.
One fictional surface, en-US, one repeat slot, new signed-out sessions, unavailable model label, unchanged owned-link-v1 rule; equal cell weights.
P01–P04 are observed in both windows. P05 is unavailable before and failed after.
Old: 8 planned, 7 observed, 1 unavailable, 0 failed; 2/7 = 28.6% positive.
New: 8 planned, 7 observed, 0 unavailable, 1 failed; 5/7 = 71.4% positive.
Retained eligible: 5; common observed: 4; matched coverage: 4/5 = 80.0%.
Matched: 2/4 = 50.0% in both windows; change 0.0 percentage points; one gain and one reversal.
Decision: begin onboarding-v2 as a new full-panel series. Keep the P01–P04 comparison as a separate descriptive subset and retain P05 as missing.
Client summary: The new panel has a higher snapshot rate, but it asks a different mix of questions. The four unchanged, jointly observed cells show no net rate change, with one gain and one reversal. This does not establish wider visibility improvement or a campaign effect.
Next action: the fictional account analyst schedules the unchanged v2 panel for 10 October 2026, records P05's availability, and has the report owner review the scope before distribution.

Limits: supplied fictional classifications and pointers; no raw provider answers, live collection, identity verification, traffic, ranking, conversion or causal effect. A pointer's presence does not verify its contents.

Manual companion worksheet with fictional data. It does not retrieve answers or modify a tracking account.

## When does a prompt update break a visibility trend?

A panel is the particular set of questions and run conditions you chose to observe. Adding branded support questions, removing difficult category questions, changing a country or rewriting a comparison changes that selection. A higher percentage afterward can reflect those choices. The chart no longer answers exactly the same question even if it still has eight rows and the same metric label.

Updating the panel can be sensible. A product launch, new buyer role or obsolete question may justify a new version. Profound's own prompt-design guidance recommends maintaining the list as customer questions evolve. Preserve the reason and supporting buyer evidence; relevance and historical comparability are separate decisions.

Use this guide when a team has two versions to reconcile. For choosing an initial SaaS panel, use the prompt portfolio. For a before/after test with unchanged configuration, use fixed-prompt retesting. A panel-change record is the handoff between those tasks and the monthly report.

- [Read Profound's prompt-list guidance](https://www.tryprofound.com/blog/how-to-design-prompts-for-ai-visibility-tracking)
- [Choose and version SaaS prompts](https://rankecho.io/templates/prompt-portfolio-b2b-saas)
- [Run a frozen-panel retest](https://rankecho.io/resources/prove/fixed-prompt-retest)

## What should you save before editing the panel?

Export or save the exact old questions, IDs, settings, observations and collection windows before making changes. Save the new list separately with a version, change reason, approval date and owner. Retain the original answer and failure records; a later rerun cannot reconstruct what an engine returned last month.

For every planned cell, record the verbatim question and revision, named surface, country/language, session and account context, repeat slot, and the complete outcome and URL-ownership rule. A cell means one prompt on one surface in one scheduled repeat slot. Keep the measurement unit and weighting explicit. The worked protocol gives every cell equal weight.

NIST's measurement guidance supports documenting test sets and methods, with limits on generalization. The exact fields and decision rules here are an original reporting protocol. They are not a provider standard or a claim that a fixed prompt sample represents the distribution of real customer searches.

- [Review NIST's measurement documentation guidance](https://airc.nist.gov/airmf-resources/playbook/measure/)
- [Open the existing registration template](https://rankecho.io/templates/prompt-portfolio)

## Which cells can remain comparable?

Join versions by a stable cell ID, then compare the underlying fields. The same ID is insufficient when its wording or scope changed. Under this conservative protocol, even a wording correction receives a new revision and stays outside the retained subset. Do not decide that two questions are equivalent after seeing which comparison looks better.

Classify each union ID as retained, changed, retired or added. Retained means all declared match fields agree; changed means the ID exists in both versions but at least one field differs. A missing run is a separate observation state, not a panel deletion. Only retained cells with inspectable observations in both windows enter the matched denominator.

Register the field checks and intended subset before interpreting outcomes. If the audit happens afterward, disclose that it is retrospective and publish all exclusions. A separately labeled common subset can help describe continuity, but it does not repair the changed full-panel trend or guarantee representative results.

| Case | Panel classification | Reporting treatment |
| --- | --- | --- |
| Exact fields agree; both observations exist | Retained, matched | Compare within the explicitly named subset. |
| Exact fields agree; an observation is missing | Retained, incomplete | Keep in eligible coverage; leave out of paired rates. |
| Same ID, different wording, context or rule | Changed | New version; do not pair the old and new answers. |
| Only in the old / new list | Retired / added | Preserve the old record / start a new observation history. |


## What changed in the worked example?

Northline is a fictional onboarding analytics product. Two teaching panels each contain eight planned cells on one fictional search surface, in English for the US, with one repeat slot and an unchanged supplied owned-link rule. The windows are 10 August and 10 September 2026, 10:00–11:00 UTC. No provider was called, and these are supplied classifications rather than real captured answers.

P01–P05 retain their configuration. P06 moves from a startup question to an enterprise SSO question and receives revision 2. P07–P08 are retired; P09–P10 add branded support questions. That is five retained, one changed, two retired and two added IDs. The teaching decision illustrates a composition shift; it is not a recommendation to add branded prompts to improve a score.

| ID / disposition | Old question and outcome | New question and outcome |
| --- | --- | --- |
| P01 · retained | Which onboarding analytics tools fit a small SaaS team? — Owned link | Which onboarding analytics tools fit a small SaaS team? — Owned link |
| P02 · retained | Which onboarding analytics tools support account-level funnels? — Owned link | Which onboarding analytics tools support account-level funnels? — No owned link |
| P03 · retained | Which onboarding analytics tools connect with a CRM? — No owned link | Which onboarding analytics tools connect with a CRM? — Owned link |
| P04 · retained | How can a SaaS team compare onboarding analytics pricing? — No owned link | How can a SaaS team compare onboarding analytics pricing? — No owned link |
| P05 · retained | Which onboarding analytics tools export event data? — unavailable | Which onboarding analytics tools export event data? — failed |
| P06 · changed | What onboarding analytics options work for startups? — No owned link | Which enterprise onboarding analytics tools support SSO? — Owned link |
| P07 · retired | Which onboarding analytics tools support legacy spreadsheets? — No owned link | Not in new panel |
| P08 · retired | Which onboarding analytics tools need no event instrumentation? — No owned link | Not in new panel |
| P09 · added | Not in old panel | How does the fictional Northline product explain its onboarding reports? — Owned link |
| P10 · added | Not in old panel | Where does the fictional Northline product document its CRM connector? — Owned link |


## Why does the headline rise while the matched rate stays flat?

The old snapshot has two owned-link positives among seven observed cells: 2/7 = 28.6%. The new snapshot has five among seven: 5/7 = 71.4%. The arithmetic difference is 42.9 percentage points, but the observed sets differ. Reporting it as an improvement in the same visibility series would conceal the changed questions.

P01–P04 are the four retained cells observed in both windows. P01 remains positive, P02 reverses, P03 gains and P04 remains negative. The matched result is 2/4 = 50.0% in each window, a net change of 0.0 percentage points. A flat rate therefore does not mean that every answer stayed the same.

The three observed old cells outside that subset are all negative; their three new counterparts are all positive. Those counterparts include a rewritten question and different membership, so they are not paired gains. The full-panel difference cannot distinguish a genuine temporal change from the effect of selecting different questions. No statistical significance, population lift or causal effect is estimated.

| Report line | Old | New | Meaning |
| --- | --- | --- | --- |
| Full-panel snapshot | 2/7 = 28.6% | 5/7 = 71.4% | Different observed question sets; separate series. |
| Matched P01–P04 | 2/4 = 50.0% | 2/4 = 50.0% | One gain, one reversal; no net rate change. |
| Matched completeness | 4 common observed / 5 retained eligible | 80.0% across both windows | P05 remains missing; not a confidence score. |


## How should missing observations affect the report?

P05 is unavailable in the old window and failed in the new one. Each panel therefore has eight planned and seven observed cells. Its null outcomes are not negatives, gains or reversals. Keep P05 in the retained eligible count so that four common observations out of five eligible retained cells remain visible as 80.0% matched coverage.

Do not use that coverage percentage as a quality threshold. Missingness may cluster in a surface or question type and make the remaining subset less useful for the decision. Report the IDs, states and reasons, and follow the registered retry schedule. Do not repeatedly rerun only failures or negatives until the number improves.

When there are no jointly observed retained cells, the matched rate and change are not available. Zero divided by zero is undefined. Show the new-panel snapshot if it has observations, preserve the gap, and schedule a new baseline. A clean-looking zero would communicate a result that was never observed.

- [Review owned-link units and denominators](https://rankecho.io/resources/prove/citation-rate)

## What should the client comparison note say?

Use the completed worksheet's summary: the new panel has a higher snapshot rate but a different question mix; the four unchanged, jointly observed cells show no net rate change, with one gain and one reversal. Name the missing fifth retained cell and state that the result does not establish broader improvement or a campaign effect.

Start onboarding-v2 as a new full-panel series and mark the transition date on the report. Keep the old series accessible. Present the common subset as a separate descriptive comparison, with its own IDs, denominator and limitations. Never splice its rate into the old full-panel line or invent historical observations for the newly added prompts.

For an important planned transition, consider collecting both frozen versions during a declared overlap window before retiring the old schedule, if the team has the capacity. That supplies contemporaneous snapshots; it still does not prove which change caused an outcome. The next action in this example is an unchanged v2 observation on 10 October, with P05's status retained for review.

- [Place the note in the monthly client report](https://rankecho.io/resources/prove/agency-monthly-ai-visibility-report)
- [Attach the detailed comparison record](https://rankecho.io/templates/proof-report)

## What can still change when your prompts stay fixed?

Google describes differences between AI Mode and AI Overviews and their possible use of related searches to build answers. Record the actual surface rather than combining product labels as though they were one environment. An API, a consumer app and a search feature need separate definitions.

An unchanged recorded configuration cannot freeze an external provider's model, retrieval, index, source pages or account behavior. Record known changes and unavailable labels. If a material observed condition breaks the match, exclude it transparently; if the condition is unknown, keep that uncertainty attached to any descriptive subset.

Panel drift concerns the questions and recorded conditions you selected. Answer volatility concerns repeat-to-repeat outcomes under fixed groups. Neither a repaired panel nor a stable rate proves that a page edit caused a citation. Identified referrals, visits and paid conversions require their own measurement records.

- [Read Google's AI-feature explanation](https://developers.google.com/search/docs/appearance/ai-features)
- [Measure repeat-to-repeat answer variation](https://rankecho.io/resources/prove/answer-volatility)
- [Keep traffic and conversion measures separate](https://rankecho.io/resources/prove/citation-to-session-to-conversion)

## How can RankEcho support the next observation window?

Once the team approves a stable configuration, the Proof Loop can support same-prompt observations after a recorded shipment. Preview the actual workflow, then evaluate it for recurring checks with recorded timing and sample limits. The panel-change worksheet remains a companion record that a person prepares and reviews.

This guide does not describe a native panel-migration tool, automated historical matching or a correction factor for a changed score. RankEcho does not turn the fictional common-cell formula into a causal result. Keep the version decision and any manual reconciliation with the report instead of assuming a dashboard has performed them.

- [Preview the Proof Loop](https://rankecho.io/demo/proof)
- [Explore ongoing same-prompt observations](https://rankecho.io/product/proof-loop)

## Can I add prompts without losing historical data?

Keep the original version and its observations, and start the changed full panel as a new series. Check the tracking tool's actual history and export behavior before editing; this worksheet does not guarantee any vendor's storage behavior.

## Can I compare prompts with similar wording?

This conservative protocol excludes revised wording from the matched subset. Similar intent is useful for organizing a library, but does not establish equivalent observation conditions.

## What percentage of prompts must remain unchanged?

There is no universal threshold here. Report retained and jointly observed counts, the excluded tasks and missingness, then judge whether the remaining subset answers the specific client question.

## Does a flat matched rate mean nothing changed?

No. The example has one gain and one reversal, leaving the aggregate rate at 50.0%. Report those transitions alongside the net difference.

## Use this pack

The two eight-cell panels are fictional teaching inputs. Their full-panel rates are 2/7 and 5/7; the four matched cells remain 2/4 in each window, with one gain and one reversal. Preserve P05 as missing. This pack does not collect provider answers or establish traffic, ranking, conversion or causal effects.

Preview the Proof Loop — https://rankecho.io/demo/proof. Explore ongoing same-prompt observations — https://rankecho.io/product/proof-loop. Panel reconciliation, assignment design and capacity planning remain external work.