Overview
Results between two environments may not match exactly if they are not maintained identically. For instance, many of our clients have both a “production” and a “staging” environment. It's important to make sure that the same actions are taken in each environment. Otherwise, you could potentially see different results. The following sections explain some common reasons why.
Results Do Not Appear or Appear With Different Values
The active rules differ between production & staging environments (e.g. rules deactivated, rules not approved).
Different Global Settings are enabled/disabled in each environment.
You are uploading a different position in the XML file in staging.
There are different aggregation structures in production & staging.
There are different disaggregation setups in each environment.
The portfolios/entities have different rule folders in production & staging.
The data overrides are different in production & staging.
The RegData has changed since the file was last run.
The disclosure history (which can be seen in the Results Chart) is not the same due to different disclosure values and imported disclosures.
Most rules rely on yesterday’s results, which will need to be the same across environments.
Some rules also rely on Historic Disclosure values (e.g. LastDisclosureValue, LastDisclosureValue).
Results With the Same Value Have Different Status' (e.g. OK Instead of Warning)
You have a different warning level set-up at entity/rule or combined level
Otherwise, same as “Results Not Appearing."
Next Steps
Export portfolios from the production environment & import to staging to ensure they are the same.
Export data overrides from the production environment & import to staging to ensure they are the same.
Export the disaggregation file from the production environment & import it to staging to ensure they are the same.
Ensure all imported disclosures are the same in both environments.
Ensure all rules are approved in the production and staging environments.
Ensure both environments have the same Global Settings enabled.