Skip to content

A.1. How to read the results

Criteria for confidence bands, correlation coefficients and anomaly verdicts

This collects the criteria for deciding how far to trust a number when one comes back.

1. The confidence band — forecasting​

A forecast chart draws one line with a band above and below it.

The confidence band on a forecast chart

The width of the band is the degree of confidence.

Shape of the bandHow to read it
NarrowThe trend was steady — worth relying on
WideIt was erratic — treat it as indicative only
Widens with distanceNormal. The further ahead, the less certain

When reading off when the limit is reached​

Look at when the top of the band reaches it, not the forecast line. You have to take the worst case to be prepared for it.

2. The correlation coefficient — correlation analysis​

How far two metrics moved together, as a value between -1 and 1.

ValueHow to read it
0.7 and aboveThey clearly moved together
0.4 to 0.7They moved together to some extent
Below 0.4Almost no relationship
NegativeThey moved in opposite directions

A negative value is not meaningless. Some pairs are supposed to move in opposite directions, such as "free memory ↓ response time ↑". Judge the strength by the absolute value, not the sign.

A high value does not make it the cause​

Both may have been driven by a third factor. A correlation result is a narrowed list of candidate causes, not a confirmed cause (Chapter 402).

3. Lead and lag — which moved first​

An A → B combination also tells you which one moved first.

  • If A moved first, look into A first
  • If they moved at the same time, both may be consequences of something else

4. The anomaly verdict — anomaly detection​

It calculates what "normal" is and judges by how far a value departs from it.

IndicationMeaning
A large departureClearly different from normal
Sitting on the boundaryAmbiguous — check what was happening at that time

What to think of first​

Deployments, batches and events are flagged even though they are normal. Look more closely only when nothing comes to mind (Chapter 404).

5. Execution plan cost — SQL​

cost is an estimate made by the database.

  • It is not seconds
  • It cannot be compared with the cost of another query or another database
  • The ■ bar is a size relative to that plan

It is a value for seeing which part of the same plan is heavier (Chapter 503).

What to suspect first​

When a result looks wrong, work through it in this order.

The order to suspect things in when a result looks wrong

The habit of not taking an answer at face value​

  • Verify numbers and any command it tells you to run
  • Expand CogentAI's thoughts above the answer
  • Look at the charts and tables it based the answer on

Next​