Level III Core · Portfolio Performance Evaluation

Style Analysis and Manager Skill in Performance Appraisal

Updated 8 October 2026 · Fact-checked

Performance appraisal asks whether a manager's excess return came from skill or luck. You test it with the information ratio, up and down capture ratios, returns-based style analysis, and a t-test on active returns. Skill needs a positive, statistically significant active return that is consistent and fits the stated style.

Understand Performance Appraisal: Manager Skill and Style Analysis

Performance appraisal comes after measurement and attribution. Measurement says what the return was. Attribution says where it came from. Appraisal asks the hard question: is the manager good, or was the manager lucky? Clients use the answer to hire, keep or fire managers.

Start with active return: portfolio return minus benchmark return. Active return alone is not enough. A manager who beats the benchmark by 2% while taking large active bets is different from one who does it with small bets. The information ratio (IR) fixes this. It divides mean active return by tracking risk, the standard deviation of active returns. It is a reward-per-unit-of-active-risk measure.

Capture ratios show how the manager behaves in different markets. The up-capture ratio is the manager's return in up-benchmark periods divided by the benchmark's return in those periods. The down-capture ratio does the same for down periods. You want up capture above 100% and down capture below 100%. The capture ratio (up ÷ down) above 1 suggests favourable asymmetry. This is useful because it shows whether the manager adds value in rising markets, falling markets, or both.

Style analysis asks what the manager actually does. Returns-based style analysis regresses the portfolio's returns on the returns of style indexes, with constrained weights that are non-negative and sum to 1. The weights show the effective style mix. The residual, called the selection return, is the portion not explained by the style indexes. It may reflect skill, but it can also reflect noise, omitted styles or a poor choice of style indexes. Holdings-based style analysis looks at the actual securities and classifies them, for example by size, value or growth. It is more precise but needs holdings data and is often available only periodically. Style drift, where the effective style departs from the mandate, is a red flag even if returns are good.

Finally, test significance. Mean active return is only an estimate. Use a t-test: t = mean active return ÷ (tracking risk ÷ √n). A high t-statistic means the result is unlikely to be pure chance. Short track records, high tracking risk and small average active returns all make significance hard to reach. Even a significant result can reflect a favourable period, so combine the numbers with a look at process.

Key rules to remember

Active return: Active return = R(portfolio) − R(benchmark); Calculate it each period, then take the mean and the standard deviation.
Information ratio: IR = mean active return ÷ tracking risk; Tracking risk is the standard deviation of active returns. Keep both on the same time basis, for example annualised.
Up-capture ratio: Up capture = manager's average return in up-benchmark periods ÷ benchmark's average return in those periods; Above 100% is desirable. Use only periods when the benchmark return is positive.
Down-capture ratio: Down capture = manager's average return in down-benchmark periods ÷ benchmark's average return in those periods; Below 100% is desirable, since the manager loses less than the benchmark.
Capture ratio: Capture ratio = up capture ÷ down capture; Above 1 suggests favourable asymmetry.
t-statistic of mean active return: t = mean active return ÷ (tracking risk ÷ √n); n is the number of periods. Compare with a critical value using n − 1 degrees of freedom. t = IR × √n only when the IR is calculated on the same period basis as n (for example, annual IR with n years).
Returns-based style analysis: R(p) = w1·R(index 1) + … + wk·R(index k) + e, with wi ≥ 0 and Σwi = 1; The weights show effective style. The residual e is the selection return, the part not explained by the style indexes.

How to solve Performance Appraisal: Manager Skill and Style Analysis questions

Use this sequence for any question on manager skill or style. Tie the conclusion to what the question asks, such as hire, retain or fire.

1Identify the benchmark and the period length. Check that returns are on the same basis (monthly, annual).
2Compute active returns for each period, then the mean active return.
3Compute tracking risk as the standard deviation of active returns. Annualise both numbers consistently if asked.
4Calculate the information ratio, or the t-statistic using n as the number of periods.
5If asked about capture, split periods by the sign of the benchmark return. Average each group and divide by the benchmark's average in that group.
6For style, read the regression weights. Compare them to the mandate and look for drift and a large unexplained residual.
7State a conclusion in one or two sentences: skill is supported or not, and why (significance, consistency, style fit).
8Add one caveat if the sample is short or the benchmark is poorly matched.

Quickest way: Fast skill check

When to use it: Use this on item-set questions where numbers are given and you must pick the best conclusion.

Find mean active return and tracking risk. If IR is given, skip to the next step.
Compute t = IR × √n only when the IR is on the same period basis as n (for example, annual IR with n years).
Compare t with the critical value given. If t is below it, the skill is not significant.
For capture, check the direction: up above 100% and down below 100% is the good combination.
Eliminate options that claim proof of skill from a short sample or that ignore style drift.

Common mistakes in Performance Appraisal: Manager Skill and Style Analysis

Calling a positive active return proof of skill
Candidates treat the average as a fact, not an estimate with error.
Fix: Always check significance with the t-statistic and sample length before saying skill.
Using total standard deviation in the information ratio
It is confused with the Sharpe ratio.
Fix: IR uses tracking risk, the standard deviation of active returns, in the denominator.
Mixing monthly and annual figures
Mean is given annually and tracking risk monthly, or the other way round.
Fix: Put both on the same basis before dividing. Annualise the standard deviation by multiplying by √12 for monthly data.
Reading a low down-capture ratio as bad
Candidates think a lower number means worse performance.
Fix: Down capture measures losses relative to the benchmark. Below 100% means smaller losses, which is good.
Ignoring style drift when returns are good
Candidates focus on the outperformance number.
Fix: Compare effective style weights with the mandate. Drift means the client is not getting the exposure it hired, and that raises risk to the total plan.
Letting style weights go negative or not sum to 1 in the explanation
Style regression is mixed up with an ordinary unconstrained regression.
Fix: Remember the standard returns-based setup constrains weights to be non-negative and sum to 1.

Worked examples

Example 1

A manager's mean annual active return over 9 years is 1.80%, with tracking risk of 3.00% a year. Calculate the information ratio and the t-statistic. The critical t-value at the chosen level is 2.31. Is the active return significant?

Show the solution

IR = 1.80% ÷ 3.00% = 0.60.
Standard error of the mean = 3.00% ÷ √9 = 3.00% ÷ 3 = 1.00%.
t = 1.80% ÷ 1.00% = 1.80. Check: IR × √n = 0.60 × 3 = 1.80.
Compare: 1.80 is below 2.31.

Answer: IR = 0.60 and t = 1.80. Since 1.80 is below 2.31, the active return is not statistically significant, so skill is not supported at that level.

Example 2

Over 6 months the benchmark returned +4%, −2%, +6%, −5%, +2%, −3%. The manager returned +5%, −1%, +7%, −3%, +3%, −2%. Calculate the up-capture ratio, the down-capture ratio and the capture ratio.

Show the solution

Up months (benchmark positive): +4, +6, +2. Benchmark average = 12 ÷ 3 = 4.00%.
Manager in those months: +5, +7, +3. Average = 15 ÷ 3 = 5.00%.
Up capture = 5.00 ÷ 4.00 = 125%.
Down months: −2, −5, −3. Benchmark average = −10 ÷ 3 = −3.333%.
Manager in those months: −1, −3, −2. Average = −6 ÷ 3 = −2.00%.
Down capture = −2.00 ÷ −3.333 = 60%.
Capture ratio = 125% ÷ 60% = 2.08.

Answer: Up capture is 125%, down capture is 60%, and the capture ratio is about 2.08. The manager gains more than the benchmark in rising months and loses less in falling months, though six months is too short to prove skill.

Exam tips

When a question says 'evaluate skill', mention both size and statistical significance of active return, then the sample length.
Show the t-statistic calculation. A correct number typed alone earns credit, but working protects you if the question has several parts.
Read command words: 'calculate' needs a number, 'justify' needs a reason tied to the data, and 'recommend' needs a decision.
In style questions, link the finding to the client's mandate. Drift matters because the client expects a specific exposure.
Check units first: monthly versus annual numbers cause most lost points in IR items.

Performance Appraisal: Manager Skill and Style Analysis: frequently asked questions

What is a good information ratio?

There is no single cut-off in the curriculum. Higher is better, and a positive IR must still be tested for significance. Judge it with sample length and the consistency of active returns.

What is the difference between returns-based and holdings-based style analysis?

Returns-based analysis regresses portfolio returns on style index returns to infer the effective style. Holdings-based analysis classifies the actual securities held. Holdings-based is more precise but needs holdings data, while returns-based needs only return series.

How do up and down capture ratios differ from the information ratio?

Capture ratios show how the manager behaves when the benchmark rises and when it falls. The information ratio gives one reward-for-active-risk number. Use capture ratios to understand the pattern and IR to compare efficiency.

Why does a long track record matter for skill?

The standard error of mean active return falls as the number of periods rises. More data makes it easier to separate skill from luck. A short record can produce a high average by chance.