All dimensions

Dimension · score weight 0%

Stylometric Analysis

What this dimension detects

Stylometry captures sentence length, Markdown usage, punctuation density, and list patterns. It is retained as a diagnostic because style can be useful for human inspection, but it is too easy to steer for scoring.

Algorithm

Compute response-level style features, average them across samples, and compare the vector with coarse stored centroids. Report the closest style family and the claimed model score as diagnostic context.

Thresholds

ConditionVerdict contribution
Closest style family matches claimed familyDiagnostic match
Closest style family differsDiagnostic anomaly
Any resultScore contribution remains 0

Limitations

Style is highly prompt-dependent and can be changed by system prompts, decoding settings, or output rewriting. It is useful for explaining results, not for scoring them.

References

  • TrueLLMs lib/identity-audit/index.ts analyzeStylometry

Back to the full methodology