Skip to content

Sharpness Retention

This metric evaluates the stability of fine details by monitoring the evolution of edge gradients. Successful numeric scores are official: they enter the quality dimension and the public leaderboard vector. We propose a vectorized Tenengrad method: independently compute the sum of absolute gradients in the horizontal (GxG_x) and vertical (GyG_y) directions, and construct a 2-D sharpness vector to capture texture-direction features:

gt=(∑∣Gx∣∑∣Gy∣)(6)\mathbf{g}_t = \begin{pmatrix} \sum |G_x| \\ \sum |G_y| \end{pmatrix} \tag{6}

where GxG_x and GyG_y are Sobel responses (3×33\times3 kernel) on the grayscale frame ItI_t.

A noise-aware circuit breaker distinguishes true detail from high-frequency artifacts. Let ntn_t be the BRISQUE noise score at frame tt and τ\tau a noise threshold. When high noise (nt>τn_t > \tau) occurs for 55 consecutive frames, the triggered state is Itrig=1I_{\mathrm{trig}}=1. The fusing penalty logic MM combines texture similarity with the breaker state (similarity S(⋅,⋅)S(\cdot,\cdot) follows the cosine inner product in Eq. (3)):

BRISQUE is undefined for a zero-variance frame. Such a frame receives the configured worst-case brisque_bad value and remains in the aggregate, so a collapse to a flat or black frame is penalized rather than silently excluded as a missing score.

M(xt)={S(gt,g1),Itrig=0  ∧  nt<τclip ⁣(1−S(gt,g1), 0, 0.2),otherwise(11)M(x_t) = \begin{cases} S(\mathbf{g}_t, \mathbf{g}_1), & I_{\mathrm{trig}} = 0 \;\wedge\; n_t < \tau \\[4pt] \mathrm{clip}\!\bigl(1 - S(\mathbf{g}_t, \mathbf{g}_1),\, 0,\, 0.2\bigr), & \text{otherwise} \end{cases} \tag{11}

An upper-convex logarithmic transform L(⋅)L(\cdot) enhances low-to-mid score segments (x∈[0,1]x \in [0,1], avoiding undefined logarithms and preserving normalization):

L(x)=ln⁡(1+k⋅x)ln⁡(1+k),k>0(10)L(x) = \frac{\ln(1 + k \cdot x)}{\ln(1 + k)}, \quad k > 0 \tag{10}

where kk controls the upper-convex degree; k∈[10,20]k \in [10, 20] is common in vision pipelines. The numerator ensures x=0⇒L(x)=0x=0 \Rightarrow L(x)=0; the denominator ensures x=1⇒L(x)=1x=1 \Rightarrow L(x)=1.

Temporal aggregation uses normalized exponentially decaying weights w^(d)\hat{w}(d) (Eq. (5) in the brightness-consistency metric, d∈[1,T−1]d \in [1, T-1]). The comprehensive score is:

SSharpness=∑d=1T−1w^(d)⋅L ⁣(M(xd+1))(12)S_{\mathrm{Sharpness}} = \sum_{d=1}^{T-1} \hat{w}(d) \cdot L\!\left(M(x_{d+1})\right) \tag{12}

where S(gt,g1)S(\mathbf{g}_t, \mathbf{g}_1) is the cosine similarity between the sharpness vector of frame tt and the initial frame. This mechanism distinguishes genuine detail from high-frequency noise and penalizes systematic visual collapse.

Audit manifest: docs/assets/metric_examples/curated_same_case_manifest.json.

Input image: image_static_photorealistic_terrestrial_landscape_0152
Input image
Input verified · same benchmark case · gap 0.8467

image_static_photorealistic_terrestrial_landscape_0152

Suite: image_staticScene: photorealistic / outdoor / terrestrial_landscape
Benchmark prompt target

Camera pan right. A desert canyon with rock formations, distant horizon, and sand.

prompt source: prompt_target

Both first frames passed geometric matching against the displayed input; labels compare this metric only.

Model result videos will be available with the ModelScope release. / 模型推理视频将在 ModelScope 方案上线后提供。

Higher metric scoreScore 0.9725

Model result videos will be available with the ModelScope release. / 模型推理视频将在 ModelScope 方案上线后提供。

Lower metric scoreScore 0.1258
Input image: image_static_photorealistic_passageways_0128
Input image
Input verified · same benchmark case · gap 0.8771

image_static_photorealistic_passageways_0128

Suite: image_staticScene: photorealistic / indoor / passageways
Benchmark prompt target

Camera pan left. A modern hallway with potted plant, artwork, and hallway extension.

prompt source: prompt_target

Both first frames passed geometric matching against the displayed input; labels compare this metric only.

Model result videos will be available with the ModelScope release. / 模型推理视频将在 ModelScope 方案上线后提供。

Higher metric scoreScore 0.9749

Model result videos will be available with the ModelScope release. / 模型推理视频将在 ModelScope 方案上线后提供。

Lower metric scoreScore 0.0978
Input image: image_static_stylized_living_spaces_0096
Input image
Input verified · same benchmark case · gap 0.8513

image_static_stylized_living_spaces_0096

Suite: image_staticScene: stylized / indoor / living_spaces
Benchmark prompt target

Camera pan right. A modern living space with hallway, neon lights, and artwork.

prompt source: prompt_target

Both first frames passed geometric matching against the displayed input; labels compare this metric only.

Model result videos will be available with the ModelScope release. / 模型推理视频将在 ModelScope 方案上线后提供。

Higher metric scoreScore 0.9514

Model result videos will be available with the ModelScope release. / 模型推理视频将在 ModelScope 方案上线后提供。

Lower metric scoreScore 0.1001