解决 GRPO 优势归因错误,Chunk-GRPO 让文生图模型更懂"节奏"

文本到图像(T2I)生成模型的发展速度超出很多人的预期。从 SDXL 到 Midjourney,再到最近的 FLUX.1,这些模型在短时间内就实现了从模糊抽象到逼真细腻的跨越。但问题也随之而来——如何让模型生成的不仅仅是"一张图",而是"正确的那张图"？这涉及到如何让 AI 理解人类在审美、风格和构图上的真实偏好。

强化学习(RL)成为解决这个问题的关键技术。通过将人类偏好分数作为奖励信号,可以对这些大模型进行微调。群体相对策略优化(GRPO)是近期比较热门的方案。但清华大学和快手的研究团队最近发现,这个方法存在一个隐藏的根本性缺陷。

这个缺陷会让模型学错东西,即便最终生成的图像看起来还不错。论文"SAMPLE BY STEP, OPTIMIZE BY CHUNK: CHUNK-LEVEL GRPO FOR TEXT-TO-IMAGE GENERATION"提出了一个叫 Chunk-GRPO 的解决方案,思路直接并且效果出众,算是训练生成模型思路上的一次转向。

GRPO 的问题:不准确的优势归因

要理解 Chunk-GRPO 做了什么,得先搞清楚现有方法的问题出在哪。论文把这个问题叫做"不准确的优势归因"(inaccurate advantage attribution)。

可以用一个类比来说明。假设你在教学徒做酸面团面包,整个流程有 17 个步骤。学徒做了两个面包——面包 A 各方面都很棒,面包 B 勉强及格。作为师傅,你给 A 打了高分(+10),给 B 打了低分(+2)。

标准 GRPO 的做法相当于告诉学徒:"面包 A 的每一个步骤都比 B 好。"它把最终的高分奖励追溯性地分配给制作 A 的所有 17 个步骤。

但实际情况可能是,做 A 的第 3 步时学徒差点打翻面团,而做 B 的第 3 步手法其实很标准。标准 GRPO 仍然会奖励 A 的糟糕第 3 步,惩罚 B 的正常第 3 步,就因为最终结果不同。这就是"不准确的优势归因"——模型被强化的某个具体动作,单独看其实是个错误。训练几千次之后,这种错误的反馈信号会让模型困惑,导致训练不稳定,效果也达不到最优。

论文用图像生成的真实案例展示了这个问题:

轨迹1有更好的最终图像，但与轨迹2相比，有更差的中间步骤(t=1)。说明标准GRPO如何错误地奖励轨迹1中的坏步骤。

除了归因不准确,还有第二个相关问题:忽略时间动态。做面包的 17 个步骤重要程度其实不同——步骤 1 到 5 是建立面团基础结构,步骤 6 到 12 是发酵和发展,步骤 13 到 17 是烘烤收尾。每个阶段的作用和特点都不一样。

在基于流匹配(flow-matching)的 T2I 生成中也是类似的情况。模型从纯噪声开始,逐步细化成连贯图像。早期时间步决定整体构图和主体,做大幅度的粗调整;中间步骤细化形状,添加中等细节;最后的步骤打磨光照、纹理这些精细元素。标准 GRPO 对决定"这是只猫"的步骤和细化猫眼睛反光的步骤给予相同的优化权重,这既低效,也违背了生成过程本身的阶段性特征。

Chunk-GRPO 的核心思路:按块而非按步优化

Chunk-GRPO 的解决方案很简单:停止对每个步骤做微观管理,改为按阶段思考。不再评估每个单独的步骤,而是把相关步骤分组成"块"(chunk),对每个块的整体表现进行评估。

还是面包的例子。与其对 17 个步骤逐一反馈,不如评估三个阶段:混合揉面阶段(步骤 1-5)面团基础建得怎么样?发酵整形阶段(步骤 6-12)发酵控制和整形技巧如何?烘烤冷却阶段(步骤 13-17)温度掌握和外皮发展是否到位?

在块级别优化的好处是,第 3 步那个小失误会被整个"混合揉面"块的表现平均掉。如果这个块里其他步骤都做得好,块整体还是算成功的。这种方法对偶发的孤立错误更加泛化,也更符合专家实际教学和学习复杂技能的方式——不是把知识切成无数个离散点,而是按连贯的多步骤动作来组织。

"动作分块"(action chunking)这个概念在机器人学等领域已经被证明很有效,能帮机器人学会流畅的长时程任务,而不是生硬的逐步动作。Chunk-GRPO 论文是首次系统性地把这个思路应用到 T2I 模型的强化学习微调中。

具体机制上,Chunk-GRPO 改变了优化目标。它不再为每个时间步

t

计算重要性比率(importance ratio,衡量策略变化的指标),而是为整个块

j

计算一个重要性比率,方法是取该块内所有步骤重要性比率的几何平均值。然后把最终的优势值(来自最终图像的奖励)应用到这个块级的单一数值上。

从步骤级到块级优化的转变直接缓解了不准确归因的问题。一个原本不错的步骤序列中出现的单个坏步骤,不会再获得不该有的奖励。优化信号变得更平滑也更稳定,能更真实地反映该生成阶段的实际贡献。

但这带来一个关键问题:怎么确定块的边界?是分 3 块、5 块还是其他?每块大小要相同吗?论文的第二个巧妙之处就在这里。

时间动态引导的分块策略

如果随意把 17 个生成步骤分成 4、4、4、5 这样的块,确实已经比步骤级优化好了。并且论文的消融实验证实,几乎任何形式的分块都优于不分块。

但他们想知道:能不能找到一种有原则的方法来定义块边界?生成过程是否存在某种自然的内在结构可供参考?

他们通过分析流匹配过程的时间动态(temporal dynamics)找到了线索。使用的指标是相对 L1 距离

L1_rel

,本质上衡量图像的潜在表示从一个时间步到下一步的变化幅度——高值表示剧烈变化,低值表示微调细化。

当把这个指标在 FLUX.1 模型的生成时间步上画出来时,他们发现了一个规律:

流匹配的提示不变时间动态，显示跨时间步的L1_rel距离曲线。曲线应该在开始时显示高值，在中间下降，在结束时上升。注释图表以显示生成的"阶段"："结构定义"、"细化"和"细节刻画"。

图表显示出清晰、一致且与提示无关的模式。不管模型生成的是"一只猫坐在垫子上"还是"火星上降落的宇宙飞船",创作的节奏都是一样的。

早期时间步的

L1_rel

值很高,模型在做大幅度跳跃,把纯噪声转化为基本构图,这是粗略草图阶段。中间时间步

L1_rel

降低,变化变得细致,模型在细化形状、清理构图、填补细节,相当于上色和阴影阶段。后期时间步

L1_rel

可能再次上升,模型添加高频细节、纹理和最终光效,进入打磨阶段。

这个动态曲线提供了一种数据驱动的自然分割方式。作者据此实现了时间动态引导的分块(temporal-dynamic-guided chunking),在生成节奏发生变化的位置设置块边界。

针对 17 个采样步骤的实验,他们采用了 4 个块,大小分别是

[2, 3, 4, 7]

。这不是随便定的,反映的是模型自身的行为特征:块 1(大小 2)是定义宏观结构的初始混乱阶段;块 2(大小 3)和块 3(大小 4)是图像成型的核心细化期;块 4(大小 7)是添加细节和打磨输出的漫长收尾阶段。

这就是 Chunk-GRPO 的关键。它不只是简单地把步骤凑成组,而是把它们分成与模型内部工作流对应的、语义上有意义的阶段。就像听艺术家的创作过程,在每个主要阶段结束时给反馈,而不是每一笔都打断。

技术细节:从步骤级到块级的数学转换

对想深入了解的读者,这里拆解一下 Chunk-GRPO 的具体机制。得先看标准 GRPO 的目标函数。

步骤级 GRPO 的数学形式

在流匹配的标准 GRPO 中,策略(T2I 模型,记为

θ

)通过最大化目标

J(θ)

来更新。简化后大致是这样:

 J(θ) ≈ Σ_i Σ_t [ r_t^i(θ) * A^i ]

这里

i

是给定提示下生成的每张图像的索引。

t

是时间步,从

1

到

T

。

A^i

是第

i

张图像的优势(advantage),通过比较最终图像的奖励与组内平均奖励计算得到。关键是,

A^i

对所有时间步

t

都相同——这就是"不准确优势归因"问题的数学体现。

r_t^i(θ)

是时间步

t

的重要性比率,衡量新策略

θ

相对旧策略

θ_old

在该步骤上的转换概率比值,反映策略的变化程度。

优化过程会推动策略增加那些导致高优势图像的步骤的概率。但因为

A^i

是常数,所有步骤都被同等地推动。

块级方案的重构

Chunk-GRPO 重新定义了这个目标。不对每个时间步

t

求和,而是对数量更少的块

j

求和:

 J(θ) ≈ Σ_i Σ_j [ r_j^i(θ) * A^i ]

优势

A^i

还是一样的(基于最终图像),但重要性比率现在定义在块级别。论文把块级重要性比率

r_j^i(θ)

定义为该块内步骤级比率的几何平均:

 r_j^i(θ) = ( Π_{t ∈ ch_j} r_t^i(θ) )^(1/cs_j)

其中

ch_j

是块

j

包含的时间步集合,

cs_j

是块

j

的大小,

Π

表示连乘。

https://vk.com/topic-233839539_54770855

https://vk.com/topic-233839538_54550581

https://vk.com/topic-233218707_55343925

https://vk.com/topic-233839533_54357299

https://vk.com/topic-233839532_54731527

https://vk.com/topic-233839531_55621702

https://vk.com/topic-233839530_55144189

https://vk.com/topic-233839529_54770854

https://vk.com/topic-233839528_54550580

https://vk.com/topic-233839539_54770853

https://vk.com/topic-233839538_54550578

https://vk.com/topic-233218707_55343923

https://vk.com/topic-233839533_54357298

https://vk.com/topic-233839532_54731526

https://vk.com/topic-233839531_55621699

https://vk.com/topic-233839530_55144188

https://vk.com/topic-233839529_54770852

https://vk.com/topic-233839528_54550577

https://vk.com/topic-233839539_54770851

https://vk.com/topic-233839538_54550576

https://vk.com/topic-233218707_55343921

https://vk.com/topic-233839533_54357297

https://vk.com/topic-233839532_54731525

https://vk.com/topic-233839530_55144187

https://vk.com/topic-233839531_55621697

https://vk.com/topic-233839529_54770849

https://vk.com/topic-233839528_54550575

https://vk.com/topic-233839539_54770848

https://vk.com/topic-233839538_54550574

https://vk.com/topic-233218707_55343919

https://vk.com/topic-233839533_54357296

https://vk.com/topic-233839532_54731524

https://vk.com/topic-233839530_55144185

https://vk.com/topic-233839531_55621696

https://vk.com/topic-233839529_54770847

https://vk.com/topic-233839528_54550573

https://vk.com/topic-233839539_54770845

https://vk.com/topic-233839538_54550572

https://vk.com/topic-233218707_55343918

https://vk.com/topic-233839533_54357295

https://vk.com/topic-233839532_54731523

https://vk.com/topic-233839530_55144184

https://vk.com/topic-233839531_55621694

https://vk.com/topic-233839529_54770844

https://vk.com/topic-233839528_54550571

https://vk.com/topic-233839539_54770843

https://vk.com/topic-233839538_54550570

https://vk.com/topic-233218707_55343917

https://vk.com/topic-233839533_54357294

https://vk.com/topic-233839532_54731522

https://vk.com/topic-233839530_55144182

https://vk.com/topic-233839531_55621693

https://vk.com/topic-233839529_54770842

https://vk.com/topic-233839528_54550569

https://vk.com/topic-233839539_54770841

https://vk.com/topic-233839538_54550568

https://vk.com/topic-233218707_55343914

https://vk.com/topic-233839533_54357293

https://vk.com/topic-233839532_54731520

https://vk.com/topic-233839530_55144181

https://vk.com/topic-233839531_55621692

https://vk.com/topic-233839529_54770840

https://vk.com/topic-233839528_54550567

https://vk.com/topic-233839539_54770839

https://vk.com/topic-233839538_54550566

https://vk.com/topic-233218707_55343913

https://vk.com/topic-233839533_54357292

https://vk.com/topic-233839532_54731519

https://vk.com/topic-233839530_55144180

https://vk.com/topic-233839531_55621691

https://vk.com/topic-233839529_54770838

https://vk.com/topic-233839528_54550565

https://vk.com/topic-233839539_54770837

https://vk.com/topic-233839538_54550563

https://vk.com/topic-233218707_55343912

https://vk.com/topic-233839533_54357291

https://vk.com/topic-233839532_54731518

https://vk.com/topic-233839531_55621690

https://vk.com/topic-233839530_55144178

https://vk.com/topic-233839529_54770836

https://vk.com/topic-233839528_54550562

https://vk.com/topic-233839539_54770835

https://vk.com/topic-233839538_54550560

https://vk.com/topic-233218707_55343911

https://vk.com/topic-233839533_54357290

https://vk.com/topic-233839532_54731517

https://vk.com/topic-233839531_55621689

https://vk.com/topic-233839530_55144177

https://vk.com/topic-233839529_54770834

https://vk.com/topic-233839528_54550559

https://vk.com/topic-233839539_54770833

https://vk.com/topic-233839538_54550558

https://vk.com/topic-233218707_55343910

https://vk.com/topic-233839533_54357288

https://vk.com/topic-233839532_54731516

https://vk.com/topic-233839531_55621688

https://vk.com/topic-233839530_55144175

https://vk.com/topic-233839529_54770832

https://vk.com/topic-233839528_54550557

https://vk.com/topic-233839539_54770831

https://vk.com/topic-233839538_54550556

https://vk.com/topic-233218707_55343908

https://vk.com/topic-233839533_54357285

https://vk.com/topic-233839532_54731514

https://vk.com/topic-233839531_55621687

https://vk.com/topic-233839530_55144173

https://vk.com/topic-233839529_54770830

https://vk.com/topic-233839528_54550555

https://vk.com/topic-233839539_54770829

https://vk.com/topic-233839538_54550553

https://vk.com/topic-233218707_55343907

https://vk.com/topic-233839533_54357283

https://vk.com/topic-233839532_54731513

https://vk.com/topic-233839531_55621684

https://vk.com/topic-233839530_55144171

https://vk.com/topic-233839529_54770828

https://vk.com/topic-233839528_54550551

https://vk.com/topic-233839539_54770827

https://vk.com/topic-233839538_54550550

https://vk.com/topic-233218707_55343906

https://vk.com/topic-233839533_54357282

https://vk.com/topic-233839532_54731512

https://vk.com/topic-233839531_55621683

https://vk.com/topic-233839530_55144168

https://vk.com/topic-233839529_54770826

https://vk.com/topic-233839528_54550549

https://vk.com/topic-233839539_54770824

https://vk.com/topic-233839538_54550547

https://vk.com/topic-233218707_55343905

https://vk.com/topic-233839533_54357279

https://vk.com/topic-233839532_54731511

https://vk.com/topic-233839531_55621682

https://vk.com/topic-233839530_55144167

https://vk.com/topic-233839529_54770823

https://vk.com/topic-233839528_54550546

https://vk.com/topic-233839539_54770822

https://vk.com/topic-233839538_54550545

https://vk.com/topic-233218707_55343904

https://vk.com/topic-233839533_54357278

https://vk.com/topic-233839532_54731510

https://vk.com/topic-233839531_55621681

https://vk.com/topic-233839530_55144165

https://vk.com/topic-233839529_54770819

https://vk.com/topic-233839528_54550543

https://vk.com/topic-233839539_54770818

https://vk.com/topic-233839538_54550542

https://vk.com/topic-233218707_55343903

https://vk.com/topic-233839533_54357277

https://vk.com/topic-233839532_54731509

https://vk.com/topic-233839531_55621679

https://vk.com/topic-233839530_55144162

https://vk.com/topic-233839529_54770816

https://vk.com/topic-233839528_54550541

https://vk.com/topic-233839539_54770815

https://vk.com/topic-233839538_54550540

https://vk.com/topic-233218707_55343900

https://vk.com/topic-233839533_54357276

https://vk.com/topic-233839532_54731508

https://vk.com/topic-233839531_55621677

https://vk.com/topic-233839530_55144161

https://vk.com/topic-233839529_54770814

https://vk.com/topic-233839528_54550539

https://vk.com/topic-233839539_54770813

https://vk.com/topic-233839538_54550538

https://vk.com/topic-233218707_55343897

https://vk.com/topic-233839533_54357275

https://vk.com/topic-233839532_54731507

https://vk.com/topic-233839531_55621676

https://vk.com/topic-233839530_55144159

https://vk.com/topic-233839529_54770812

https://vk.com/topic-233839528_54550537

https://vk.com/topic-233839539_54770811

https://vk.com/topic-233839538_54550536

https://vk.com/topic-233218707_55343896

https://vk.com/topic-233839533_54357272

https://vk.com/topic-233839532_54731506

https://vk.com/topic-233839531_55621675

https://vk.com/topic-233839530_55144158

https://vk.com/topic-233839529_54770810

https://vk.com/topic-233839528_54550535

https://vk.com/topic-233839539_54770809

https://vk.com/topic-233839538_54550534

https://vk.com/topic-233218707_55343894

https://vk.com/topic-233839533_54357270

https://vk.com/topic-233839532_54731505

https://vk.com/topic-233839531_55621674

https://vk.com/topic-233839530_55144156

https://vk.com/topic-233839529_54770808

https://vk.com/topic-233839528_54550533

https://vk.com/topic-233839539_54770806

https://vk.com/topic-233839538_54550532

https://vk.com/topic-233218707_55343893

https://vk.com/topic-233839533_54357268

https://vk.com/topic-233839532_54731504

https://vk.com/topic-233839531_55621673

https://vk.com/topic-233839530_55144155

https://vk.com/topic-233839529_54770805

https://vk.com/topic-233839528_54550531

https://vk.com/topic-233839539_54770804

https://vk.com/topic-233839538_54550530

https://vk.com/topic-233218707_55343891

https://vk.com/topic-233839533_54357267

https://vk.com/topic-233839532_54731503

https://vk.com/topic-233839531_55621671

https://vk.com/topic-233839530_55144154

https://vk.com/topic-233839529_54770803

https://vk.com/topic-233839528_54550528

https://vk.com/topic-233839539_54770802

https://vk.com/topic-233839538_54550527

https://vk.com/topic-233218707_55343890

https://vk.com/topic-233839533_54357265

https://vk.com/topic-233839532_54731502

https://vk.com/topic-233839531_55621670

https://vk.com/topic-233839530_55144152

https://vk.com/topic-233839529_54770801

https://vk.com/topic-233839528_54550526

https://vk.com/topic-233839539_54770800

https://vk.com/topic-233839538_54550525

https://vk.com/topic-233218707_55343888

https://vk.com/topic-233839533_54357264

https://vk.com/topic-233839532_54731500

https://vk.com/topic-233839531_55621666

https://vk.com/topic-233839530_55144151

https://vk.com/topic-233839529_54770799

https://vk.com/topic-233839528_54550524

https://vk.com/topic-233839539_54770798

https://vk.com/topic-233839538_54550523

https://vk.com/topic-233218707_55343887

https://vk.com/topic-233839533_54357263

https://vk.com/topic-233839532_54731499

https://vk.com/topic-233839531_55621665

https://vk.com/topic-233839530_55144148

https://vk.com/topic-233839529_54770797

https://vk.com/topic-233839528_54550522

https://vk.com/topic-233839539_54770796

https://vk.com/topic-233839538_54550521

https://vk.com/topic-233218707_55343886

https://vk.com/topic-233839533_54357262

https://vk.com/topic-233839532_54731498

https://vk.com/topic-233839531_55621663

https://vk.com/topic-233839530_55144147

https://vk.com/topic-233839529_54770795

https://vk.com/topic-233839528_54550520

https://vk.com/topic-233839539_54770794

https://vk.com/topic-233839538_54550519

https://vk.com/topic-233218707_55343882

https://vk.com/topic-233839533_54357260

https://vk.com/topic-233839532_54731496

https://vk.com/topic-233839531_55621661

https://vk.com/topic-233839530_55144145

https://vk.com/topic-233839529_54770793

https://vk.com/topic-233839528_54550518

https://vk.com/topic-233839539_54770792

https://vk.com/topic-233839538_54550517

https://vk.com/topic-233218707_55343881

https://vk.com/topic-233839533_54357259

https://vk.com/topic-233839532_54731495

https://vk.com/topic-233839531_55621660

https://vk.com/topic-233839530_55144144

https://vk.com/topic-233839529_54770791

https://vk.com/topic-233839528_54550516

https://vk.com/topic-233839539_54770790

https://vk.com/topic-233839538_54550515

https://vk.com/topic-233218707_55343880

https://vk.com/topic-233839533_54357257

https://vk.com/topic-233839532_54731494

https://vk.com/topic-233839531_55621659

https://vk.com/topic-233839530_55144142

https://vk.com/topic-233839529_54770788

https://vk.com/topic-233839528_54550514

https://vk.com/topic-233839539_54770787

https://vk.com/topic-233839538_54550513

https://vk.com/topic-233218707_55343879

https://vk.com/topic-233839533_54357256

https://vk.com/topic-233839532_54731493

https://vk.com/topic-233839531_55621658

https://vk.com/topic-233839530_55144140

https://vk.com/topic-233839529_54770786

https://vk.com/topic-233839528_54550512

https://vk.com/topic-233839539_54770785

https://vk.com/topic-233839538_54550511

https://vk.com/topic-233218707_55343876

https://vk.com/topic-233839533_54357254

https://vk.com/topic-233839532_54731492

https://vk.com/topic-233839531_55621657

https://vk.com/topic-233839530_55144139

https://vk.com/topic-233839529_54770784

https://vk.com/topic-233839528_54550510

https://vk.com/topic-233839539_54770783

https://vk.com/topic-233839538_54550509

https://vk.com/topic-233218707_55343875

https://vk.com/topic-233839533_54357253

https://vk.com/topic-233839532_54731491

https://vk.com/topic-233839530_55144136

https://vk.com/topic-233839531_55621656

https://vk.com/topic-233839529_54770782

https://vk.com/topic-233839528_54550508

https://vk.com/topic-233839539_54770780

https://vk.com/topic-233839538_54550507

https://vk.com/topic-233218707_55343874

https://vk.com/topic-233839533_54357252

https://vk.com/topic-233839532_54731490

https://vk.com/topic-233839530_55144135

https://vk.com/topic-233839531_55621652

https://vk.com/topic-233839529_54770779

https://vk.com/topic-233839528_54550506

https://vk.com/topic-233839539_54770778

https://vk.com/topic-233839538_54550505

https://vk.com/topic-233218707_55343873

https://vk.com/topic-233839533_54357250

https://vk.com/topic-233839532_54731489

https://vk.com/topic-233839530_55144134

https://vk.com/topic-233839531_55621651

https://vk.com/topic-233839529_54770777

https://vk.com/topic-233839528_54550503

https://vk.com/topic-233839539_54770776

https://vk.com/topic-233839538_54550502

https://vk.com/topic-233218707_55343872

https://vk.com/topic-233839533_54357248

https://vk.com/topic-233839532_54731488

https://vk.com/topic-233839530_55144132

https://vk.com/topic-233839531_55621649

https://vk.com/topic-233839529_54770775

https://vk.com/topic-233839528_54550501

https://vk.com/topic-233839539_54770774

https://vk.com/topic-233839538_54550500

https://vk.com/topic-233218707_55343869

https://vk.com/topic-233839533_54357246

https://vk.com/topic-233839532_54731487

https://vk.com/topic-233839530_55144131

https://vk.com/topic-233839531_55621648

https://vk.com/topic-233839529_54770773

https://vk.com/topic-233839528_54550499

https://vk.com/topic-233839539_54770772

https://vk.com/topic-233839538_54550498

https://vk.com/topic-233218707_55343868

https://vk.com/topic-233839533_54357245

https://vk.com/topic-233839532_54731486

https://vk.com/topic-233839530_55144129

https://vk.com/topic-233839531_55621646

https://vk.com/topic-233839529_54770771

https://vk.com/topic-233839528_54550497

https://vk.com/topic-233839539_54770770

https://vk.com/topic-233839538_54550496

https://vk.com/topic-233218707_55343867

https://vk.com/topic-233839533_54357243

https://vk.com/topic-233839532_54731485

https://vk.com/topic-233839530_55144128

https://vk.com/topic-233839531_55621645

https://vk.com/topic-233839529_54770768

https://vk.com/topic-233839528_54550495

https://vk.com/topic-233839539_54770767

https://vk.com/topic-233839538_54550494

https://vk.com/topic-233218707_55343866

https://vk.com/topic-233839533_54357241

https://vk.com/topic-233839532_54731484

https://vk.com/topic-233839530_55144127

https://vk.com/topic-233839531_55621644

https://vk.com/topic-233839529_54770766

https://vk.com/topic-233839528_54550493

https://vk.com/topic-233839539_54770765

https://vk.com/topic-233839538_54550492

https://vk.com/topic-233218707_55343865

https://vk.com/topic-233839533_54357240

https://vk.com/topic-233839532_54731483

https://vk.com/topic-233839530_55144125

https://vk.com/topic-233839531_55621643

https://vk.com/topic-233839529_54770762

https://vk.com/topic-233839528_54550491

https://vk.com/topic-233839539_54770761

https://vk.com/topic-233839538_54550490

https://vk.com/topic-233218707_55343864

https://vk.com/topic-233839533_54357238

https://vk.com/topic-233839532_54731482

https://vk.com/topic-233839530_55144124

https://vk.com/topic-233839531_55621642

https://vk.com/topic-233839529_54770760

https://vk.com/topic-233839528_54550489

https://vk.com/topic-233839539_54770759

https://vk.com/topic-233839538_54550488

https://vk.com/topic-233218707_55343863

https://vk.com/topic-233839533_54357237

https://vk.com/topic-233839532_54731481

https://vk.com/topic-233839531_55621641

https://vk.com/topic-233839530_55144122

https://vk.com/topic-233839529_54770758

https://vk.com/topic-233839528_54550485

https://vk.com/topic-233839539_54770757

https://vk.com/topic-233839538_54550484

https://vk.com/topic-233218707_55343862

https://vk.com/topic-233839532_54731480

https://vk.com/topic-233839533_54357236

https://vk.com/topic-233839530_55144121

https://vk.com/topic-233839531_55621640

https://vk.com/topic-233839529_54770755

https://vk.com/topic-233839528_54550483

https://vk.com/topic-233839539_54770754

https://vk.com/topic-233839538_54550482

https://vk.com/topic-233839532_54731479

https://vk.com/topic-233839533_54357235

https://vk.com/topic-233839531_55621638

https://vk.com/topic-233839530_55144120

https://vk.com/topic-233839529_54770752

https://vk.com/topic-233839528_54550481

https://vk.com/topic-233839390_55144112

https://vk.com/topic-233839386_54430925

https://vk.com/topic-233839388_54550478

https://vk.com/topic-233839389_54770745

https://vk.com/topic-233839390_55144110

https://vk.com/topic-233839387_55343856

https://vk.com/topic-233839391_55621632

https://vk.com/topic-233839385_53944793

https://vk.com/topic-233839383_54357228

https://vk.com/topic-233839386_54430924

https://vk.com/topic-233839384_54059391

https://vk.com/topic-233839388_54550476

https://vk.com/topic-233839389_54770744

https://vk.com/topic-233839390_55144108

https://vk.com/topic-233839387_55343854

https://vk.com/topic-233839391_55621631

https://vk.com/topic-233839385_53944792

https://vk.com/topic-233839383_54357226

https://vk.com/topic-233839386_54430923

https://vk.com/topic-233839384_54059390

https://vk.com/topic-233839388_54550475

https://vk.com/topic-233839389_54770743

https://vk.com/topic-233839390_55144107

https://vk.com/topic-233839387_55343852

https://vk.com/topic-233839391_55621630

https://vk.com/topic-233839385_53944791

https://vk.com/topic-233839383_54357225

https://vk.com/topic-233839386_54430920

https://vk.com/topic-233839384_54059389

https://vk.com/topic-233839388_54550474

https://vk.com/topic-233839390_55144106

https://vk.com/topic-233839389_54770742

https://vk.com/topic-233839387_55343851

https://vk.com/topic-233839391_55621629

https://vk.com/topic-233839385_53944790

https://vk.com/topic-233839386_54430918

https://vk.com/topic-233839384_54059388

https://vk.com/topic-233839383_54357224

https://vk.com/topic-233839388_54550473

https://vk.com/topic-233839390_55144105

https://vk.com/topic-233839389_54770741

https://vk.com/topic-233839387_55343850

https://vk.com/topic-233839391_55621628

https://vk.com/topic-233839385_53944789

https://vk.com/topic-233839386_54430916

https://vk.com/topic-233839384_54059387

https://vk.com/topic-233839383_54357222

https://vk.com/topic-233839388_54550472

https://vk.com/topic-233839390_55144104

https://vk.com/topic-233839389_54770738

https://vk.com/topic-233839387_55343848

https://vk.com/topic-233839391_55621627

https://vk.com/topic-233839385_53944788

https://vk.com/topic-233839386_54430915

https://vk.com/topic-233839384_54059386

https://vk.com/topic-233839383_54357221

https://vk.com/topic-233839388_54550471

https://vk.com/topic-233839390_55144103

https://vk.com/topic-233839389_54770737

https://vk.com/topic-233839387_55343847

https://vk.com/topic-233839391_55621626

https://vk.com/topic-233839385_53944787

https://vk.com/topic-233839386_54430914

https://vk.com/topic-233839384_54059385

https://vk.com/topic-233839383_54357220

https://vk.com/topic-233839388_54550470

https://vk.com/topic-233839390_55144102

https://vk.com/topic-233839389_54770735

https://vk.com/topic-233839387_55343846

https://vk.com/topic-233839391_55621625

https://vk.com/topic-233839385_53944786

https://vk.com/topic-233839386_54430913

https://vk.com/topic-233839384_54059383

https://vk.com/topic-233839383_54357219

https://vk.com/topic-233839388_54550468

https://vk.com/topic-233839390_55144101

https://vk.com/topic-233839389_54770734

https://vk.com/topic-233839387_55343844

https://vk.com/topic-233839391_55621624

https://vk.com/topic-233839385_53944785

https://vk.com/topic-233839386_54430912

https://vk.com/topic-233839384_54059381

https://vk.com/topic-233839383_54357218

https://vk.com/topic-233839388_54550467

https://vk.com/topic-233839390_55144100

https://vk.com/topic-233839389_54770733

https://vk.com/topic-233839387_55343843

https://vk.com/topic-233839391_55621623

https://vk.com/topic-233839385_53944784

https://vk.com/topic-233839386_54430910

https://vk.com/topic-233839384_54059380

https://vk.com/topic-233839383_54357216

https://vk.com/topic-233839388_54550466

https://vk.com/topic-233839390_55144099

https://vk.com/topic-233839389_54770730

https://vk.com/topic-233839387_55343842

https://vk.com/topic-233839391_55621622

https://vk.com/topic-233839385_53944783

https://vk.com/topic-233839384_54059379

https://vk.com/topic-233839386_54430909

https://vk.com/topic-233839383_54357215

https://vk.com/topic-233839388_54550465

https://vk.com/topic-233839390_55144098

https://vk.com/topic-233839389_54770729

https://vk.com/topic-233839387_55343841

https://vk.com/topic-233839391_55621621

https://vk.com/topic-233839385_53944782

https://vk.com/topic-233839384_54059378

https://vk.com/topic-233839386_54430908

https://vk.com/topic-233839383_54357214

https://vk.com/topic-233839388_54550464

https://vk.com/topic-233839389_54770728

https://vk.com/topic-233839390_55144097

https://vk.com/topic-233839387_55343839

https://vk.com/topic-233839391_55621620

https://vk.com/topic-233839385_53944780

https://vk.com/topic-233839384_54059377

https://vk.com/topic-233839386_54430907

https://vk.com/topic-233839383_54357213

https://vk.com/topic-233839388_54550463

https://vk.com/topic-233839390_55144096

https://vk.com/topic-233839389_54770725

https://vk.com/topic-233839387_55343838

https://vk.com/topic-233839391_55621619

https://vk.com/topic-233839385_53944779

https://vk.com/topic-233839384_54059376

https://vk.com/topic-233839386_54430906

https://vk.com/topic-233839383_54357212

https://vk.com/topic-233839388_54550462

https://vk.com/topic-233839389_54770724

https://vk.com/topic-233839390_55144095

https://vk.com/topic-233839387_55343837

https://vk.com/topic-233839391_55621618

https://vk.com/topic-233839385_53944778

https://vk.com/topic-233839384_54059375

https://vk.com/topic-233839386_54430905

https://vk.com/topic-233839383_54357210

https://vk.com/topic-233839388_54550461

https://vk.com/topic-233839389_54770722

https://vk.com/topic-233839390_55144094

https://vk.com/topic-233839387_55343836

https://vk.com/topic-233839391_55621615

https://vk.com/topic-233839385_53944777

https://vk.com/topic-233839384_54059374

https://vk.com/topic-233839386_54430904

https://vk.com/topic-233839383_54357209

https://vk.com/topic-233839388_54550459

https://vk.com/topic-233839389_54770721

https://vk.com/topic-233839390_55144093

https://vk.com/topic-233839387_55343835

https://vk.com/topic-233839391_55621614

https://vk.com/topic-233839385_53944776

https://vk.com/topic-233839384_54059373

https://vk.com/topic-233839386_54430903

https://vk.com/topic-233839383_54357207

https://vk.com/topic-233839388_54550458

https://vk.com/topic-233839389_54770719

https://vk.com/topic-233839390_55144092

https://vk.com/topic-233839387_55343832

https://vk.com/topic-233839391_55621613

https://vk.com/topic-233839385_53944775

https://vk.com/topic-233839384_54059372

https://vk.com/topic-233839386_54430902

https://vk.com/topic-233839383_54357206

https://vk.com/topic-233839388_54550457

https://vk.com/topic-233839389_54770717

https://vk.com/topic-233839390_55144091

https://vk.com/topic-233839387_55343831

https://vk.com/topic-233839391_55621612

https://vk.com/topic-233839385_53944774

https://vk.com/topic-233839384_54059371

https://vk.com/topic-233839386_54430901

https://vk.com/topic-233839383_54357204

https://vk.com/topic-233839388_54550456

https://vk.com/topic-233839389_54770715

https://vk.com/topic-233839390_55144090

https://vk.com/topic-233839387_55343830

https://vk.com/topic-233839391_55621611

https://vk.com/topic-233839385_53944773

https://vk.com/topic-233839384_54059370

https://vk.com/topic-233839386_54430900

https://vk.com/topic-233839383_54357203

https://vk.com/topic-233839388_54550455

https://vk.com/topic-233839389_54770713

https://vk.com/topic-233839390_55144089

https://vk.com/topic-233839387_55343828

https://vk.com/topic-233839391_55621610

https://vk.com/topic-233839384_54059369

https://vk.com/topic-233839385_53944772

https://vk.com/topic-233839386_54430899

https://vk.com/topic-233839383_54357202

https://vk.com/topic-233839389_54770712

https://vk.com/topic-233839388_54550454

https://vk.com/topic-233839390_55144087

https://vk.com/topic-233839387_55343825

https://vk.com/topic-233839391_55621609

https://vk.com/topic-233839384_54059368

https://vk.com/topic-233839385_53944771

https://vk.com/topic-233839386_54430898

https://vk.com/topic-233839383_54357200

https://vk.com/topic-233839389_54770711

https://vk.com/topic-233839388_54550453

https://vk.com/topic-233839390_55144086

https://vk.com/topic-233839387_55343823

https://vk.com/topic-233839391_55621607

https://vk.com/topic-233839384_54059367

https://vk.com/topic-233839385_53944770

https://vk.com/topic-233839386_54430897

https://vk.com/topic-233839383_54357199

https://vk.com/topic-233839389_54770708

https://vk.com/topic-233839388_54550452

https://vk.com/topic-233839390_55144085

https://vk.com/topic-233839387_55343822

https://vk.com/topic-233839391_55621605

https://vk.com/topic-233839384_54059366

https://vk.com/topic-233839385_53944769

https://vk.com/topic-233839386_54430896

https://vk.com/topic-233839383_54357197

https://vk.com/topic-233839389_54770706

https://vk.com/topic-233839388_54550451

https://vk.com/topic-233839390_55144084

https://vk.com/topic-233839387_55343820

https://vk.com/topic-233839384_54059365

https://vk.com/topic-233839391_55621604

https://vk.com/topic-233839385_53944768

https://vk.com/topic-233839386_54430895

https://vk.com/topic-233839383_54357196

https://vk.com/topic-233839389_54770704

https://vk.com/topic-233839388_54550450

https://vk.com/topic-233839390_55144083

https://vk.com/topic-233839387_55343818

https://vk.com/topic-233839384_54059364

https://vk.com/topic-233839391_55621603

https://vk.com/topic-233839385_53944767

https://vk.com/topic-233839386_54430894

https://vk.com/topic-233839383_54357195

https://vk.com/topic-233839389_54770703

https://vk.com/topic-233839388_54550449

https://vk.com/topic-233839390_55144082

https://vk.com/topic-233839387_55343817

https://vk.com/topic-233839384_54059363

https://vk.com/topic-233839391_55621601

https://vk.com/topic-233839385_53944766

https://vk.com/topic-233839386_54430892

https://vk.com/topic-233839383_54357194

https://vk.com/topic-233839389_54770702

https://vk.com/topic-233839388_54550448

https://vk.com/topic-233839390_55144081

https://vk.com/topic-233839387_55343815

https://vk.com/topic-233839384_54059362

https://vk.com/topic-233839391_55621600

https://vk.com/topic-233839385_53944765

https://vk.com/topic-233839386_54430889

https://vk.com/topic-233839383_54357193

https://vk.com/topic-233839389_54770701

https://vk.com/topic-233839388_54550447

https://vk.com/topic-233839390_55144080

https://vk.com/topic-233839387_55343813

https://vk.com/topic-233839384_54059361

https://vk.com/topic-233839391_55621599

https://vk.com/topic-233839385_53944764

https://vk.com/topic-233839386_54430888

https://vk.com/topic-233839383_54357192

https://vk.com/topic-233839388_54550446

https://vk.com/topic-233839389_54770700

https://vk.com/topic-233839390_55144079

https://vk.com/topic-233839387_55343811

https://vk.com/topic-233839384_54059360

https://vk.com/topic-233839391_55621598

https://vk.com/topic-233839385_53944763

https://vk.com/topic-233839383_54357190

https://vk.com/topic-233839386_54430887

https://vk.com/topic-233839388_54550445

https://vk.com/topic-233839389_54770699

https://vk.com/topic-233839390_55144078

https://vk.com/topic-233839387_55343809

https://vk.com/topic-233839384_54059359

https://vk.com/topic-233839391_55621596

https://vk.com/topic-233839385_53944762

https://vk.com/topic-233839383_54357189

https://vk.com/topic-233839386_54430885

https://vk.com/topic-233839388_54550444

https://vk.com/topic-233839389_54770698

https://vk.com/topic-233839390_55144077

https://vk.com/topic-233839387_55343808

https://vk.com/topic-233839384_54059358

https://vk.com/topic-233839391_55621595

https://vk.com/topic-233839385_53944761

https://vk.com/topic-233839383_54357188

https://vk.com/topic-233839386_54430884

https://vk.com/topic-233839388_54550443

https://vk.com/topic-233839389_54770696

https://vk.com/topic-233839390_55144076

https://vk.com/topic-233839387_55343807

https://vk.com/topic-233839384_54059357

https://vk.com/topic-233839391_55621594

https://vk.com/topic-233839385_53944760

https://vk.com/topic-233839383_54357187

https://vk.com/topic-233839386_54430883

https://vk.com/topic-233839388_54550441

https://vk.com/topic-233839389_54770694

https://vk.com/topic-233839390_55144075

https://vk.com/topic-233839387_55343805

https://vk.com/topic-233839384_54059356

https://vk.com/topic-233839391_55621592

https://vk.com/topic-233839385_53944759

https://vk.com/topic-233839383_54357186

https://vk.com/topic-233839386_54430882

https://vk.com/topic-233839388_54550440

https://vk.com/topic-233839389_54770693

https://vk.com/topic-233839390_55144074

https://vk.com/topic-233839387_55343804

https://vk.com/topic-233839384_54059354

https://vk.com/topic-233839391_55621590

https://vk.com/topic-233839385_53944758

https://vk.com/topic-233839383_54357185

https://vk.com/topic-233839386_54430881

https://vk.com/topic-233839388_54550439

https://vk.com/topic-233839389_54770692

https://vk.com/topic-233839390_55144073

https://vk.com/topic-233839387_55343802

https://vk.com/topic-233839384_54059353

https://vk.com/topic-233839391_55621588

https://vk.com/topic-233839385_53944757

https://vk.com/topic-233839383_54357183

https://vk.com/topic-233839386_54430880

https://vk.com/topic-233839388_54550438

https://vk.com/topic-233839389_54770690

https://vk.com/topic-233839390_55144072

https://vk.com/topic-233839387_55343801

https://vk.com/topic-233839384_54059352

https://vk.com/topic-233839391_55621587

https://vk.com/topic-233839385_53944756

https://vk.com/topic-233839383_54357181

https://vk.com/topic-233839386_54430879

https://vk.com/topic-233839388_54550437

https://vk.com/topic-233839389_54770689

https://vk.com/topic-233839390_55144071

https://vk.com/topic-233839387_55343800

https://vk.com/topic-233839384_54059350

https://vk.com/topic-233839391_55621586

https://vk.com/topic-233839385_53944755

https://vk.com/topic-233839383_54357180

https://vk.com/topic-233839386_54430877

https://vk.com/topic-233839388_54550436

https://vk.com/topic-233839389_54770688

https://vk.com/topic-233839390_55144070

https://vk.com/topic-233839387_55343799

https://vk.com/topic-233839384_54059349

https://vk.com/topic-233839385_53944754

https://vk.com/topic-233839385_53944754

https://vk.com/topic-233839383_54357178

https://vk.com/topic-233839386_54430876

https://vk.com/topic-233839388_54550435

https://vk.com/topic-233839389_54770687

https://vk.com/topic-233839390_55144069

https://vk.com/topic-233839387_55343797

https://vk.com/topic-233839384_54059348

https://vk.com/topic-233839391_55621583

https://vk.com/topic-233839385_53944753

https://vk.com/topic-233839383_54357176

https://vk.com/topic-233839386_54430874

https://vk.com/topic-233839388_54550434

https://vk.com/topic-233839389_54770685

https://vk.com/topic-233839390_55144068

https://vk.com/topic-233839387_55343796

https://vk.com/topic-233839384_54059347

https://vk.com/topic-233839391_55621581

https://vk.com/topic-233839385_53944752

https://vk.com/topic-233839383_54357175

https://vk.com/topic-233839386_54430873

https://vk.com/topic-233839388_54550433

https://vk.com/topic-233839389_54770684

https://vk.com/topic-233839390_55144067

https://vk.com/topic-233839387_55343794

https://vk.com/topic-233839384_54059346

https://vk.com/topic-233839391_55621579

https://vk.com/topic-233839385_53944751

https://vk.com/topic-233839383_54357173

https://vk.com/topic-233839386_54430872

https://vk.com/topic-233839388_54550432

https://vk.com/topic-233839389_54770682

https://vk.com/topic-233839390_55144066

https://vk.com/topic-233839387_55343792

https://vk.com/topic-233839384_54059345

https://vk.com/topic-233839391_55621577

https://vk.com/topic-233839383_54357171

https://vk.com/topic-233839385_53944750

https://vk.com/topic-233839386_54430870

https://vk.com/topic-233839388_54550430

https://vk.com/topic-233839389_54770681

https://vk.com/topic-233839390_55144065

https://vk.com/topic-233839387_55343791

https://vk.com/topic-233839384_54059344

https://vk.com/topic-233839391_55621576

https://vk.com/topic-233839383_54357169

https://vk.com/topic-233839385_53944749

https://vk.com/topic-233839386_54430869

https://vk.com/topic-233839388_54550428

https://vk.com/topic-233839389_54770680

https://vk.com/topic-233839390_55144064

https://vk.com/topic-233839387_55343788

https://vk.com/topic-233839384_54059343

https://vk.com/topic-233839391_55621574

https://vk.com/topic-233839383_54357168

https://vk.com/topic-233839385_53944748

https://vk.com/topic-233839386_54430868

https://vk.com/topic-233839389_54770678

https://vk.com/topic-233839388_54550427

https://vk.com/topic-233839390_55144063

https://vk.com/topic-233839387_55343787

https://vk.com/topic-233839384_54059342

https://vk.com/topic-233839391_55621571

https://vk.com/topic-233839386_54430867

https://vk.com/topic-233839383_54357167

https://vk.com/topic-233839385_53944747

https://vk.com/topic-233839389_54770677

https://vk.com/topic-233839388_54550425

https://vk.com/topic-233839390_55144062

https://vk.com/topic-233839387_55343785

https://vk.com/topic-233839384_54059341

https://vk.com/topic-233839391_55621570

https://vk.com/topic-233839386_54430865

https://vk.com/topic-233839383_54357166

https://vk.com/topic-233839385_53944746

https://vk.com/topic-233839389_54770675

https://vk.com/topic-233839388_54550424

https://vk.com/topic-233839390_55144060

https://vk.com/topic-233839387_55343784

https://vk.com/topic-233839384_54059339

https://vk.com/topic-233839391_55621569

https://vk.com/topic-233839386_54430864

https://vk.com/topic-233839383_54357165

https://vk.com/topic-233839385_53944745

https://vk.com/topic-233839388_54550423

https://vk.com/topic-233839389_54770674

https://vk.com/topic-233839390_55144059

https://vk.com/topic-233839387_55343782

https://vk.com/topic-233839384_54059338

https://vk.com/topic-233839391_55621568

https://vk.com/topic-233839386_54430863

https://vk.com/topic-233839383_54357163

https://vk.com/topic-233839385_53944744

https://vk.com/topic-233839389_54770673

https://vk.com/topic-233839388_54550422

https://vk.com/topic-233839387_55343780

https://vk.com/topic-233839384_54059337

https://vk.com/topic-233839391_55621567

https://vk.com/topic-233839383_54357162

https://vk.com/topic-233839385_53944743

为什么这样更好?论文附录有数学分析,直观理解就是这种平均化过程提供了更平滑稳定的优化地形。通过几何平均,任何一个可能有噪声或者异常的单个

r_t^i(θ)

的影响都会被抑制。传回模型的梯度信号不再是一连串尖锐的、可能相互矛盾的步骤级指令,而是针对整个生成阶段的更平滑、更整体的引导。

论文附录的分析表明,在存在不准确优势归因的情况下,块级目标可以被证明比标准步骤级 GRPO 目标更接近"真实"目标,尤其是当块大小保持适度(比如 5 或更小)时。这为实验结果提供了理论支撑。