CANN Cube-Vec模式文档
2026/5/9 15:35:25 网站建设 项目流程

Cube-to-Vec Pattern

【免费下载链接】cannbot-skillsCANNBot 是面向 CANN 开发的用于提升开发效率的系列智能体,本仓库为其提供可复用的 Skills 模块。项目地址: https://gitcode.com/cann/cannbot-skills

Generic baseline only. For a2 (b3) kernels, preferagent/references/patterns/a2-cube-vec.md, which adds the mandatory a2 GM-workspace bridge and device-specific constraints.

Read this file when cube work produces an intermediate that vec work must postprocess before final writeback.

Use this pattern when

  • cube computes the main tile
  • vec applies elementwise or row-wise postprocess
  • the result is finally written out from the vec side

Minimal flow

GM -> L1 -> L0 -> L0C -> UB -> @vf -> GM

Ownership rule

The cube-to-vec handoff is a cross-side ownership edge. Use explicitCvMutex. Do not expectauto_sync()to replace it.

Stable repository mapping:

  • CvMutex(..., src_end_pipe=Pipe.FIX, dst_end_pipe=Pipe.V)

What usually matters most

  • where the cube tile becomes a vec-visible UB tile
  • whether the postprocess runs infloator after a cast
  • standard half-row vec writeback for tails
  • separate counters for the longer postprocess lifetime if needed

a2 variant

On a2,l0c_to_ubis absent. The cube → vec handoff goes through GM workspace instead. Readagent/references/patterns/a2-cube-vec.mdfor the full pattern.

Key differences from a5:

  • CvMutex(FIX → MTE2)instead ofCvMutex(FIX → V)
  • GM workspace withsplit_workspaceinstead of UB DBuff froml0c_to_ub
  • No@vf— vec operations are directly in the kernel body
  • Each sub-block reads its ownTILE_M//2rows viaGetSubBlockIdx()

Typical files to study

  • agent/example/kernels/a5/basic_cube_vec_mix.py— a5 baseline
  • agent/example/kernels/a5/matmul_half_splitn_bias10p2_vf.py
  • agent/example/kernels/a5/matmul_rowwise_norm.py
  • agent/example/kernels/a5/matmul_mknk_2dgrid_splitk_add1.py
  • agent/example/kernels/a2/flash_attn_score.py— a2 variant with GM bridge

【免费下载链接】cannbot-skillsCANNBot 是面向 CANN 开发的用于提升开发效率的系列智能体,本仓库为其提供可复用的 Skills 模块。项目地址: https://gitcode.com/cann/cannbot-skills

创作声明:本文部分内容由AI辅助生成(AIGC),仅供参考

需要专业的网站建设服务?

联系我们获取免费的网站建设咨询和方案报价,让我们帮助您实现业务目标

立即咨询