python transpose Python transpose玩不转?这包不装,你的代码只能原地转圈圈
需要找到与你当前机器对应的包
#设置需要安装的路径
export INSTALL_PATH=/usr/local/Ascend
./Ascend-cann-toolkit*run --install-path=$INSTALL_PATH --full --quiet
./Ascend-cann-A3*run --install-path=$INSTALL_PATH --install --quiet
source $INSTALL_PATH/ascend-toolkit/set_env.sh
编译自定义算子包
接下来, 要进行安装算子包的操作, 这个算子包所包含的是高性能GDN算子, 而在此处, 需要用到的是三方库fla-npu。
下载地址为
# 编译命令,注意--soc=${soc_version}需要指定为当前机器的芯片类型
bash build.sh --soc=ascend910_93 --pkg --ops=chunk_bwd_dv_local,chunk_bwd_dqkwg,chunk_gated_delta_rule_bwd_dhu,prepare_wy_repr_bwd_da,prepare_wy_repr_bwd_full,chunk_fwd_o,chunk_gated_delta_rule_fwd_h,recurrent_gated_delta_rule,recompute_wu_fwd
# 安装run包
./build_out/cann-ops-transformer-custom_linux-aarch64.run
框架编译构建
下载并安装对应和torch版本的最新发行版
需要获取26.1 beta及以后的版本
编译torch适配whl包并安装
cd torch_custom/fla_npu
bash build.sh
算子接入
Qwen3.5里面涉及的算子数量众多, 对于基于传统的非线性层以及整网耗时占比较小的那些成熟算子, 这里就不多说了, 仅仅讲解下在新结构情形下的中重型算子。
重点算子列表
推理-场景/训练-前向场景
推理使用的算子, 跟训练前向场景所运用的算子是一样的, 总共涉及7个融合算子, 具体如下表所示:
推理-场景
训练-反向场景
反向场景中包含较多前向算子,这里只单独提及仅反向涉及的算子
模块-GDN接入实践
在接入GDN算子以前, 先讲清楚我们为追求极致性能所做的一些小设计。若要获取到完整的性能收益, 接入GDN算子得留意以下两件事情。
模型里传递的默认, 全都是定长的BSH, 还有变长的TND, 对于GDN而言, 读写动作会跨越超越高N维, 致使访存效率下降。GDN算子数量众多, 其开销会比访存效率降低的代价要低, 所以在本篇文章里推荐的GDN算子统一采用了NTD或者BNSD的特殊方式。为了削减这样引入的开销, 我们在GDN预处理算子的前反向达成默认到特殊的转变, 所有的GDN算子都使用统一的特殊方式, GDN流程中不存在变动。
对于要达成更优的、更为严谨的负载均衡而言, C算子的host阶段应当获取到, 与此同时, 这还能够助力我们拦截掉一部分索引有误的问题。所以, C GDN算子的输入是list(在host上), 然而GDN算子都是(上)。其物理意义是组batch逻辑, 这便意味着45个线性层里所有的GDN算子需要同一份输入。我们需要从一开始就在和host上各存储一份, 借此使得每个训练step或者每个完整任务仅仅进行一次h2d。
接入代码示例:
FFN模块-/接入实践
和算子用以替换Moe层里的通信算子, 通信算子关联H/D同步, 致使耗时偏长。使用及替换之后, 专家路由结果的处理, 下沉至上, 消除了Host与同步开销。历经多个迭代的演进, 和算子运用了AIV驱动ROCE能力, 还叠加了通信数据去重, 机内机间流水并行等优化办法, 在典型场景当中, 模型吞吐性能提高了50%。
算子输入相对简单, 模型方面, 只需把数据 x 当作输入, 还要将前级门控网络挑选出的 topk 个专家索引作为输入, 同时提供 moe 专家数、EP 通信域大小、rank ID 等属性就行。输出的数据、各个专家的 token 个数会直接给到后级 GMM。通信算法相关的辅助信息 ine, 会由输出直接传递过去, 模型侧不用去在意。
算子接口参数详细说明、调用示例可参考接口文档:
:
:
优化结果
在输入规模为bs等于 64, 等于 1k, 等于 32 这样的场景当中, 重点之 GDN 算子的优化效果呈现出如下的情况:
耗时平均缩短为原始算子的44%。
处于输入规模为 ep64 的那种情况下, bs 的值是 32, 还有等于 1, 等于 7k, topk 为 8 的这般场景里, /算子的优化效果呈现出如下的状况:

耗时平均缩短为基线方案的43%。Blog.Csdn.rzfuk.cN/Article/details/633848.sHtML
Blog.Csdn.rzfuk.cN/Article/details/324301.sHtML
Blog.Csdn.rzfuk.cN/Article/details/735872.sHtML
Blog.Csdn.rzfuk.cN/Article/details/329290.sHtML
Blog.Csdn.rzfuk.cN/Article/details/929055.sHtML
Blog.Csdn.rzfuk.cN/Article/details/684979.sHtML
Blog.Csdn.rzfuk.cN/Article/details/432795.sHtML
Blog.Csdn.rzfuk.cN/Article/details/010227.sHtML
Blog.Csdn.rzfuk.cN/Article/details/241200.sHtML
Blog.Csdn.rzfuk.cN/Article/details/818636.sHtML
Blog.Csdn.rzfuk.cN/Article/details/399088.sHtML
Blog.Csdn.rzfuk.cN/Article/details/900312.sHtML
Blog.Csdn.rzfuk.cN/Article/details/721928.sHtML
Blog.Csdn.rzfuk.cN/Article/details/776758.sHtML
Blog.Csdn.rzfuk.cN/Article/details/116879.sHtML
Blog.Csdn.rzfuk.cN/Article/details/667871.sHtML
Blog.Csdn.rzfuk.cN/Article/details/216542.sHtML
Blog.Csdn.rzfuk.cN/Article/details/782586.sHtML
Blog.Csdn.rzfuk.cN/Article/details/258679.sHtML
Blog.Csdn.rzfuk.cN/Article/details/311210.sHtML
Blog.Csdn.rzfuk.cN/Article/details/768102.sHtML
Blog.Csdn.rzfuk.cN/Article/details/305781.sHtML
Blog.Csdn.rzfuk.cN/Article/details/114758.sHtML
Blog.Csdn.rzfuk.cN/Article/details/209498.sHtML
Blog.Csdn.rzfuk.cN/Article/details/146834.sHtML
Blog.Csdn.rzfuk.cN/Article/details/309132.sHtML
Blog.Csdn.rzfuk.cN/Article/details/671574.sHtML
Blog.Csdn.rzfuk.cN/Article/details/641602.sHtML
Blog.Csdn.rzfuk.cN/Article/details/845912.sHtML
Blog.Csdn.rzfuk.cN/Article/details/637661.sHtML
Blog.Csdn.rzfuk.cN/Article/details/935119.sHtML
Blog.Csdn.rzfuk.cN/Article/details/431039.sHtML
Blog.Csdn.rzfuk.cN/Article/details/174692.sHtML
Blog.Csdn.rzfuk.cN/Article/details/103786.sHtML
Blog.Csdn.rzfuk.cN/Article/details/629559.sHtML
Blog.Csdn.rzfuk.cN/Article/details/966338.sHtML
Blog.Csdn.rzfuk.cN/Article/details/549352.sHtML
Blog.Csdn.rzfuk.cN/Article/details/395845.sHtML
Blog.Csdn.rzfuk.cN/Article/details/040096.sHtML
Blog.Csdn.rzfuk.cN/Article/details/488212.sHtML
Blog.Csdn.rzfuk.cN/Article/details/265116.sHtML
Blog.Csdn.rzfuk.cN/Article/details/584233.sHtML
Blog.Csdn.rzfuk.cN/Article/details/425107.sHtML
Blog.Csdn.rzfuk.cN/Article/details/970537.sHtML
Blog.Csdn.rzfuk.cN/Article/details/178519.sHtML
Blog.Csdn.rzfuk.cN/Article/details/089861.sHtML
Blog.Csdn.rzfuk.cN/Article/details/840736.sHtML
Blog.Csdn.rzfuk.cN/Article/details/561883.sHtML
Blog.Csdn.rzfuk.cN/Article/details/415031.sHtML
Blog.Csdn.rzfuk.cN/Article/details/425127.sHtML
Blog.Csdn.rzfuk.cN/Article/details/333072.sHtML
Blog.Csdn.rzfuk.cN/Article/details/930217.sHtML
Blog.Csdn.rzfuk.cN/Article/details/008450.sHtML
Blog.Csdn.rzfuk.cN/Article/details/712559.sHtML
Blog.Csdn.rzfuk.cN/Article/details/689318.sHtML
Blog.Csdn.rzfuk.cN/Article/details/287569.sHtML
Blog.Csdn.rzfuk.cN/Article/details/348623.sHtML
Blog.Csdn.rzfuk.cN/Article/details/368532.sHtML
Blog.Csdn.rzfuk.cN/Article/details/961297.sHtML
Blog.Csdn.rzfuk.cN/Article/details/891164.sHtML
Blog.Csdn.rzfuk.cN/Article/details/575965.sHtML
Blog.Csdn.rzfuk.cN/Article/details/790796.sHtML
Blog.Csdn.rzfuk.cN/Article/details/093171.sHtML
Blog.Csdn.rzfuk.cN/Article/details/246841.sHtML
Blog.Csdn.rzfuk.cN/Article/details/404650.sHtML
Blog.Csdn.rzfuk.cN/Article/details/092798.sHtML
Blog.Csdn.rzfuk.cN/Article/details/022480.sHtML
Blog.Csdn.rzfuk.cN/Article/details/094210.sHtML
Blog.Csdn.rzfuk.cN/Article/details/647853.sHtML
Blog.Csdn.rzfuk.cN/Article/details/806036.sHtML
Blog.Csdn.rzfuk.cN/Article/details/292301.sHtML
Blog.Csdn.rzfuk.cN/Article/details/316169.sHtML
Blog.Csdn.rzfuk.cN/Article/details/388487.sHtML
Blog.Csdn.rzfuk.cN/Article/details/353206.sHtML
Blog.Csdn.rzfuk.cN/Article/details/974570.sHtML
Blog.Csdn.rzfuk.cN/Article/details/128577.sHtML
Blog.Csdn.rzfuk.cN/Article/details/640168.sHtML
Blog.Csdn.rzfuk.cN/Article/details/996757.sHtML
Blog.Csdn.rzfuk.cN/Article/details/402351.sHtML
Blog.Csdn.rzfuk.cN/Article/details/115689.sHtML
Blog.Csdn.rzfuk.cN/Article/details/436431.sHtML
Blog.Csdn.rzfuk.cN/Article/details/795090.sHtML
Blog.Csdn.rzfuk.cN/Article/details/465286.sHtML
Blog.Csdn.rzfuk.cN/Article/details/701323.sHtML
Blog.Csdn.rzfuk.cN/Article/details/433870.sHtML
Blog.Csdn.rzfuk.cN/Article/details/394661.sHtML
Blog.Csdn.rzfuk.cN/Article/details/362016.sHtML
Blog.Csdn.rzfuk.cN/Article/details/840026.sHtML
Blog.Csdn.rzfuk.cN/Article/details/895596.sHtML
Blog.Csdn.rzfuk.cN/Article/details/014012.sHtML
Blog.Csdn.rzfuk.cN/Article/details/322708.sHtML
Blog.Csdn.rzfuk.cN/Article/details/818540.sHtML
Blog.Csdn.rzfuk.cN/Article/details/356552.sHtML
Blog.Csdn.rzfuk.cN/Article/details/479898.sHtML
Blog.Csdn.rzfuk.cN/Article/details/299108.sHtML
Blog.Csdn.rzfuk.cN/Article/details/704997.sHtML
Blog.Csdn.rzfuk.cN/Article/details/761973.sHtML
Blog.Csdn.rzfuk.cN/Article/details/449979.sHtML
Blog.Csdn.rzfuk.cN/Article/details/194579.sHtML
Blog.Csdn.rzfuk.cN/Article/details/071997.sHtML
Blog.Csdn.rzfuk.cN/Article/details/037629.sHtML
Blog.Csdn.rzfuk.cN/Article/details/109191.sHtML
Blog.Csdn.rzfuk.cN/Article/details/008477.sHtML
Blog.Csdn.rzfuk.cN/Article/details/559410.sHtML
Blog.Csdn.rzfuk.cN/Article/details/262434.sHtML
Blog.Csdn.rzfuk.cN/Article/details/099305.sHtML
Blog.Csdn.rzfuk.cN/Article/details/531930.sHtML
Blog.Csdn.rzfuk.cN/Article/details/612476.sHtML
Blog.Csdn.rzfuk.cN/Article/details/040642.sHtML
Blog.Csdn.rzfuk.cN/Article/details/098276.sHtML
Blog.Csdn.rzfuk.cN/Article/details/970332.sHtML
Blog.Csdn.rzfuk.cN/Article/details/831527.sHtML
Blog.Csdn.rzfuk.cN/Article/details/372622.sHtML
Blog.Csdn.rzfuk.cN/Article/details/465347.sHtML
Blog.Csdn.rzfuk.cN/Article/details/642762.sHtML
Blog.Csdn.rzfuk.cN/Article/details/944599.sHtML
Blog.Csdn.rzfuk.cN/Article/details/655845.sHtML
Blog.Csdn.rzfuk.cN/Article/details/031572.sHtML
Blog.Csdn.rzfuk.cN/Article/details/262487.sHtML
Blog.Csdn.rzfuk.cN/Article/details/377013.sHtML
Blog.Csdn.rzfuk.cN/Article/details/583426.sHtML
Blog.Csdn.rzfuk.cN/Article/details/173138.sHtML
Blog.Csdn.rzfuk.cN/Article/details/741084.sHtML
Blog.Csdn.rzfuk.cN/Article/details/157115.sHtML
Blog.Csdn.rzfuk.cN/Article/details/417978.sHtML
Blog.Csdn.rzfuk.cN/Article/details/456348.sHtML
Blog.Csdn.rzfuk.cN/Article/details/214643.sHtML
Blog.Csdn.rzfuk.cN/Article/details/006743.sHtML
Blog.Csdn.rzfuk.cN/Article/details/416119.sHtML
Blog.Csdn.rzfuk.cN/Article/details/931402.sHtML
Blog.Csdn.rzfuk.cN/Article/details/582227.sHtML
Blog.Csdn.rzfuk.cN/Article/details/510949.sHtML
Blog.Csdn.rzfuk.cN/Article/details/155059.sHtML
Blog.Csdn.rzfuk.cN/Article/details/541015.sHtML
Blog.Csdn.rzfuk.cN/Article/details/487765.sHtML
Blog.Csdn.rzfuk.cN/Article/details/489363.sHtML
Blog.Csdn.rzfuk.cN/Article/details/084860.sHtML
Blog.Csdn.rzfuk.cN/Article/details/551761.sHtML
Blog.Csdn.rzfuk.cN/Article/details/220476.sHtML
Blog.Csdn.rzfuk.cN/Article/details/431968.sHtML
Blog.Csdn.rzfuk.cN/Article/details/117687.sHtML
Blog.Csdn.rzfuk.cN/Article/details/720126.sHtML
Blog.Csdn.rzfuk.cN/Article/details/816641.sHtML
Blog.Csdn.rzfuk.cN/Article/details/023008.sHtML
Blog.Csdn.rzfuk.cN/Article/details/895464.sHtML
Blog.Csdn.rzfuk.cN/Article/details/486950.sHtML
Blog.Csdn.rzfuk.cN/Article/details/226432.sHtML
Blog.Csdn.rzfuk.cN/Article/details/353365.sHtML
Blog.Csdn.rzfuk.cN/Article/details/697514.sHtML
Blog.Csdn.rzfuk.cN/Article/details/207298.sHtML
Blog.Csdn.rzfuk.cN/Article/details/648520.sHtML
Blog.Csdn.rzfuk.cN/Article/details/177237.sHtML
Blog.Csdn.rzfuk.cN/Article/details/570615.sHtML
Blog.Csdn.rzfuk.cN/Article/details/085295.sHtML
Blog.Csdn.rzfuk.cN/Article/details/889483.sHtML
Blog.Csdn.rzfuk.cN/Article/details/454903.sHtML
Blog.Csdn.rzfuk.cN/Article/details/463189.sHtML
Blog.Csdn.rzfuk.cN/Article/details/290005.sHtML
Blog.Csdn.rzfuk.cN/Article/details/870788.sHtML
Blog.Csdn.rzfuk.cN/Article/details/128085.sHtML
Blog.Csdn.rzfuk.cN/Article/details/060882.sHtML
Blog.Csdn.rzfuk.cN/Article/details/030273.sHtML
Blog.Csdn.rzfuk.cN/Article/details/629871.sHtML
Blog.Csdn.rzfuk.cN/Article/details/364173.sHtML
Blog.Csdn.rzfuk.cN/Article/details/403693.sHtML
Blog.Csdn.rzfuk.cN/Article/details/549663.sHtML
Blog.Csdn.rzfuk.cN/Article/details/139297.sHtML
Blog.Csdn.rzfuk.cN/Article/details/091881.sHtML
Blog.Csdn.rzfuk.cN/Article/details/288826.sHtML
Blog.Csdn.rzfuk.cN/Article/details/296973.sHtML
Blog.Csdn.rzfuk.cN/Article/details/395442.sHtML
Blog.Csdn.rzfuk.cN/Article/details/052136.sHtML
Blog.Csdn.rzfuk.cN/Article/details/072962.sHtML
Blog.Csdn.rzfuk.cN/Article/details/149106.sHtML
Blog.Csdn.rzfuk.cN/Article/details/567209.sHtML
Blog.Csdn.rzfuk.cN/Article/details/127736.sHtML
Blog.Csdn.rzfuk.cN/Article/details/733520.sHtML
Blog.Csdn.rzfuk.cN/Article/details/732587.sHtML
Blog.Csdn.rzfuk.cN/Article/details/689419.sHtML
Blog.Csdn.rzfuk.cN/Article/details/529700.sHtML
Blog.Csdn.rzfuk.cN/Article/details/585752.sHtML
Blog.Csdn.rzfuk.cN/Article/details/787878.sHtML
Blog.Csdn.rzfuk.cN/Article/details/490385.sHtML
Blog.Csdn.rzfuk.cN/Article/details/076535.sHtML
Blog.Csdn.rzfuk.cN/Article/details/927470.sHtML
Blog.Csdn.rzfuk.cN/Article/details/332060.sHtML
Blog.Csdn.rzfuk.cN/Article/details/181242.sHtML
Blog.Csdn.rzfuk.cN/Article/details/754629.sHtML
Blog.Csdn.rzfuk.cN/Article/details/202835.sHtML
Blog.Csdn.rzfuk.cN/Article/details/035798.sHtML
Blog.Csdn.rzfuk.cN/Article/details/141330.sHtML
Blog.Csdn.rzfuk.cN/Article/details/302043.sHtML
Blog.Csdn.rzfuk.cN/Article/details/811527.sHtML
Blog.Csdn.rzfuk.cN/Article/details/595109.sHtML
Blog.Csdn.rzfuk.cN/Article/details/587426.sHtML
Blog.Csdn.rzfuk.cN/Article/details/165003.sHtML
Blog.Csdn.rzfuk.cN/Article/details/088676.sHtML
Blog.Csdn.rzfuk.cN/Article/details/761261.sHtML
Blog.Csdn.rzfuk.cN/Article/details/729716.sHtML
Blog.Csdn.rzfuk.cN/Article/details/925279.sHtML
Blog.Csdn.rzfuk.cN/Article/details/261485.sHtML
Blog.Csdn.rzfuk.cN/Article/details/239291.sHtML
Blog.Csdn.rzfuk.cN/Article/details/735364.sHtML
Blog.Csdn.rzfuk.cN/Article/details/203490.sHtML
Blog.Csdn.rzfuk.cN/Article/details/665789.sHtML
Blog.Csdn.rzfuk.cN/Article/details/254968.sHtML
Blog.Csdn.rzfuk.cN/Article/details/191152.sHtML
Blog.Csdn.rzfuk.cN/Article/details/592573.sHtML
Blog.Csdn.rzfuk.cN/Article/details/198827.sHtML
Blog.Csdn.rzfuk.cN/Article/details/922888.sHtML
Blog.Csdn.rzfuk.cN/Article/details/981363.sHtML
Blog.Csdn.rzfuk.cN/Article/details/722745.sHtML
Blog.Csdn.rzfuk.cN/Article/details/975128.sHtML
Blog.Csdn.rzfuk.cN/Article/details/295218.sHtML
Blog.Csdn.rzfuk.cN/Article/details/060986.sHtML
Blog.Csdn.rzfuk.cN/Article/details/649683.sHtML
Blog.Csdn.rzfuk.cN/Article/details/428903.sHtML
Blog.Csdn.rzfuk.cN/Article/details/678822.sHtML
Blog.Csdn.rzfuk.cN/Article/details/683036.sHtML
Blog.Csdn.rzfuk.cN/Article/details/434056.sHtML
Blog.Csdn.rzfuk.cN/Article/details/751962.sHtML
Blog.Csdn.rzfuk.cN/Article/details/465409.sHtML
Blog.Csdn.rzfuk.cN/Article/details/962025.sHtML
Blog.Csdn.rzfuk.cN/Article/details/382275.sHtML
Blog.Csdn.rzfuk.cN/Article/details/918842.sHtML
Blog.Csdn.rzfuk.cN/Article/details/936073.sHtML
Blog.Csdn.rzfuk.cN/Article/details/212746.sHtML
Blog.Csdn.rzfuk.cN/Article/details/354675.sHtML
Blog.Csdn.rzfuk.cN/Article/details/586210.sHtML
Blog.Csdn.rzfuk.cN/Article/details/906583.sHtML
Blog.Csdn.rzfuk.cN/Article/details/537778.sHtML
Blog.Csdn.rzfuk.cN/Article/details/681825.sHtML
Blog.Csdn.rzfuk.cN/Article/details/049837.sHtML
Blog.Csdn.rzfuk.cN/Article/details/158943.sHtML
Blog.Csdn.rzfuk.cN/Article/details/916215.sHtML
Blog.Csdn.rzfuk.cN/Article/details/789928.sHtML
Blog.Csdn.rzfuk.cN/Article/details/768211.sHtML
Blog.Csdn.rzfuk.cN/Article/details/140061.sHtML
Blog.Csdn.rzfuk.cN/Article/details/641588.sHtML
Blog.Csdn.rzfuk.cN/Article/details/201288.sHtML
Blog.Csdn.rzfuk.cN/Article/details/630176.sHtML
Blog.Csdn.rzfuk.cN/Article/details/103524.sHtML
Blog.Csdn.rzfuk.cN/Article/details/005636.sHtML
Blog.Csdn.rzfuk.cN/Article/details/580190.sHtML
Blog.Csdn.rzfuk.cN/Article/details/655137.sHtML
Blog.Csdn.rzfuk.cN/Article/details/189909.sHtML
Blog.Csdn.rzfuk.cN/Article/details/176769.sHtML
Blog.Csdn.rzfuk.cN/Article/details/376995.sHtML
Blog.Csdn.rzfuk.cN/Article/details/184243.sHtML
Blog.Csdn.rzfuk.cN/Article/details/973187.sHtML
Blog.Csdn.rzfuk.cN/Article/details/298667.sHtML
Blog.Csdn.rzfuk.cN/Article/details/311377.sHtML
Blog.Csdn.rzfuk.cN/Article/details/767833.sHtML
Blog.Csdn.rzfuk.cN/Article/details/422372.sHtML
Blog.Csdn.rzfuk.cN/Article/details/571600.sHtML
Blog.Csdn.rzfuk.cN/Article/details/541173.sHtML
Blog.Csdn.rzfuk.cN/Article/details/553170.sHtML
Blog.Csdn.rzfuk.cN/Article/details/394753.sHtML
Blog.Csdn.rzfuk.cN/Article/details/957673.sHtML
Blog.Csdn.rzfuk.cN/Article/details/976992.sHtML
Blog.Csdn.rzfuk.cN/Article/details/151868.sHtML
Blog.Csdn.rzfuk.cN/Article/details/607441.sHtML
Blog.Csdn.rzfuk.cN/Article/details/666122.sHtML
Blog.Csdn.rzfuk.cN/Article/details/089414.sHtML
Blog.Csdn.rzfuk.cN/Article/details/494525.sHtML
Blog.Csdn.rzfuk.cN/Article/details/993493.sHtML
Blog.Csdn.rzfuk.cN/Article/details/127341.sHtML
Blog.Csdn.rzfuk.cN/Article/details/456643.sHtML
Blog.Csdn.rzfuk.cN/Article/details/860757.sHtML
Blog.Csdn.rzfuk.cN/Article/details/005332.sHtML
Blog.Csdn.rzfuk.cN/Article/details/582442.sHtML
Blog.Csdn.rzfuk.cN/Article/details/710094.sHtML
Blog.Csdn.rzfuk.cN/Article/details/903483.sHtML
Blog.Csdn.rzfuk.cN/Article/details/843333.sHtML
Blog.Csdn.rzfuk.cN/Article/details/568835.sHtML
Blog.Csdn.rzfuk.cN/Article/details/794239.sHtML
Blog.Csdn.rzfuk.cN/Article/details/900295.sHtML
Blog.Csdn.rzfuk.cN/Article/details/823787.sHtML
Blog.Csdn.rzfuk.cN/Article/details/258040.sHtML
Blog.Csdn.rzfuk.cN/Article/details/232299.sHtML
Blog.Csdn.rzfuk.cN/Article/details/156303.sHtML
Blog.Csdn.rzfuk.cN/Article/details/159247.sHtML
Blog.Csdn.rzfuk.cN/Article/details/784704.sHtML
Blog.Csdn.rzfuk.cN/Article/details/062375.sHtML
Blog.Csdn.rzfuk.cN/Article/details/960504.sHtML
Blog.Csdn.rzfuk.cN/Article/details/148857.sHtML
Blog.Csdn.rzfuk.cN/Article/details/709867.sHtML
Blog.Csdn.rzfuk.cN/Article/details/400229.sHtML
Blog.Csdn.rzfuk.cN/Article/details/071618.sHtML
Blog.Csdn.rzfuk.cN/Article/details/962553.sHtML
Blog.Csdn.rzfuk.cN/Article/details/431539.sHtML
Blog.Csdn.rzfuk.cN/Article/details/833257.sHtML
Blog.Csdn.rzfuk.cN/Article/details/378573.sHtML
Blog.Csdn.rzfuk.cN/Article/details/264162.sHtML
Blog.Csdn.rzfuk.cN/Article/details/424593.sHtML
Blog.Csdn.rzfuk.cN/Article/details/775031.sHtML
Blog.Csdn.rzfuk.cN/Article/details/921936.sHtML
Blog.Csdn.rzfuk.cN/Article/details/033063.sHtML
Blog.Csdn.rzfuk.cN/Article/details/534532.sHtML
Blog.Csdn.rzfuk.cN/Article/details/204001.sHtML
Blog.Csdn.rzfuk.cN/Article/details/463217.sHtML
Blog.Csdn.rzfuk.cN/Article/details/251202.sHtML
Blog.Csdn.rzfuk.cN/Article/details/800202.sHtML
Blog.Csdn.rzfuk.cN/Article/details/806300.sHtML
Blog.Csdn.rzfuk.cN/Article/details/834249.sHtML
Blog.Csdn.rzfuk.cN/Article/details/496180.sHtML
Blog.Csdn.rzfuk.cN/Article/details/164836.sHtML
Blog.Csdn.rzfuk.cN/Article/details/646524.sHtML
Blog.Csdn.rzfuk.cN/Article/details/988396.sHtML
Blog.Csdn.rzfuk.cN/Article/details/478971.sHtML
Blog.Csdn.rzfuk.cN/Article/details/048917.sHtML
Blog.Csdn.rzfuk.cN/Article/details/800153.sHtML
Blog.Csdn.rzfuk.cN/Article/details/115063.sHtML
Blog.Csdn.rzfuk.cN/Article/details/945356.sHtML
Blog.Csdn.rzfuk.cN/Article/details/246471.sHtML
Blog.Csdn.rzfuk.cN/Article/details/393138.sHtML
Blog.Csdn.rzfuk.cN/Article/details/054091.sHtML
Blog.Csdn.rzfuk.cN/Article/details/283110.sHtML
Blog.Csdn.rzfuk.cN/Article/details/991811.sHtML
Blog.Csdn.rzfuk.cN/Article/details/483773.sHtML
Blog.Csdn.rzfuk.cN/Article/details/246591.sHtML
Blog.Csdn.rzfuk.cN/Article/details/108069.sHtML
Blog.Csdn.rzfuk.cN/Article/details/913800.sHtML
Blog.Csdn.rzfuk.cN/Article/details/848059.sHtML
Blog.Csdn.rzfuk.cN/Article/details/514699.sHtML
Blog.Csdn.rzfuk.cN/Article/details/456967.sHtML
Blog.Csdn.rzfuk.cN/Article/details/847953.sHtML
Blog.Csdn.rzfuk.cN/Article/details/575335.sHtML
Blog.Csdn.rzfuk.cN/Article/details/178395.sHtML
Blog.Csdn.rzfuk.cN/Article/details/958801.sHtML
Blog.Csdn.rzfuk.cN/Article/details/098567.sHtML
Blog.Csdn.rzfuk.cN/Article/details/118558.sHtML
Blog.Csdn.rzfuk.cN/Article/details/511470.sHtML
Blog.Csdn.rzfuk.cN/Article/details/749030.sHtML
Blog.Csdn.rzfuk.cN/Article/details/050256.sHtML
Blog.Csdn.rzfuk.cN/Article/details/210926.sHtML
Blog.Csdn.rzfuk.cN/Article/details/701810.sHtML
Blog.Csdn.rzfuk.cN/Article/details/850621.sHtML
Blog.Csdn.rzfuk.cN/Article/details/343700.sHtML
Blog.Csdn.rzfuk.cN/Article/details/426185.sHtML
Blog.Csdn.rzfuk.cN/Article/details/048905.sHtML
Blog.Csdn.rzfuk.cN/Article/details/905127.sHtML
Blog.Csdn.rzfuk.cN/Article/details/945858.sHtML
Blog.Csdn.rzfuk.cN/Article/details/524551.sHtML
Blog.Csdn.rzfuk.cN/Article/details/824764.sHtML
Blog.Csdn.rzfuk.cN/Article/details/812772.sHtML
Blog.Csdn.rzfuk.cN/Article/details/443567.sHtML
Blog.Csdn.rzfuk.cN/Article/details/328978.sHtML
Blog.Csdn.rzfuk.cN/Article/details/659060.sHtML
Blog.Csdn.rzfuk.cN/Article/details/254937.sHtML
Blog.Csdn.rzfuk.cN/Article/details/119534.sHtML
Blog.Csdn.rzfuk.cN/Article/details/993296.sHtML
Blog.Csdn.rzfuk.cN/Article/details/138089.sHtML
Blog.Csdn.rzfuk.cN/Article/details/568882.sHtML
Blog.Csdn.rzfuk.cN/Article/details/846532.sHtML
Blog.Csdn.rzfuk.cN/Article/details/302172.sHtML
Blog.Csdn.rzfuk.cN/Article/details/276949.sHtML
Blog.Csdn.rzfuk.cN/Article/details/652236.sHtML
Blog.Csdn.rzfuk.cN/Article/details/157746.sHtML
更多推荐




所有评论(0)