请按照初始代码中的签名实现 LoRALinear 类。
base_weight 为 (out, in) float32;lora_A 为 (r, in),lora_B 为 (out, r),1 <= r <= 8;x 为 (B, in) float32,B <= 16,in/out <= 64。
基础前向 r=2
正确性调用
LoRALinear(tensor[4, 6] [-0.413831, 1.17994, -0.807948, 1.68292, -0.132184, 0.058462, …], tensor[2, 6] [0.071838, 0.018137, -0.040141, 0.2156, -0.091287, -0.36819, …], tensor[4, 2] [0.183764,0.024763,-0.0923,-0.123061,0.000172,0.078901,-0.013708,0.037595], 8).forward(tensor[3, 6] [-0.073189, -0.742494, 0.143081, -0.684245, -0.957508, 0.407565, …])
预期结果
tensor[3, 4] [-2.14003, -1.61457, 0.763303, 0.022632, -2.57049, -2.66451, …]
运行会检查可见示例,提交会运行完整的隐藏测试。
登录并提交后,你的提交记录会显示在这里。