Problem 1

Source: LoRA/loralib/layers.py
Issue: lora_B (instead of lora_A) is sampled from normal distribution.
Problem 2

Source: LoRA/loralib/layers.py
Issue: The comment is misguiding because lora_A is supposed to get Kaiming initialization, whereas lora_B is supposed to be initialized as zero.
Problem 1
Source:
LoRA/loralib/layers.pyIssue:
lora_B(instead oflora_A) is sampled from normal distribution.Problem 2
Source:
LoRA/loralib/layers.pyIssue: The comment is misguiding because
lora_Ais supposed to get Kaiming initialization, whereaslora_Bis supposed to be initialized as zero.