A quick idea from a run the other day: it would be cool to find a way to inspect LoRA layers to see if they are getting ‘saturated’ and could benefit from a higher rank.
Search
A quick idea from a run the other day: it would be cool to find a way to inspect LoRA layers to see if they are getting ‘saturated’ and could benefit from a higher rank.