Skip to content

Singular value regularization

⬅️ [Textual diffusion through repeated summarization](<./Textual diffusion through repeated summarization.md>) | ⬆️ [Ideas](<./README.md>) | [Neural Manifolds](<./Neural Manifolds.md>) ➡️

Singular value regularization

Form of regularization where we try to Keep the eigenvectors of weight matrix similar instead of L2 difference. Also you can then say only the top k. So keep broad strokes the same, but allow details to vary greatly as long as they have small effects.

⬅️ [Textual diffusion through repeated summarization](<./Textual diffusion through repeated summarization.md>) | ⬆️ [Ideas](<./README.md>) | [Neural Manifolds](<./Neural Manifolds.md>) ➡️