low-rank-representaion

There are 0 repository under low-rank-representaion topic.

• boyiwei / alignment-attribution-code

  Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications

  alignmentllmlow-rank-representaionsafetysafety-critical
  Language:Python 28

• hli1221 / imagefusion_dllrr

  multi-focus image fusion using dictionary learning and low-rank representation(ICIG 2017, Shanghai)

  image-fusiondictionary-learninglow-rank-representaionmulti-focus
  Language:MATLAB 28

• transbioZI / RMTL

  Regularized Multi-task Learning in R

  multi-task-learningsparse-codinglow-rank-representaionregularization
  Language:R 19

• anishacharya / Online-Embedding-Compression-AAAI-2019

  Deep learning models have become state of the art for natural language processing (NLP) tasks, however deploying these models in production system poses significant memory constraints. Existing compression methods are either lossy or introduce significant latency. We propose a compression method that leverages low rank matrix factorization during training, to compress the word embedding layer which represents the size bottleneck for most NLP models. Our models are trained, compressed and then further re-trained on the downstream task to recover accuracy while maintaining the reduced size. Empirically, we show that the proposed method can achieve 90% compression with minimal impact in accuracy for sentence classification tasks, and outperforms alternative methods like fixed-point quantization or offline word embedding compression. We also analyze the inference time and storage space for our method through FLOP calculations, showing that we can compress DNN models by a configurable ratio and regain accuracy loss without introducing additional latency compared to fixed point quantization. Finally, we introduce a novel learning rate schedule, the Cyclically Annealed Learning Rate (CALR), which we empirically demonstrate to outperform other popular adaptive learning rate algorithms on a sentence classification benchmark.

  compressiondeep-learninglow-rank-approximationlow-rank-representaionmatrix-decompositionsmodel-compressiontensorflowtext-classificationword-embeddingword-embeddings
  Language:Python 4

• caesarcai / IRCUR

  Rapid Robust Principal Component Analysis: CUR Accelerated Inexact Low Rank Estimation

  matlabrobust-pcacur-decompositionlow-rank-representaionalgorithm
  Language:MATLAB 4

• roland1993 / MA

  Master's thesis 'Low rank- and sparsity-based image registration'

  pockchambolleimage-registrationconvex-optimizationmatlabprimal-dual-algorithmrobust-pcalow-rank-representaionsparsitytotal-variation
  Language:MATLAB 4