llm-architecture

There are 0 repository under llm-architecture topic.

itsnamgyu / block-transformer
Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
kv-cache kv-cache-compression llm llm-architecture llm-inference
Language:Python 162
mickymultani / LLM-Architecture
Visualize some important concepts related to LLM architectures.
attention-mechanism huggingface huggingface-transformers llm llm-inference tokenizers transformers llm-architecture
Language:Jupyter Notebook 6
JangYeongSil / JettaRLLLM
Jetta-Reinforcement-Learning-Hybrid-LLM-Architecture
ai artificial-neural-networks large largelanguagemodel llm llm-architecture largelanguagemodelsarachitecture
5
konig-ophion / ophion-memory-os
Reference architecture for structured AI memory lifecycle management — from the OPHION Memory OS Protocol.
ai-memory ai-systems duckies llm-architecture openai ophion reference-architecture whitepaper codex-system memory-os
1
dragon1 / models
This repository is to communicate and promote the Dragon1 Open Standard for Architecture Modeling, with the Dragon1 Modeling Language. This repository will specify the modeling language and interchange file format, provide 100 example models and diagrams to help architects and designers with their tasks. https://www.dragon1.com
business-architecture cybersecurity data-architecture ea-tooling ea-tools enterprise-architecture llm-architecture security-architecture digital-architecture it-arch-ms enterprise-architecture-tools
0
Insider77Circle / ADAPTIVE-CONTEXTUAL-ATTENTION-GATING
Adaptive Contextual Attention Gating (ACAG) — context‑aware, efficient attention mechanism for Transformers. Optimized for long‑context LLMs, few‑shot reasoning, and scalable NLP with PyTorch.
adaptive-attention llm-architecture attention-mechanisms efficient-transformers transformer-models context-aware-attention few-shot-reasoning long-context-llm memory-efficient-attention scalable-transformers sequence-length-scaling
kossisoroyce / mandlemem
MandelMem: Multi-Resolution Reasoning Architecture with Fractal-Inspired Dynamics. A breakthrough AI reasoning system achieving 60.0% accuracy through quadtree decomposition and bounded iterative dynamics. Complete research paper, implementation, and reproducible results included.
artificial-intelligence llm llm-architecture machine-learning multi quadtree reasoning reasoning-systems resolution fractal-dynamics
Language:Python
Nandan91 / relu-revival-normfree
PyTorch implementation of normalization-free LLMs investigating entropic behavior to find desirable activation functions
attention-we entropy-collapse gelu gpt-2 leaky-relu llm-architecture llm-evaluation llm-inference model-optimization normalization-free-training privacy-preserving-machine-learning private-inference pythia pytorch-implementation relu transformers-models
Language:Python
sachnaror / LLM_Transformer_Architecture_with_no_pretrained_model
Codebase ideation (for better understanding in Django way) for LLM without using pre-trained models, with custom embeddings (TF-IDF or Word2Vec), FAISS for vector storage.
faiss-vector-database llm-architecture llm-inference tf-idf-vectorization nlp-machine-learning

llm-architecture

itsnamgyu / block-transformer

mickymultani / LLM-Architecture

JangYeongSil / JettaRLLLM

konig-ophion / ophion-memory-os

dragon1 / models

Insider77Circle / ADAPTIVE-CONTEXTUAL-ATTENTION-GATING

kossisoroyce / mandlemem

Nandan91 / relu-revival-normfree

sachnaror / LLM_Transformer_Architecture_with_no_pretrained_model