Adrian Böck's repositories
Ask-Anything
[VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
awesome-diverse-captioning
Some papers about *diverse* image (a few videos) captioning
BERT-LRP
On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification
benchmarking-xai-misogyny
Code associated with the paper "Benchmarking Post-Hoc Interpretability Approaches for Transformer-based Misogyny Detection"
bertviz
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
cactool
An easy way to collaboratively code social media posts for manual content and discourse analysis
chatllama
ChatLLaMA 📢 Open source implementation for LLaMA-based ChatGPT runnable in a single GPU. 15x faster training process than ChatGPT
counternarrative-resources
Resources on hate speech moderation through counter narratives, counter speech
Data-science
Collection of useful data science topics along with code and articles
german-hate-speech-detection
Experimental setup for a German hate speech detection accompanying my bachelor thesis on this topic.
long-short-term-transformer
[NeurIPS 2021 Spotlight] Official implementation of Long Short-Term Transformer for Online Action Detection
Multi-Task-Transformer
Code of ICLR2023 paper "TaskPrompter: Spatial-Channel Multi-Task Prompting for Dense Scene Understanding" and ECCV2022 paper "Inverted Pyramid Multi-task Transformer for Dense Scene Understanding"
Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
ProtoTEx
Code for ACL 2022 paper "ProtoTEx: Explaining Model Decisions with Prototype Tensors"
pyqtgraph
Fast data visualization and GUI tools for scientific / engineering applications
semantic-metadata-extraction-from-videos
Semantic Metadata Extraction from Generated Video Captions (CD-MAKE 2023).
skweak
skweak: A software toolkit for weak supervision applied to NLP tasks
snorkel
A system for quickly generating training data with weak supervision
Transformer-Explainability
[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.
transformers-interpret
Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.
Video-ChatGPT
"Video-ChatGPT" is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
video_captioning_datasets
Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Perspective: A Comprehensive Review*
Zeroshot_Counterspeech
This repository contains code for zeroshot counterspeech generation.