Experimentation with adapter modules for transformer architectures, using AdapterHub.
Goals:
- Test single task adapter on GLUe tasks.
- Model extracted natural language triplets from ConceptNet using a masked language modeling objective.
- Experiment with different adapter compositions.