osirrc / jig

Jig for the Open-Source IR Replicability Challenge (OSIRRC)

osirrc/jig Issues

Intro Guide to Dockerfile Best Practices
Updated 5 years ago
Image should clearly communicate run ids
Updated 5 years ago4
Why are we doing this?
Closed 5 years ago2
How to avoid indexing after re-build docker?
Updated 5 years ago7
trec_eval needs to be in jig/ directory
Closed 5 years ago1
interact hook should take collections/topics/qrels flags
Updated 5 years ago4
HTTP ports exposed in interact hook do not match the dockerfile EXPOSE
Updated 5 years ago3
interact hook is unclear
Updated 5 years ago4
trec_eval should use -c option
Closed 5 years ago1
Cannot mount collection directory under SELinux (Fedora)
Updated 5 years ago1
Images reporting expected effectiveness metrics
Updated 5 years ago
Additional collections: NYT and Washington Post
Closed 5 years ago5
Can we add NDCG?
Closed 5 years ago
Clueweb queries only
Closed 5 years ago3
Roubst04 (Disk4/5) manifest
Closed 5 years ago18
NYT Manifest
Closed 5 years ago2
Topic format conversion in jig
Closed 5 years ago2
train hooks needs collection name
Closed 5 years ago1
searcher.py assumes that topics and qrels are in the respective topics and qrels folders
Closed 5 years ago5
Timing broken on some docker images
Closed 5 years ago1
Versioning Images
Closed 5 years ago2
Agree on collection name/id of web collections
Closed 5 years ago7
Script up end-to-end testing of all images on Azure
Closed 5 years ago
Image specific parameters
Closed 5 years ago2
Add requirements.txt
Closed 5 years ago
docker tag too long
Closed 5 years ago1
Efficiency measurements (how to gather?)
Updated 5 years ago6
Versioning for init script
Closed 5 years ago
Make topic and qrels parameter consistent
Closed 5 years ago1
Proposal for training hooks
Updated 5 years ago4
Clarify jig 'search' subcommand
Closed 5 years ago8
Add ability to drop image into container for interactive session
Closed 5 years ago4
Topic name
Closed 5 years ago2
Only one run per image?
Closed 5 years ago2
Collection and topic examples
Closed 5 years ago1
Collection format
Closed 5 years ago6
Improve handling of relative/absolute paths
Closed 5 years ago
How is search time measured?
Closed 5 years ago2
jig should support top k retrieval
Closed 5 years ago1
Intermediate container tags
Closed 5 years ago3
Error handling/logging
Updated 5 years ago
How to get data
Closed 5 years ago1
Separate scripts for each step
Closed 5 years ago4
Add snapshot image after initialization
Updated 5 years ago6
Start documenting specs
Closed 5 years ago4
Named Arguments vs. Positional Arguments
Closed 5 years ago1
'search' hook should take a collection name
Closed 5 years ago1
Refactor into subcommands
Closed 5 years ago2
Specification of the search script
Closed 5 years ago
Specification of the index script
Closed 5 years ago