brain-score / vision

A framework for evaluating models on their alignment to brain and behavioral measurements (50+ benchmarks)

http://brain-score.org

brain-score/vision Issues

Score models on new Ferguson2024 benchmarks
Closed a month ago
Merge and Deploy Ferguson2024 Benchmark
Closed a month ago
Score Models on Baker2022 Benchmark
Closed a month ago
Merge Matching Models
Closed a month ago1
This is a sample issue
Closed a month ago
Merge and Deploy Baker 2022 Benchmark
Closed a month ago
Run top 25 models on Sanghavi
Closed a month ago2
Improve efficiency of test_look_at_neural_V1
Updated a month ago
Remove trailing >> from benchmark Init files
Closed 2 months ago
Update Jenkins repo with all the config files
Closed 2 months ago1
Update Jenkins Documentation
Closed 2 months ago1
Get nas_net and inception_v4 to score on MajajHong
Updated 2 months ago3
Figure out how to handle unconvertible models
Updated 2 months ago1
"Create Benchmark" tutorial incorrect import
Updated 2 months ago
rename `number_of_trials` -> `number_of_repetitions`
Updated 2 months ago
StimulusSet data types may clash with DataAssembly data types after s3 upload
Updated 2 months ago1
Fix Score reproducibility discrepancy with Rank 12 and 18 models
Updated 2 months ago1
Resolve torch install inside conda env
Closed 2 months ago
Add a message to dataset/stimulus upload to say whether the uploaded files are private or public access
Updated 2 months ago
Run competition models on Sanghavi
Closed 2 months ago2
Allow uploading pre-computed feature .nc files to s3 buckets using similar functionality as for DataAssemblies/StimulusSets
Updated 2 months ago1
Speed up activations issues in tests
Closed 2 months ago
Get resent-152_v2 to Score on MajajHong2015.IT-pls
Closed 2 months ago6
Test alexnet scoring on Rajalingham2018public-i2n
Closed 2 months ago5
Update Quickstart Text
Closed 2 months ago
Allow users to see benchmarks they own
Updated 2 months ago2
Remove the gather_index in DataAssembly
Updated 2 months ago3
Create 2 science benchmarks
Updated 2 months ago
Time Alexnet run across all benchmarks on OpenMind
Closed 2 months ago2
Create Mini Table of Public benchmark scores
Updated 2 months ago
Run Model resnet50-VITO-8deg-cc on 1.0
Closed 2 months ago
Run Model resnet50_finetune_cutmix_e3_robust_linf8255_e0_247x234 on 1.0
Closed 2 months ago
Finalize Conversion process docs for UROP
Closed 2 months ago
Centralize Competition Models and Top 25 Models
Closed 3 months ago
Rerun rank 12 and rank 18 models
Closed 3 months ago
Change score_plugins job email to be generic
Closed 3 months ago
Investigate automerge not happening
Closed 3 months ago
Review jenkins after OM downtime
Closed 3 months ago
Verify users aren't getting multiple emails upon submission
Closed 3 months ago
Build a recipe to set up Openmind testing environment
Closed 3 months ago
change plugin limit to 1
Closed 3 months ago
Fix Travis AWS Credential errors
Closed 3 months ago
Document remaining models to be converted
Closed 3 months ago
Handle large submissions in tests
Closed 3 months ago
Retest that all models in vision pass generic_plugin_tests
Updated 3 months ago
Speed up test_integration tests
Updated 3 months ago
Resolve Travis memory issues
Updated 3 months ago
Create test to check that Jenkins and Travis are catching errors
Updated 3 months ago
Investigate Jenkins passing incorrectly
Closed 3 months ago1
Speed up test_endpoints tests
Updated 3 months ago