FedericoAureliano / aiutare

Automated Analysis, Regression, and Evaluation

FedericoAureliano/aiutare Issues

Convenient packaging solution?
Updated 5 years ago
Setup and execution need testing in a virtual environment (issues with MongoDB)
Updated 5 years ago
Generate regression models based on the current contents of a database and provided independent variables
Updated 5 years ago
Model cross-checking for SAT branch
Updated 5 years ago
Add maxrss (RAM usage high water mark) reporting for all programs run by aiutare
Closed 5 years ago
All functions that use config should reload(module) the config file after it is updated
Closed 5 years ago
SMT model peer-verification
Closed 5 years ago
Do more experimentation with Syrup to analyze performance
Closed 5 years ago
Create a generalized plotting script that can be used for any category and extended by the user
Closed 5 years ago
Update dev branch with new install method, updated structure, and basic graphing functionality
Closed 5 years ago
Reorganize repo structure to mimic stringfuzz
Closed 5 years ago
All plotting needs to still function on data where Exceptions were caught
Closed 5 years ago
Replace analyze.py with our own summarize script
Closed 5 years ago
Progress indicator while benching
Closed 5 years ago
Make everything work on Windows 10 64bit
Closed 5 years ago
Move as much functionality as possible OUT of bench to optimize for running bench multiple times
Closed 5 years ago
Package project for pip distribution
Closed 5 years ago
Make the program easier for users to set up
Closed 5 years ago
Individual solvers will occasionally not run and/or not write their results to the database
Closed 5 years ago1
All output interpretation and writing to csv files (and eventually the database) should be extracted to be handled on a by-program basis
Closed 5 years ago
Each solver's output2result function will need to be expanded once feature extraction is implemented
Closed 5 years ago
Refactor bench and analyze to be modular/also compatible with SAT solvers and problems
Closed 5 years ago
Write setup.sh files for automated installation of case study solvers
Closed 5 years ago1
Select which CDCL SAT solvers to compare
Closed 5 years ago1
Develop NoSQL database schema
Closed 5 years ago
Use linear regression to generate expected runtime models
Updated 5 years ago
Extract features from problems and allow for graphing based on these metrics
Closed 5 years ago
Writing benchmark results to database
Closed 5 years ago
Analyze/graph benchmark results from database
Closed 5 years ago
Run past versions of solvers
Closed 5 years ago
Use control groups to plot accurate significance levels on each graph
Closed 5 years ago
Use JSON files to handle command line input for each category
Closed 5 years ago
Need a collection of real problems for benchmarks
Closed 5 years ago2
Need a way to generate artificial problems
Closed 5 years ago