name: benchmark-suite-manager description: Manage benchmarks for algorithm engineering experiments and evaluations allowed-tools:
- Bash
- Read
- Write
- Edit
- Glob
- Grep metadata: specialization: computer-science domain: science category: research-documentation phase: 6
Benchmark Suite Manager
Purpose
Provides expert guidance on managing benchmark suites for algorithm engineering and experimental evaluation.
Capabilities
- Standard benchmark suite access (DIMACS, TSPLIB, etc.)
- Instance generation for specific problem classes
- Statistical analysis of results
- Performance comparison tables
- Visualization of scaling behavior
- Reproducibility support
Usage Guidelines
- Suite Selection: Choose appropriate benchmark suite
- Instance Selection: Select representative instances
- Execution: Run experiments systematically
- Analysis: Perform statistical analysis
- Reporting: Generate comparison tables and plots
Tools/Libraries
- DIMACS
- TSPLIB
- SuiteSparse Matrix Collection
- Statistical tools