name: benchmark-suite-manager description: Manage and execute mathematical benchmark suites allowed-tools:
- Bash
- Read
- Write
- Edit
- Glob
- Grep metadata: specialization: mathematics domain: science category: reproducibility phase: 6
Benchmark Suite Manager
Purpose
Provides management and execution capabilities for mathematical benchmark suites for algorithm validation.
Capabilities
- Standard benchmark access (Matrix Market, NIST, etc.)
- Custom benchmark generation
- Performance profiling
- Accuracy validation
- Comparison against reference solutions
- Statistical analysis of results
Usage Guidelines
- Benchmark Selection: Choose appropriate standard benchmarks
- Custom Generation: Create problem-specific benchmarks
- Validation: Compare against known solutions
- Statistical Analysis: Properly analyze performance data
Tools/Libraries
- Matrix Market
- NIST Digital Library
- SuiteSparse Matrix Collection