Merge "benchmarks: Create $normBenchs before the run instead of during"