Why should you care?

Automated benchmarking or scientific testing ensures maintaining the accuracy of the methods when changes to the codebase happen.

Different benchmarks can have different goals

  • Ensure that software improves over time
  • Ensure that software performance doesn’t degrade over time