Benchmark Skepticism
The cluster focuses on debates about the reliability, reproducibility, manipulation, and real-world relevance of performance benchmarks in software and hardware contexts.
Activity Over Time
Top Contributors
Keywords
Sample Comments
Well, the benchmarks don't tell that.
Wouldn't it depend on how those benchmarks were written?
Man, I hope those benchmarks actually measure something.
Does benchmark-oriented means it's unlikely to help (or could even hurt) real world applications?
Spend some time looking at the real benchmarks before writing nonsense
This doesn't mean much without benchmarks
Doesn't that just kinda lend further support to the benchmarks being a bit silly?
Don't trust benchmarks. They're all manipulated by the hardware companies
Not a single benchmark on the page...Just sloppy TBH.
Benchmarks are snake oil when not being given the ability to reproduce them.