Low end vs high end storage devices

It's interesting to note that in the previous environment we had a very slow storage device, much much slower than the maximal bandwidth sustained by the cache and cpu of the machine.

In real life the databases are attached to raid arrays that delivers bandwidth of hundred of Mbytes per second.

The faster the disk is and the slower the cpu/memory is, the more O_DIRECT will make a difference in the numbers.