Explain cache system

• why there is a cache
• why it's only useful for large batches with multiple workers where results depend from previous workers (balsac style)
• what's covered