Reduce memory usage during training

Closes #172 (closed)

changed milestone to %ML Prod - Summer 2023

added P1 label

assigned to @mboillet

marked this merge request as draft

added 7 commits

• e85d3d2b...8c0dfdeb - 6 commits from branch main
• 1338f6ca - Simplify Collate function and fix decoder features

Compare with previous version

added 1 commit

• 344ca944 - Simplify DPIAdjusting function

Compare with previous version

added 3 commits

• ded809b1 - 1 commit from branch main
• dc639d29 - Simplify Collate function and fix decoder features
• cddd6587 - Simplify DPIAdjusting function

Compare with previous version

marked this merge request as ready

changed title from Draft: Fix OOM error? to Reduce memory usage during training

changed milestone to %DAN-P5: Improve training

requested review from @yschneider

I see how these changes could reduce memory usage. Did you assess the difference on a real training?

added 1 commit

• aa2790df - Apply review suggestions

Compare with previous version

added 4 commits

• 0f154c32 - 1 commit from branch main
• ccb78ae6 - Simplify Collate function and fix decoder features
• e0252761 - Simplify DPIAdjusting function
• d66ed2e3 - Apply review suggestions

Compare with previous version

resolved all threads

approved this merge request

added 4 commits

• a47466ef - 1 commit from branch main
• 63b27449 - Simplify Collate function and fix decoder features
• d1853913 - Simplify DPIAdjusting function
• 317c1fd7 - Apply review suggestions

Compare with previous version