Estimate a sensible early-stopping patience and the expected total training time from your observed training speed, before you launch a long run.
patience 过大浪费算力,过小可能早停。
| Item | Formula / Note | Source / Standard |
|---|---|---|
| Early stopping | stop training once validation loss stops improving for several epochs | Prechelt 1998 |
| Patience | too little patience reacts to noise and too much wastes compute | Prechelt 1998 |
| Regularisation effect | early stopping limits the parameter norm, acting as regularisation | Machine learning theory |