A training loop repeatedly processes training data, computes model predictions and loss, backpropagates errors, and updates parameters across epochs. Validation runs measure learning without changing parameters; an untouched test set provides the final performance check. section 6.3.3 section 8.2.2
A practical loop follows these steps:
- Set the device, model, number of epochs, loss function, optimizer, learning rate, and any regularization such as weight decay. section 8.2.2 section 9.2.3
- Enter training mode, iterate over batches or the training graph, clear gradients, run a forward pass, calculate loss, backpropagate, and update parameters. section 6.3.3 section 9.2.3
- Enter evaluation mode and run the validation data without backpropagation; record loss, accuracy, or F1 across epochs as learning curves. section 8.2.2 section 9.2.3
- Evaluate once on unseen test data after training, because decreasing training loss and improving validation metrics do not replace a final generalization check. section 8.2 section 9.3.4
Voice-faking detection
A PyTorch transformer trains for 10 epochs with binary classification loss and Adam at a learning rate of 0.001. Each epoch updates parameters on audio batches, then measures validation accuracy without gradients; reported validation accuracy rises from 82.66% to 96.74%. section 8.2.2
Listing 8.3 Training deep learning model using PyTorch
num_epochs = 10
for epoch in range(num_epochs):
model.train() #A
running_loss = 0.0
for i, (inputs, labels) in enumerate(train_loader):
inputs, labels = inputs.to(device), labels.to(device)
optimizer.zero_grad() #B
outputs = model(inputs) #C
loss = criterion(outputs, labels) #D
loss.backward() #E
optimizer.step() #F
running_loss += loss.item()
print(f"Epoch {epoch+1}/{num_epochs}, Loss: {running_loss/len(train_loader)}")
model.eval() #G
correct = 0
total = 0
with torch.no_grad():
for inputs, labels in val_loader:
inputs, labels = inputs.to(device), labels.to(device)
outputs = model(inputs)
_, predicted = torch.max(outputs, 1) #H
total += labels.size(0)
correct += (predicted == labels).sum().item() #I
print(f'Validation Accuracy: {100 * correct / total} %')
Inspect the complete PyTorch pattern for device transfer, training mode, batch iteration, gradient updates, evaluation mode, and validation predictions. section 8.2.2






