Propose an alternative activation function for your model to mitigate numerical instability issues caused by the sigmoid function. Explain the reasoning behind your choice and any tradeoffs involved.

Replace the sigmoid function with the softplus function, which has a smoother derivative that avoids zero points and reduces vanishing gradients during backpropagation. This change comes at the cost of slightly increased complexity in the model’s output layer.