Is it time to replace the bottom bracket?

If the play is on both sides of the crank, yes.
Sometimes the crank arms come loose and develop this sort of play.