You can bring up the upgrade menu anytime by pressing E.
Move your bobber using W/S, and A/D to turn.
Once close to ripples, hold SPACE to catch a fish!
Open the pond selection menu with F.