When the bombs are spent, use depth charges.
When that too is spent, feint a bomb run to rattle the ships