A ruling Labour Party has suddenly shrunk to a minority on a Kent council after members defected within a week.