Speaker John Boehner told his conference on Tuesday he will move to a “Plan B” in fiscal cliff talks with the White House that would raise tax rates on annual income above $1 million, The Hill reported.

The House speaker announced the plan to his conference behind closed doors after a flurry of negotiations with President Obama that made it appear the two sides were moving closer to a deal.

Boehner is not cutting off talks with Obama and told members his Plan B is less than ideal.

But he told members that with time dwindling before massive tax increases on all taxpayers occur in January, the House must also have a backup plan.