Trump is fed up with Powell, but experts say Americans seeking cheaper interest rates and lower prices shouldn’t be rooting for the Fed chair to be forced into an early exit.

President Donald Trump locked horns with Federal Reserve Chair Jerome Powell during a rare presidential visit to the U.S. central bank on Thursday, criticizing the cost of renovating two historical buildings at its headquarters and pressing the case for lower interest rates.

Trump is the first president to visit the Fed since President George W. Bush attended the swearing-in ceremony of Fed Chair Ben Bernanke in 2006. That ceremony marked only the third visit of a president to the Fed, Bernanke noted in his remarks on the day.