At a joint appearance by Janet Yellen, the Fed chairwoman, and her three living predecessors, the conversation quickly turned to their economic outlook.