Card spending saw its greatest fall since 2021 in November, as consumer confidence remains subdued, the bank found.