Americans on the lower end of the economy are feeling the impact of higher borrowing costs and weaker purchasing power.