Below freezing, reactions inside lithium cells slow down. Lithium ions move less readily, internal resistance rises, and the battery delivers less usable power.
Charging in the cold is the bigger concern. If you charge a frozen battery, metallic lithium can plate onto the anode, damaging the cells and shortening their service life. Most manufacturers prohibit charging below 0 °C even when discharging is still allowed.