Run this command (which will update /etc/default/locale)
update-locale LANG=sv_SE.UTF-8 LANGUAGE=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
And if needed remove this file to clear any value stored in KDE
rm ~/.config/plasma-localerc