Well it looks like I was wrong previously, some settings were still set to polish. When ALL regional settings are set into EN(US) exporting to excel works fine. (tested second ago)
Still, I prefer working in Polish local settings, so I would use OLEDB.