1. Mandarin . Why it’s so hard: It may be the most spoken language in the world, but it comes with its own difficulties for English speakers. Since Mandarin is a tonal language, you can have a completely different meaning of a word just by changing your tone.