Crowds watch Mexican drill riding display

The speaker reflects on their English proficiency, expressing that mastering the language is challenging.

In what ways can learning English be considered harder than other languages?

Reflect on the statement 'it's even harder to do that.' What does 'that' refer to?