I’m not OP, but I don’t think they meant “weren’t Anglo” but instead that the villagers were literally diverse, i.e. a lot of different ethnicities.

It does put a confused spin on both “huh, you’re from the two rivers? You look like one of those Aiel” and the post-siege development of two rivers where the increased diversity from folk moving from different places to there causes tension in the villagers.

I may be wrong, though.