How is that racist? The OP said they didn't speak english very well but didn't say what their native language is. So I said yes in every language I could find.
A bunch of them were from predominately white countries.
I realize the OP almost certainly understands "yes", the whole thing was intended to be friendly and funny.
If they had said they spoke french and I only said "oui" to answer the question would that have been racist to you? --- Reading is good. It improves your vocabulary, expands your imagination and provides endless amounts of information.