Ehh, I dunno. Was it immature? Certainly. Intolerant? Yup. Ignorant? Most definitly. But I'm not too sure about racist.
Well, if one told a black man, "You Black piece of shit," I can almost assure you that the black man would see it as racist. I don't see why this is any different, but I don't know. You're probably right.