Nah, it’s because the taste sticks and you shouldn’t scrub the layer of burned in away. The longer a cast-iron is in use the more of a unique taste it develops by itself, you can taste which cast-iron was used for cooking when you know them.

I have three and can taste the difference.

And no, its not dirty, its the intended use of cast-iron.