Yes they have queens. Actually multiple queens make up their society much like our power play leaders do. They even war with each other.
There are no on foot thargoid encounters yet so we have no idea what they look like. The thargoid device is just a machine so I doubt it's what they look like.