You're there protecting some NPC Haulers from from A-->B... I fly in and start attacking the Haulers. You don't appreciate this, so attack me. We fight and you blow me up. That feels pretty PvP to me.
I see what your point is, but actually exactly this is what we already have with CG's and powerplay. This would even extend with a proper reputation system where you could spot alignemt of others if they have build up a certain reputation and would be visible as some kind of supporter or even member of minor faction XY.
But this, without a proper and balanced reputation system that includes perks and penalties leads us to threads like this or worse.