Sorry, not a good idea on any level considered. You already have universal limpets, so specific types of controllers make sense - they are an equivalent of specific tools for specific jobs and I don't see how making them all become one thing will make anything better, more logical or more fun.
Happy for you to believe this. However, looks like this thread and the dozens on the same topic that preceded it paint a very different picture of everyone else's opinion.