What the CF needs to do is wise up and create a definitive list of "approved" COTS gear for soldiers to buy, if they want to spend their money on it.
I'm not sure this is a viable solution.
The industry moves so fast and the bureaucracy is so slow that by the time good COTS gear is approved by the big army it will be outdated.
I suggest that we open the floodgates to everything CADPAT and let the decision making be done at the lowest levels. Let the section commanders, PL WOs, CSMs and RSMs shut down the really dumb pieces of kit on an individual basis. If a young Pte wants to spend his own money on COTS gear, let him. But if he's right outv'er, his section commander will shut that down and he'll suffer the expense of buying gear he can't use.
I have faith that a sort of non-issue "natural selection" will prevail. Guys will police each other and good ideas will thrive while bad ideas die out. Things will be constantly tested and evaluated and tactical thought will be stimulated as guys analyze problems and look for solutions. Scenarios will be war-gamed and guys will start thinking outside the PAM at the lowest levels.
In the grander scheme of things, I believe in democracy and a free market because it reflects a survival of the fittest in political ideology in the former and economics in the latter. These systems work because the free masses will always take the path of least resistance. Good businesses are allowed to prosper and poor business die out, trimming the fat and streamlining our economy. The majority vote wins allowing a government that most people can at least live with. One person will make mistakes, but 10 people will make fewer. 80,000 people all testing gear will show trends in what equipment works and what doesn't. The odd person might do something stupid, but overall the group will be better off.
This is demonstrated in the success of websites like wikipedia. Everyone knows of a case where some anonymous writer posted something on wikipedia that was way out to lunch, but it is usually caught pretty quick by 10 other people who know better. As everyone contributes together the end result is an largely unbiased source of mostly accurate information. Because it is policed by it's own freedom it avoids the mistakes a single author would make. It is survival of the fittest applied to knowledge. It's not perfect, but its fast and it's accurate enough - as shown by it's popularity.
Now, just because an idea is popular doesn't make it right. But in our environment with our operational tempo as it is and the amount of training that we do, we have the opportunity to test popular opinion against real world conditions. As more and more troops figure out what works and what doesn't in places like Kandahar and Helmand popular opinion changes to reflect real life. I don't care how many studies you do, a Canadian Battlegroup given free reign over their equipment will figure out what works best in Kandahar faster then a handfull of R&D types in NDHQ. R&D can conduct trails and surveys to try and see what the troops want, but the bayonets on the ground will always evolve faster.
War as I see it is a race of adaptation. The faster we can share information, identify goals, and focus on those goals the better chance we'll all come home alive. The faster we can fuck up the bad guys OODA loop and keep it fucked up the sooner the war will be over. It's about taking the initiative to throw the enemy off balance and aggressively exploiting those holes faster then he can plug them. If we adapt to the situation faster then he does, we will win.
So how do we do survive? The same way every other species fights for survival. Natural selection. It's defined life on earth up to this point and any species that had it's priorities elsewhere has died off. Free economy has brought financial prosperity, free democracy has brought political stability, and if given the chance a free thinking army will find the path of least resistance and choose the right gear for the job. It will adapt faster, fight smarter, and win wars.