E.R. Campbell said:
We They You are too risk averse.
The problem isn't that we are too risk adverse. Its that we don't consider all the risks.
I remember being in an MHP meeting where I was the only operator. Somebody (from the PMO, I think) said that the number one concern was flight safety. I pointed out it wasn't, it's operational suitability. If it was flight safety we'd park them all in the hangars and keep them shiny...
There is a tangible risk to not adopting new technology WHEN APPROPRIATE... the other side may adopt new tech or some other method to get around ours, and then you lose if you have to fight them, and you also become an ineffective deterrent.
However, the problem with using an iPad in the cockpit (and I would vehemently argue against it unless the risks are considered) are much more than EMI, or even than Technical Airworthiness:
- Inappropriate DANGEROUS use: ie low level nav on a system not tested to that level can very easily get you in trouble: crews aren't trained to understand the different in projections and datums of electronic maps to make sure they don't screw it up
- Over expectancy that the system is operationally correct
- Attention: playing with a fancy iPad while you fly into the water (I know a USN H-3 pilot who lost two firends because they were trying to figure out the ASN-123 during a departure from the dip)
- Supportability... you spend a bunch of MR money on your iPads, which rapidly become indispensable, but then 2 years later when the people that did it move on you bitch to the LCMMs because there are no spares
- Software supportability... yes the software works as advertised... but a couple of years later the maps it depends on are no longer available and there is no upgrade path, as an example
- and yes EMI, but I know for a fact you can do a full sweep on a Sea King in less than a week
The procurement and TA (technical airworthiness) process is inherently broken. however, the answer isn't to go around it, its to fix it.
It starts with the SOR. Alan Williams says the SOR is broken, that it isn't properly done, but he misses the point. The SOR should not be a contractual document, it should be a living, operational document, hence the O in Statement of Operational Requirements. As the threat and need evolves so should the SOR. IOT&E determines the delta between the SOR and the delivered capability (even if the SOR has matured and the need has changed). FOT&E determines the gap as the threat/needs evolves, and allows intelligent decisions to be made as to the priorities for Weapon System Improvements. The SOR itself is determined from overall defence guidance (when are we going to have another White Paper?), assigned roles, and assessed threats.
Advanced Weapon Systems, being software driven, are inherently an evolutionary activity, but the procurement system, with its "Requirement over the wall mentality," doesn't recognize that. The challenge is to properly prioritize and control the issues, to avoid the good ideas club taking over, which has to happen at the SOR level to provide guidance, and then at all levels of the change management process.
Williams also says that the thought that new equipment is cheaper is a myth, but again he misses the point. We ignore our fleets on the whole, and put all our eggs in the basket of the replacement. Of course it is more expensive, because it holds entire new capabilities. If it was just a replacement it would be cheaper to operate.
The TA checklist, last time I heard, is 52 items long. This is a result of everytime someone made a mistake a new step has been added, plus there are some empires that got it bloated. There hasn't been a rationalization of what we are trying to accomplish, which is to minimize the risk in operations, and to get the best bang for the available buck (a sure way to defeat a nation is to let military spend run amok, ask the Soviets).
We also need to actually understand, at the highest levels, what OT&E is for. It is an actual check to see if the equipment is operationally suitable, and what needs to be fixed in order to make it so, not an afterthought. We should have a central OT&E unit, for each environment, that reports directly to the environmental chief, and fleet OT&E units would be dets. In the Air Force this would make them an equal to AETE.
When ADM(Mat) was created PWGSC didn't exist... now we have two empires clashing with each other. Although the US system is FULL of problems, they make procurement a service chief issue. I'd like to see ADM(Mat) go away. Make the environmental chiefs responsible for all aspects of FG including equipment requirements and acceptance, with the the actual procurement done by PWGSC. Which implies the majority of the uniformed pers would be in the environmental chiefs.
With the new Federal IT strategy I'd also like to see ADM(IM) go away and be replaced with a "Cyber" Command... sort of a Communications Command with more operational focus, for the same reasons. But we don't need both...
Finally, we have so few trained and experienced people left to do this work, and aren't creating more. When I did SANC (which in large part is to lay the ground work) a few years ago I already had a robust experience level. The course was somewhat idsconnected from the reality... AAOC as become a catch all course for OT&E, procurement, DT&E to some extent, software management, software acceptance, etc, etc for operators. This are all separate specialties, and should be sub-specialties in occupations. Some of them shouldn't be operators at all, we should actually train our engineers to assist the operators, not tell them they are wrong...
OK, but we aren't going to fix that system, but understanding its shortcomings allows us to use it to our (as operators) advantage:
- first, most operator complaints are never written up, or written up properly. The UCR and SOCD system is what it is, but learn to use it properly
- once you have identified an issue, get the CoC to understand and support it
- follow an age old military axiom: selection and maintenance of the aim. This avoids the procurement sides biggest concern: scope creep.
- identify both the risks incurred and those avoided and document. Get the technical side to help, because there are things you don't understand. Once you have them, document how you are going to mitigate them.
- make sure there is a way your need will live on past your departure. These things normally take time.
- this is the most critical step: get command (which is by definition the operational side), as high as you can, to support your idea and accept the risks. Remember, at the end of the day the technical side can only identify the risks, it is up to the operational side (at the appropriate level) to accept them..
- encourage others to tear holes in your ideas, because you can either figure out it was a bad idea, or you can fix the holes. Especially during OT&E (whether official or not).
Bottom line, you can make the system work, but it takes ingenuity and hard work... bitching doesn't accomplish anything.
We did all of these things (poorly at times, and a lot of mistakes were made, hopefully resulting in "lessons learned") with the Sea King Augmented Surface Plot (ASP) project, which is a transitional project to get from the Sea King. The realization was made that we weren't, as operators, getting ready for Cyclone. The best tool we had, the Sea King itself, wasn't optimized for the current environment, and it was too expensive and too late to do that by traditional means. Therefore, we identified the Operational Risks involved (an actual decrease in the aircraft capability, which it turns out did not materialize but in fact an operational increase occurred), identified the risk mitigated (difficulty in transition), and identified and mitigated the Technical Risks. The result is a fleet fit of ASP is ongoing, which is in essence two tactical laptops with simple but effective nav, radar, AIS, and imagery interfaces and custom software.
We also did the exact same thing for NVGs, which are also being fleet fit, for mitigating transitional risk.
An interesting side benefit of is the Sea King is actually much more effective than it was a few years ago.
That certainly turned into a rant... maybe I should get around to putting it in a Service Paper.