Wednesday, July 06, 2011

Deliver Us From Bean Counters

Background:
I’ve been ‘taking to task’ a hyperventilating commenter over at DoD Buzz who goes by the handle ‘Engineer_Economist’. He (I am assuming he is a ‘he’) is in a fully formed outrage over what he claims is the completely failed and doomed F-35 program. He bases his claims on what I see as  superficial knowledge of what might be the actual status of the program and what IMHO publically mimics a school-house awareness of the acquisition process (see for yourself here). It is entirely possible that he has worked one or more 'smallish' programs (as compared to the F-35), but doubtfully anywhere near a Program Manager level. This experience seems to have reinforced a dogmatic, and incorrect belief that the acquisition process must be implemented according to strict interpretation of a very rigid paradigm, and if not then there is a certainty that chaos and failure WILL result. When and if he someday runs a program, he will find there are many ways to ‘skin a cat’ within the bounds of the acquisition process. When and if he someday gets involved in a program with major political ramifications, then maybe he’ll see where real program chaos comes from.

In the linked-to comment thread, I gave him a challenge (my typos corrected):
I haven't avoided your arguments at all, just cast scorn on them as hybris-ridden rantings of a program manager wannabe. If you can't Grok that the objectives and goals of the processes are more important than the processes themselves, that we have rules and processes to foster success and order--not to DEFINE success and order, that is not my problem. Let me flip your arguments back on you: tell us EXACTLY WHY what is so overarchingly important to you, should be just as important to me, and EXACTLY WHAT will be the consequences if your worst fears come true if no one listens to you....and I will post a complete ‘fisking’ of it at my place.
'Engineer_Economist’s' response:
yes you have avoided the arguments and you are still avoiding them. you have faith in and are selling us on the unit cost estimates when development is far from complete. again, I have to explain to you, the F-35's latest SAR shows MS B as being rescinded, and all the dates for IOT&E, IOC, MS C, FOC, are all TBD. That means there is no schedule. They canceled the DAB that was supposed to determine these dates. They can't even hold the DAB the program is so screwed. If you'd pay attention I wouldn't have to REPEAT to you over and over again why this matters. F-35 continues the repeated failing pattern of late, overbudget, and underperforming programs. If we continue to reward such programs, the problem will just get worse and worse. We will fail to properly recapitalize our defense system portfolios, forcing us to operate legacy systems longer & longer and greater risk. If I just say "DMS" are you able to make the connection or am I going to have to explain THAT to you as well?
And now, I fulfill my promise
The only 'splaining' you've done is to yourself –and it is more appropriately called ‘rationalization’. Simply declaring you are ‘right’ about something without supporting facts or claiming doom without explaining how and why “B” will follow “A”. Stating what form it will take and assertion of doom with certainty) does not explain much less prove diddly-squat. The irony here is that if you had managed to judiciously insert a few ‘perhaps’ , ‘mights’, or ‘increased chances of’, I don’t think hardly anyone would have have had a problem with your comments. But instead you pretty much only insist repeatedly that the 'formalities must be observed' and declare that because they’re not occurring according to a script (as you believe they should be), then an epic program failure is happening all around us. And all of your outrage is based upon ... made-up and poorly understood (public) cost estimates (and expectations) as well as your frail outsider understanding of actual schedule drivers and impacts to-date, and all with no idea of the nature of program or what risks are behind it or what the risks are that sit ahead. The program does. DoD does. Political posturing aside, I believe even enough of Congress does. You don't, and are in a sophomoric snit about it.

Let the Fisking begin!
Your argument is sufficiently vague to ALMOST evade ‘fisking’, but not vague enough.
We’ll take your key ‘points’ in order.
>RE: ” …the F-35's latest SAR shows MS B as being rescinded, and all the dates for IOT&E, IOC, MS C, FOC, are all TBD. That means there is no schedule. They canceled the DAB that was supposed to determine these dates”
Such hyperbolic breathlessness! Schedules and progress don’t magically disappear based upon a declaration of a Milestone do-over or reprogramming, so rescinding MS B doesn’t mean there is no schedule or budget baseline. It DOES mean that the program is still working to a previous baseline while it is developing updated schedules and budget forecasts for a new baseline. 
>RE: “They can't even hold the DAB the program is so screwed…”.
No. It means that because the F-35 is a VERY large and complex program, nothing is easy - even bean counting. In fact, if you read around a bit, I believe you will find that the biggest driver in delaying the DAB is the reconciliation of the so-called ‘independent’ CAPE and program cost estimates. The PEO wants to get things right, and ensure as much actual program data is available so the DAB is now slated for sometime in the Fall. Good on him.
"It was decided: why don't we let a little bit more of the performance of the program both in test and production play out through the summer; why don't we let that integrated master schedule get finished, do a schedule risk assessment of it, present that to service leadership, let them ponder IOC [initial operating capability], let the operational test planning complete," said JSF program executive officer Vice Adm. David Venlet. "Then, rather than set a baseline now with a whole bunch of go-finish-your-homework assignments, we will go finish the homework and then present the new baseline for [Pentagon procurement chief] Dr. [Ashton] Carter's approval in the fall of this year."
….The delay is a matter of being thorough, not an indication of new problems, Venlet said.
"That is not a sign of alarm. It is, I think, a determination to continue in a deliberate fashion with good solid fundamentals applied to get things done," he said.
Thus we find the JSF program is evidently not “so screwed” as the ranting of a PM ‘wannabe’ might lead us to believe and insists MUST be true in spite of evidence otherwise.  
>RE: “…. If we continue to reward such programs, the problem will just get worse and worse. We will fail to properly recapitalize our defense system portfolios, forcing us to operate legacy systems longer & longer and greater risk.”
I think we may assume that you are using the term “reward” metaphorically for deciding to continue pursuit of a program instead of a literal and illogical ‘reward/punish’ paradigm. Mission need and the cost of meeting that need versus the risk of not being capable of meeting that mission need is all that matters in determining the viability of a program. To-date, the F-35 program is seen as executable by those responsible, and the mission need remains in the eyes of the users. As I’ve noted before, outside observers on the sideline don’t know diddly, never have – never will.

On CAPE estimates and comparisons for casual readers dropping in:
My ‘opponent’ gives much credence to external estimations (that employ varying assumptions, (many of which are irrelevant) that predict outlandish costs In the out-years, yet completely discounted the fact that LRIP 1-3 deliveries have beaten internal program cost estimates to-date and are trending downward. Like many, he chose to believe external numbers. I choose to believe my ‘own lying eyes’ and the information in front of them. [BTW: I suspect these same internal estimates are now showing adverse impacts to earlier LRIP 4 and 5 due to constantly imposed program ‘tweaks’, but I also predict they will STILL be significantly lower than the farcical external estimate methodologies, including CAPE’s.]
Since reconciling the CAPE estimates with actual costs to-date and internal cost projections is a sticking point that will remain with us for some time, I cannot pass up this opportunity to highlight some known aspects of the CAPE estimate -- and how much ‘relevance’ the government really (vs. publically) places on CAPE estimations… and we need not look any further than how the LRIP 4 negotiations were conducted [emphasis mine]:
Lockheed Martin officials take issue with the Pentagon’s APUC estimates, which come from the cost analysis and program evaluation (CAPE) office. “The CAPE model uses production costs derived from the F-18 and F-22 programs and extrapolates them out to 2037 using only a 50-percent confidence level,” Steve O’Bryan, vice president for F-35 business development, told AIN. “That model takes no account of our plans for lean production, nor our much lower supplier costs. For instance, we can buy an F-35 radar for half the cost of an F-22 radar. We can make the same order of savings on the electronic warfare system and other avionics, including the single-piece plasma screen in the cockpit.”
Moreover, he added, the APUC figure includes military construction necessary to support the F-35 and a portion of the support costs. The F-35 comes complete with radar, avionics, defensive systems and so forth, as well as weapons pylons, he noted.
“While the U.S. government uses the high independent estimates for program budgeting purposes, it holds the contractor to an entirely different standard in contracting for the actual aircraft,” another Lockheed Martin spokesman told AIN. Negotiations for LRIP Lot 4 (low rate of initial production) have been under way in the weeks leading up to this week’s Farnborough show. The government’s offer was 40 percent lower than its own CAPE estimate for this lot, while Lockheed Martin’s opening bid was 20 percent lower than the same estimate. “We’ll settle somewhere in the middle of that range,” the spokesman added.
And so a LRIP 4 production deal came to pass. [As a side note, I find it interesting how many of the major aerospace websites covered the same story at the time. They somehow seemed to have ‘missed’ some of the more ‘affirmative’ details concerning the F-35. (Just saying)]
The above quote also highlights the pivotal bookkeeping hook that ‘some’ are using to draw inappropriate (since the end purpose appears to be nefarious -- might I say “unfair”?) comparisons. Whereas F-16/F-18/AV-8 costs tossed around are essentially the URF [my note: ‘Unit Recurring Flyaway’ cost], we note that the F-35 numbers tossed around  by critics these days are estimated  “APUC”[my note: Average Procurement Unit Cost]. This is not trivial, so an example is in order:

Mod programs to bring early production aircraft up to final production standard have typically been booked against the APUC and are thus missing from F-18/F-16 and AV-8 URF numbers, But these costs ARE included in what is being thrown around concerning the F-35. These high jinks are not unprecedented: Pushing the APUC costs in the public mind has been an increasingly common tactic of incumbent programs (not just by contractors – do NOT underestimate entrenched DoD constituencies):
Comparisons between the acquisition costs of the F/A-18E/F and an attack capable version of the F-14D, such as the F-14D Quick Strike, have been highly conjectural because of conflicting estimates of development and production costs, and projected inventory requirements . In mid-1991, Department of Defense (DOD) officials estimated their flyaway unit costs in FY1990 dollars as $33 million for the F/A-18E/F vs. $44.5 million for the F-14D Quick Strike . F-14 supporters noted, however, that flyaway costs do not include development costs, which would be several billion dollars for the F/A-18E/F vs. several hundred million for the F-14D Quick Strike . They noted further that these flyaway costs assumed annual buys of 72 F/A-18s vs. 24 F-14s, and they argued that comparable 72-plane buys would reduce the cost of each F-14D Quick Strike to $34 .5 million, approaching the cost of an F/A-18E/F. “ (p.10)
When evaluating mercantile claims critical of ongoing programs, it is best to always consider Cui bono?” While the incumbent contractor’s ties to their commercial interests are obvious, it still takes a certain willful ignorance to pretend those assailing an ongoing program are not serving what they perceive to be their own self-interests.

Additional Notes on the Use and Abuse of Cost Numbers
In a rational world, we could leave the question of whether or not the JSF program is progressing, is ‘worth it’ and has the majority of its ‘risk’ behind it with an answer of definitely “YES” . We can also answer a similar question as to if the JSF program still needs to be managed carefully to ensure the plans and program are successfully implemented in the years to come with an equally emphatic ‘YES” (I am aware of no one who disputes the second point) . But I think given the disconnect between the hysteria generated by JSF-detractors in their public-relations war against the F-35, and actual program status, a couple more points should also be made.

1. SDD costs are running higher than first projected. That anyone would think stretching the SDD to reduce program and production risk would not have adverse cost impacts speaks more about those who think such lunacy than the program itself. Squawking about increased SDD costs as if they were some unexpected anomaly without acknowledging the role that decisions made to ‘buy down’ risks had in the cost increase is disingenuous. I would blame decisions made solely by Lockheed Martin for exactly one year’s worth of schedule delays to-date, and that was because their plan was to fully staff the program faster than any program had been staffed before, but did not change any of their staffing processes or ground rules: you can’t get different results unless you do things differently. Ironically, this delay is about the only one that we can point to that contributed relatively little to the SDD cost growth: if you don’t hire the people to begin with, it doesn’t cost the program for people they don’t have to not do the work. Conversely, if you stretch your plan after the people are on board, it costs big $ to have a capability run in place. Conversely, if you elect to cut deliverables after your program is staffed up and running, you are burning dollars while running in place. I’d like to know what the costs of cutting the LRIP batches are. This would include not only the costs of LRIP production batches, but also the costs added by suppressing the learning curve needed to achieve full production rates. There’s also a PhD thesis ripe for the picking for some industrious candidate in this problem: Develop a methodology to trade off the costs of early production units having to be modified to later baseline configurations against the increased costs of production units with inhibited learning curves. The trick is to make the methodology transparent enough for innumerate policy makers to understand. Good Luck.

2. Given that the F-35 program is replacing (from the US point-of-view) 4 existing aircraft weapon systems, shouldn’t the SDD cost of replacing more than one weapon system (at least two?) be the standard by which the F-35 SDD program costs and schedules are declared “too high”? (some other thoughts on ‘perspective’ and other factors here) I submit that the SDD cost increase would have to be significantly greater than the current projected bill before the JSF SDD costs became anything less than a ‘tremendous bargain’.

About the worst that could ever happen at this point is for the program to ‘break even’ and that is only if some VERY major technological hurdle pops up that no one yet sees. I think the chances of such a big ‘uh-oh’ moment are highly unlikely this late in the program. (This not to say the weak sisters among us don’t try to manufacture a crisis every time a little hiccup comes along)

In closing, it must be mentioned that at the root of all the confusion, claim and counterclaim concerning costs, is the fact remains that no one has ever presented a complete line by line comparison and analysis of the cost numbers, or the legitimacy of their underlying rationale, being thrown about.
Nor is there a reason to – the decision makers have the numbers.

Tuesday, July 05, 2011

Hope Everyone Had a Good 4th of July Weekend

Mine was bittersweet. All my immediate family is stateside for the first time in years. But I also found out I had just lost a former colleague (and Texan) whom I was fond of -- he was killed in an experimental aircraft flying accident mere days before he retired from an illustrious career in aerospace. 'Priorities' were on my mind this weekend and blogging didn't make the cut.

Tuesday, June 28, 2011

F-35 and 'Misleading' Cost Estimates

And I'd describe the term 'misleading' as "generous"...

Loren Thompson, the Lexington Institute founder, and policy wonk the Non-State Actors and Opposing Ax-Grinder types love to hate has a 'pretty good' column up at Forbes titled "Massive Cost Estimate For Fighter Program Is Misleading" where he bemoans the curious external cost estimate 'inflation' that is all the rage and afflicting the F-35 program these days.

I'm not a huge fan of Thompson (or of his lead Defense Policy Wonk Dr. Goure) but then again I'm not a fan of pure defence 'policy' experts in general. The mere need to attach 'policy' to the moniker usually screams a certain 'political' and not 'technical' expertise. The 'big picture' view of 'policy' types often leads them to not pay close enough attention to the hard details --and then they falter in reinforcing their points by using flawed anecdotes or examples.This penchant, I believe, detracts from their ability to get their message across and can harm their credibility in the eyes of those they seek to influence the most: marginally involved and undecided politicos (directly)... and (indirectly) a large part of the interested public.

But after the early missteps in the piece (which I will discuss shortly), Thompson lays out a very good review of what is actually going on with all the 'funny' numbers  being thrown around concerning the F-35 program.

Read it ALL.

Missteps and Gems

The Missteps:
My comments in [brackets]
1."The F-35 Joint Strike Fighter is the most expensive weapons program the U.S. Department of Defense is currently funding. The reason it’s [the program] so costly is that the Clinton Administration decided in 1993 to replace a slew of cold-war combat aircraft operated by three different military services with a single family of planes.
[This is an oversimplification to say the least. As I've posted before, the reasons are more accurately :
a. The simultaneous procurement of the AF’s High-Low mix (F-15 & F-16) in the 70s-80s. It should surprise no one that concurrent acquisition increases probability of concurrent obsolescence. The F-16s are in a little better shape wear-and-tear-wise than the F-15, but the Stealth Revolution and advances in near-peer fighter and air defense technology is bringing obsolescence to both fighters at about the same rate.
b. The failure of the Navy to execute the A-12 program. A large gaping hole was created in Naval Strike when that program failed and after the A-6s were retired.
c. An earlier Congress pressing on combining Air Force and Navy needs, then requiring the absorption of the Marine Harrier replacement effort. This forced three efforts that could have been developed at their own pace which would have spread out the costs and risks to be rolled into one schedule and one set of budget line items paid for at the same time. Combining three efforts into one creates program complexity that should be avoided if it can be avoided, but given a. and b. above, this arrangement became unavoidable. You can argue the ‘unavoidable’ part only if you are willing to assume a completely different set of risks as acceptable. The DoD doesn’t believe it was/is avoidable and I don’t either]

2. Cost is crucial for two reasons. First, if the price of each plane rises too far, potential users will start dropping out of the program. Fewer users means lower production rates, so economies of scale are lost — leading to further price increases. This dynamic is referred to in the aerospace industry as the budgetary “death spiral,” a process that did in the Air Force’s last new bomber and fighter before production numbers got anywhere near what the service needed.
[The B-2 numbers were capped under the guise of gaining a perceived “peace dividend” after the design was highly developed and the production capability was already sunk cost. The B-2's were (wrongly) perceived as only useful for a Cold War gone hot in a 'Nuke' weapons employment scenario]

The Gems:

'Actuals'.
"However, what got lost in the exchange was the distinction between estimates and actual costs. The more you examine the program’s track record to date and the methods utilized to calculate future costs, the less clear the program’s real price-tag becomes. In terms of the track record so far, the contractor has repeatedly delivered early production planes for less than the Pentagon estimated they would cost, and its internal projection is that it will be able to market the most common version of the plane at about the same price that its F-16 fighter currently sells for overseas — about $65 million each."

Timeframe.
The most important thing to understand about the estimated support costs for the F-35 is that they are projected over a 50-year period, through 2065. That inevitably creates misconceptions about costs for two reasons. First, the cumulative cost of any ongoing item is going to look huge if it is projected out over a half-century. For instance, the 50-year cost of the various music bands the military sustains is around $50 billion, if you assume present funding levels persist and inflation continues at its current pace. [I've heard/read this 'band' analogy before, but it is still a good one]

Context.
....With regard to the price of alternative modernization strategies, it already costs more each year to sustain the legacy fleet of tactical aircraft the F-35 will replace than the highest official projection of F-35 annual support costs. In fact, if the same assumptions used to project F-35 support costs are applied to legacy aircraft, it would cost four times as much — $4 trillion — in “then-year” dollars to maintain the current fleet rather than transitioning to F-35...
[ Also, how 'good' are the numbers? I made the following comment once at Strategy Page in a discussion  about O&S costs covering 65 years: “whataya' reckon the accuracy of costs projected 65 years in the future are BTW? Hint: think of how you would estimate the costs of operating a plane in 2010 that was first fielded in 1945”]

Methods.
[I like the whole section on this topic] A further degree of confusion is fostered by failing to distinguish between actual cost growth and changes in the counting rules used by government estimators. Three-quarters of the increases in F-35 support costs reported by the Pentagon have resulted from changes in the scope of work being analyzed or changes in the methodology for how costs should be calculated, rather than rising costs in the program. With regard to changing scope, the government has increased the number of years estimates cover since its initial cost projections from 30 to 50; it has increased the number of bases where F-35s will be stationed from 33 to 49; and it has doubled the amount of support equipment it plans to use in sustaining the aircraft. With regard to changing methodology, the government revised its formula for projecting support-cost growth (adding $50 billion to estimates); switched from industry to in-house metrics (adding $33 billion to estimates); and included capability upgrades previously excluded from support-cost models (adding $28 billion to estimates). All told, government adjustments unrelated to contractor performance have more than doubled F-35 support-cost estimates since the program began.

Omissions.
... They also failed to note that the F-35 management system was designed to track all costs associated with operations and support, whereas legacy aircraft lacked comprehensive accounting systems. This point has been noted repeatedly by the Government Accountability Office, a watchdog agency, and explains why items like aircraft modifications, pilot training and information systems are captured in the F-35 cost estimates but not in the support-cost estimates for previous planes. When comparisons are adjusted to remove [just] this disparity, the cost per flight hour of the F-35 is only about ten percent higher than that of legacy planes for a fighter that is far more survivable and effective.

I can hardly wait for the 'Nattering Nabobs of Negativity' to latch on to this one...

Added 29Jun11: Solomon over at SNAFU has a good post up on F-35 shipboard integration where they talk about the F-35 program paying for the cost. Some integration and alot of other costs for legacy programs have not always been booked against the airplane program proper. the F-35 has the most inclusive cost numbers I've ever seen. This [is the] kind of cost accounting disparity between F-35 and legacy programs that Loren Thompson refers to above. 

Saturday, June 18, 2011

San Antonio Sucks

Wrapping up a long weekend in San Antonio, Texas on an Anniversary getaway.I lived in San Antonio twice while growing up, including the magical 1968 when the World's Fair was here. My Mother was born and grew up here. I've been back several times over the years and this time I have to say it was the most disappointing trip ever.

It wasn't the heat (105 degrees today!), it wasn't the so-called luxury hotel on the Riverwalk (Housekeeping WAS excellent btw).--- It was the 'city': San Antonio is rotting from the inside out. Between the panhandlers at every turn (Downtown AND out at the Loop 410) and crazies (Downtown) running around, the City is a shadow of what it was. I was particularly struck by the disrepair of city parks and properties, including a late 1800's stone house built by my Great-Great-Grandfather and several other buildings on the old Hemisfair grounds. My Grandmother sold the house to the city under an Eminent Domain deal for use in the World's Fair. The bars and restaurants along the Riverwalk and in the Northwest area were great, but speaking as someone who has bought nights in hotel rooms in Washington DC, San Diego, Atlanta, Tampa, and Los Angeles in the past two years, San Antonio is waaaay too proud of their hotels. Mine didn't even have non-valet parking, and the city lot across the street gouged me for a flat rate, in advance, on my last night that will require me to leave by 0800hrs tomorrow to keep from paying even more. Add to that finding just about the highest number of A**holes per square mile that I've encountered in the State of Texas, and I am left with very little reason to come back. I used to count San Antonio among my few real 'hometowns'. No more. We enjoyed the attractions we took in and our weekend in spite of instead of because of the 'city'. Thanks for nothing San Antonio, next time I'll drop my many hundreds of $ in Fredericksburg or someplace else where it is appreciated.

Update 18 June: Back home and able to post a couple of photos. Here's Great-Great-Grandfather John Kusch's house on the old Hemisfair grounds that I refer to above. The 'city' is not a very good caretaker IMHO, so no telling when and if they decide to just tear it down after letting it go to pot, so I decided to at least preseve the memory.
The city inventory description:
John Kusch, a stonemason, is believed to have constructed this 19th century, Gothic Revival house in 1885. Its interesting features include metal-clad gable roofs with box girders and simple, eave moldings. During HemisFair, it housed the “La Fonda Santa Anita,” an elegant, urbane Mexican restaurant patterned after a similar restaurant in Mexico City...

And this is how close it is to the "Tower of the Americas":

Monday, June 13, 2011

X-45 Secret History? More Like Historical Fiction

Ah...A 'Boeing Tall Tale' to scare the children. Someone should tell them that the UAV world is still a fairly small and close-knit one...and made up of people with very good memories.

David Axe has a piece up at Wired’s Danger Room that self- identifies as an uncritical ‘Boeing POV’. While Northrop Grumman evidently declined to comment on Boeing’s collective memory, that hardly excuses the slobbering deferral to Boeing’s ‘claims’ and the gross lack of investigative skill or skepticism applied in the article.

That it seems like Axe didn’t bother with a critical eye at all in this ‘effort’ is shown by the assertion that the Government gave Northrop Grumman money to develop the X-47A. Wrong. US Government funding came after the development of the Pegasus.

Northrop Grumman X-47A Pegasus
The ‘Pegasus’ was a “company-funded” effort that Corporate Vice President Scott Seymour sponsored and nurtured through a rapid development process to keep Northrop Grumman in the UCAS running. This fact was in all the news at the time. The ‘Pegasus’ existed before DARPA got involved and gave the UAV the ‘X-Plane’ designation.

Since Scott Seymour no longer works for Northrop Grumman, perhaps he might be willing to talk to David Axe about it some and give another viewpoint that isn't 'All Boeing'? I know software developers and integrators that produced the X-47A, so far the only response I’ve received from any of them when I refererred them to this article is that the piece made their stomach turn….and to tell Axe the X-47(A or B) is not ‘remote controlled’: It is AUTONOMOUS -- with provisions for human intervention by exception rather than as a rule. If Axe ever viewed the X-47A first flight video, he might have observed that no one was 'controlling' the Pegasus: everyone was monitoring the flight. The only commands given by the ‘controller’ (‘Old Heads’ in the Test Pilot community should immediately recognize him in the control room BTW) was to hit the ‘GO’ button to get it moving off the parking spot, some EOR power checks by the engine contractor,  the ‘release brakes’ command for takeoff and a precautionary speed change. For a 'First Flight'? Incredible. The whole point of the exercise was to demonstrate autonomous flight with a precision carrier-type approach and landing, which the demonstration did admirably (See SRGPS link below) .

Having got the who-funded-what wrong on the X-47A, Axe’s Boeing fairy-tale tellers didn't get any better. He should try to be a little less gullible next time. He had me falling out of my chair laughing with the Boeing claim that since their X-45 was 'thinner' it would be stealthier. He should have asked them: how many LO weapon systems they've fielded to-date? There are two houses that really ‘get’ LO: ‘Northrop’ and ‘LockMart’. Boeing is playing catch-up, and OBTW they benefitted greatly in the LO department when they bought McDonnell Douglas who benefitted from exposure to Northrop’s LO expertise on the F-22 and JSF programs. If the Borg (my Lockheed Martin colleagues’ favorite name for Boeing) hadn't bought Rockwell and McDonnell Douglas, they would be even farther behind than they are.

Classic Boeing Hybris
My favorite line from the article though has to be: "How could Northrop, with what they strongly believed was inferior software, possibly pull off a robotic carrier landing cheaper than Boeing?"
WTFO? Sounds as if the Borg ‘believe’ it, then it just HAS to be true, doesn’t it? Not on your life. Boeing's explanation on the cost differential doesn't hold water for a variety of reasons I won’t (can’t) go into either. Suffice to say the X-47A first flight was also the first flight for the Navy’s Shipboard Relative GPS (SRGPS) system aka ‘Navy JPALS’. Read the entire article at the SRGPS link – there’s lots of info on what Northrop Grumman actually accomplished (on their dime) with that little self-funded ‘Phase 1 ’ hop.

Raytheon BTW, has since selected Northrop Grumman’s IMU as the heart of their JPAL System. So perhaps Northrop isn’t as 'hapless' when it comes to navigating UAVs around the patch as big bad Boeing would like the unwashed masses to believe? Maybe Northrop Grumman has resources to draw from beyond their airplane-building sector that Boeing chooses to selectively ignore?

Axe was fed a  treble hook on a 100lb-test line this time. If he is not careful, he is well-positioned for continued use as a Boeing pawn in Boeing's ever-more desperate attempts to be relevant on the combat aircraft scene.

I fear Boeing will eventually start winning 'something' just to keep them in the game. Expect to hear even more woe-is-me BS from Boeing as production contracts near for a Naval UCAS. But I had to listen to Boeing tell the world it was they who really did the software and integrated the B-2, and now LM gets to hear the same crap over the F-22. Boeing shouldn’t be allowed to rewrite history on UCAS programs as well.

06/15/11 Update:I'm starting to get e-mail correspondence on this post pointing out other problems with 'the story' as Boeing narrated and Danger Room presented. One commenter noted that Axe got the first flight date of the X-47A nearly a year later than it actually occurred. The X-47A first flew on 23 Feb 2003 and NOT "January 2004" as claimed in the Danger Room article. One way this milestone might have been screwed up could be that the reference of the February 2003 flight was pulled from a reference to it posted/published in January 2004.

Saturday, June 11, 2011

Fear of Unknown and Almighty $ = Turn off Your Phone After Boarding

(H/T Instapundit)

Every time I fly, listening to the flight attendant's sincere directions containing the simplistic assertion that personal electronic devices (PEDs) may interfere with aircraft operations and directives that I must turn off my electronic devices ALMOST makes me forget I had just played a bit role in the latest episode of Security Theater. There is an ABC News piece with the headline "Is It Really Safe to Use a Cellphone on a Plane?" that attempts to build a mountain, not out of a molehill, but from a couple of grains of sand.

I have DECADES of avionics systems laboratory and flight test experience, including conceiving, developing, and executing System and Subsystem EMI, ALT, HALT, Functional and Failure Mode Effects Test procedures. IMHO, this issue is about lawyers, liability law and the inherent imperfection and fallibility of ANY man-made device, and the certainty of failure given enough time. From this perspective, I have multiple beefs with both the article and many of the comments (44 of them at the time I read the article).

1. All 'incidents' presented are anecdotes about occurrences in either uncontrolled or unrealistic/simulated  environments. There is NO evidence presented as to ‘root cause’ nor even enough evidence to dismiss the possibility that any might have been random events. Certainly the almost immeasurably small number of possible incidents identified ("75 separate incidents of possible electronic interference") globally over a 6 year period, is for all practical purposes statistically insignificant,

2. Events presented may or may not have had something to do with operation of the personal electronics devices, but even if they did, they still not point towards root cause. The problem could be with the electronic devices OR aircraft systems, as the possible failure modes for either, while not infinite ARE inestimable.

3. Airframe manufacturers and airlines have a vested interest in pointing at the PEDs as the ‘problem’. It prevents them from having to deal with additional design requirements, testing and the associated costs or having to improve designs in existence for operating in the modern environment and servicing the 21st century public.

4. Funny that the article suggests that ‘older’ planes may be more of a problem. The author should bum a ride in the back of GE’s engine test bed. It is one of the oldest 747s still flying, and during test missions you will find the back end filled to the max with rows and rows of equipment racks with panels off running at full tilt, ad hoc instrumentation data lines, laptops up and running, and guys on cell phones and radios talking to the data download facility, and the last I heard (from THE guy who would know) they’ve never had a problem.

5. RE: Commenter ‘spsooz’s “Most of us aren't impressed with the common sense of the traveling public, nor do we appreciate the hostile reactions we get when we are just doing our jobs.”

That’s alright 'spsooz'. While I can’t speak for ‘most of us’ on the other side, I stopped being impressed with cabin crew performance right after they stopped turning into Kiwis and started turning into crones (and I’m not talking about ‘age’ here). It’s HOW one does their job that makes the difference, and today the traveling public gets to see a broad range of what gets defined as ‘professionalism’.

"If an airplane is properly hardened, in terms of the sheathing of the electronics, there's no way interference can occur."
The best quote in the article comes from ABC's aviation expert (who unlike most in the news game actually has experience on the subject beyond observing real experts):
There are still doubters, including ABC News's own aviation expert, John Nance.

"There is a lot of anecdotal evidence out there, but it's not evidence at all," said Nance, a former Air Force and commercial pilot. "It's pilots, like myself, who thought they saw something but they couldn't pin it to anything in particular. And those stories are not rampant enough, considering 32,000 flights a day over the U.S., to be convincing."
Nance thinks there are alternate explanations for the events. "If an airplane is properly hardened, in terms of the sheathing of the electronics, there's no way interference can occur."
After this passage comes a "yes, but" follow-on from Boeing's experts that provides another but not necessarily contradictory POV. Nance's last statement is irrefutable.

First Rule of Problem Solving: Is it My Problem?
It makes perfect sense to require PEDs to be turned off during critical flight phases, but stop blaming the PEDs in advance. This tactic allows the airline and airframe manufacturers to continue to assert a defacto  loophole from being held liable and allows them to continue to not deal with a possible problem that should be their responsibility.  Any ‘incompatibility’ can be due just as easily to insufficient or unfortunate aircraft systems design, installation or maintenance as anything else. IMHO, the problem should be considered to be on the ‘airplane side’ since the purpose of the plane and airline is to serve the 21st Century travelling public vs. the other way around.

Sunday, June 05, 2011

Bob Cox Still Milking the 8 April 2000 MV-22 Crash

"I know little of military aviation, and even less of experimental flying, which is perhaps the most inspiring and yet fateful of all".
 -Ernest K. Gann, in the preface to Fate is the Hunter 



US Marine Corps photo by Sergeant Mark Fayloga


There is just so much wrong with this hit piece posing as an  'article' I want to frickin' scream!

I want to ask the bereaved widows why it is a 'stain' on the memory of their husbands that 'human factors' were a finding in the crash, when the Marine Corps doesn't consider it a 'stain':
A Marine spokesman, Capt. Brian Block, said the finding of "human factors" as the cause of the accident should not be equated with pilot error or blaming the pilots.


"Whenever a mishap like this occurs, we owe it to our Marines to take an honest, dispassionate look at all possible contributing factors to ensure it does not happen again," Block said. "The investigations into this mishap revealed that human factors contributed to, but were by no means solely responsible for, this mishap.


"These findings in no way impugn nor denigrate Maj. Gruber and Lt. Col. Brow's reputations as Marine officers, Marine aviators, and MV-22 pioneers. Maj. Gruber and Lt. Col. Brow were selected as pilots for what, at the time, was a brand new airframe precisely because of their courage, skill, and impeccable records."


Navy spokeswoman Lt. Cmdr. Tamara Lawrence said Mabus reviewed the crash investigation reports and "determined their conclusions still stand: that it was a result of a chain of events which, taken together, resulted in the loss of very talented and brave Marines."


A spokesman for Fort Worth-based Bell said "it would be inappropriate to comment on an internal Marine Corps matter."
I want to ask Bob Cox:
1. What made him think asking the aircraft manufacturer for a comment on a human factors finding in a USMC accident investigations wasn't inflammatory and inappropriate in the first place? Or did he ask knowing it was? 
2. If he recognizes the contributing role he and other jack-jawed 'journalists' played in the pressure put on the program to perform since, as he wrote in the article, the V-22 was "In development since 1981, at a cost approaching $15 billion, the Osprey was a troubled program. It had been the target of critics inside and outside the Pentagon..."?

I want to ask Lt.Col. Shaefer how much of his desire to clean a record that does not need cleaning, comes from some guilt he (wrongly, I believe) carries inside:
From his position several miles away, Schafer said he knew the two aircraft were too high as they began to descend.

For safety reasons, any pilot or co-pilot on that mission could have called a halt to the plan.


"I could have stopped that crash. I could have called a wave-off. I was the most experienced [pilot]. I had the most hours in the V-22 of the test team," Schafer said. "I've been in their position and been too high in a V-22, and that airplane isn't friendly when you're trying to descend fast."
Most of all, the article gives me (again) the urge to kick Bob Cox's macabre little voyeuristic a**.

Speed vs. Stealth: Stealth Wins

“Speed Kills”… or "Low Observability Changes the Survivability Equation: Speed No Longer Reigns Supreme".


From a comment in a recent thread at DoD Buzz:
….The one thing stealth did not do is make speed less valuable in air warfare. It is unfortunate that we've forgotten the lesson "speed is life" in the interest of making aircraft stealthy. The SR-71 combined a limited degree of signature reduction with high speed and would still be difficult if not impossible for most countries in the world -- including the Russians and Chinese -- to shoot down. Even missiles that fly faster than the SR-71 cannot sustain those speeds for a long enough time to hit that airplane regardless of whether they carry their oxidizer on board or get it from the air around them….
Nope.

"Speed is Life” is an Enduring Myth.
I will provide evidence that ‘Speed is Life’ is ‘no more’. I provide only evidence (vs. ‘overwhelming’ evidence) because I will not go anywhere near where I cannot go in public forums. (As an aside, there is also just so much ‘wrong’ with the above assessment of the SR-71’s hypothetical performance against modern systems that we’ll just note here that the statement presumes a ‘late’ acquisition and a ‘tail chase’ and falls apart on that presumption alone.)

NOTE: This is not to pick on the commenter who made the above assertions – I’ve heard similar from professionals who really should have known better. Myths die hard.

“Speed is Life” is an example of an air combat concept that has outlived its status as a ‘maxim’ and should be modified to read accurately today as: “Speed is Life… to a limited extent…maybe…sometimes”. More often than not, against an integrated air defense system in today’s battlespace, a truer statement would be: “Go Faster – Die Sooner”.

To support my assertion that in effect ‘Speed Kills’ the following are releasable excerpts from a study (disclosure: mine, written in 2000 and updated in 2009) that included observations concerning the Aeronautical Systems 1999 ‘study’ “System and Operational Implications for Choosing Best Speed for Global Missions” (aka ‘Speed Study’ or ‘ASC Study’) and the treatment of ‘speed’ vs. ‘survivability’ in other publications as well.

Excerpt 1
….. The ‘weaponization’ section of the ASC Study report reviewed the study’s exploration of the interrelationship between aircraft speed, altitude, and the ability of a very fast platform to attack using large standoff launch distances from a target. The report includes the observation that the survivability of the weapons, like the candidate platforms, would be based upon a best-value combination of factors including speed, altitude, tell-tale signatures maneuverability, and countermeasures. The definition of best value was not included in the report. The report indicates that the study further explored the ramifications of such a launch technique on the standoff weapons’ conceptual designs, noting that a higher kinetic energy delivery could reduce the fuel fraction of powered weapons and allow the weapon to have a larger warhead.

The ASC Study report reiterated that to ensure adequate survivability, all platform concepts studied would rely on the employment of standoff weapons to keep away from dense threat areas during the initial phases of an air campaign until other assets could be brought into theater for support, and presented a chart (p. 58) showing the relative glide weapon ranges when launched from aircraft flying at various speeds and altitudes. It is worth noting that while large launch distances from the target can be achieved, for the various concepts, it is seen that all launch platform concepts close the gap between the threat area and their position significantly after launch. It should be noted that it also appears from the study data that the faster the platform speed, the greater the post-launch closure to the target and threat area. A theoretical example of this dynamic is illustrated in Figure 9.
Figure 9. Hypothetical Mach 4 aircraft post-launch closure to target and associated potential threat.


Figure 9 illustrates estimates and profiles provided in the report for a Mach 4 launch of a glide weapon. This specific example presents the geometry of launching a weapon from approximately 180 nm away from a target to deliver the weapon with a .85 Mach impact speed on the target. Using the Gravity-load (G-load) factor provided by the study report for a practical operational turn, the launch aircraft would approach within approximately 87 nautical miles of the target after the launch in executing a turn away from the target. The launch aircraft closes to less than half the original launch distance after weapon separation. A thorough examination of the synergy that comes from combining standoff weapons and stealth is available (Paterson 1999), illustrating how the combination of stealth and standoff weapons delivered using conventional launch techniques becomes a significant contributor to survivability. However, it cannot be determined from the ASC report if the net impact of the post-launch closure at stand-off ranges using higher kinetic launch events was considered or factored into the ASC study’s kinetic delivery survivability assertions. If the candidate platforms were maneuvered in a manner that exploited the modicum of reduced signature reduction they were assumed to employ, then performing turns at even smaller bank angles would generate even larger turn radii, and the post-launch flight path of the aircraft would bring it even closer to the target and perceived threat, further minimizing the advantage of kinetic standoff attack….

Excerpt 2…


SPEED, OBSERVABILITY, AND SURVIVABILITY

In the conduct of this study, a need for a better understanding of the relationship between aircraft speed, observability, and survivability in a complex threat environment became apparent. In one of the earliest published discussions on low observability and survivability, it was noted that aircraft flying “at the greatest speeds possible in high threat areas minimizes time at risk” (Paterson, 1997, p. 10). A similar point was made in the 2006 Committee’s report ‘Future Air Force Needs for Survivability’:
Clearly, when trying to shrink an adversary’s reaction time, increasing the weapon system’s speed for the same signature can reduce its exposure time in the adversary’s weapons engagement zone. From the Radar Range Equation one can derive the approximate ratio that increasing the speed by a factor of 10 is equivalent to decreasing the frontal radar cross section (RCS) by a factor of 40,000 to provide the same exposure time. (NRC, 2006, p. 24)
While the relationship of speed and observability is elaborated upon and clarified within the 2006 Committee’s report, the 2006 Committee statement as it stands is incorrect and misleading. The quote is only accurate if the quality of the exposure time is equivalent. As noted by Grant (2001), the F-117s in Operation Allied Force had difficulty in maneuvering within the confined airspace over Serbia and Kosovo to attack targets and managing their signature profiles. When discussing transiting high threat environments at the greatest speeds possible, this must include provisions for management of the penetrating aircraft’s signature in doing so. The faster the aircraft is moving through the threat environment, the more difficult it is to manage its signature. The probability of the faster systems being able to equally manage their flight profiles and in turn equally managing their signatures as well as slower systems in a high threat environment can be shown to be comparatively low. This is easily demonstrated using a variation of Figure 9’s Mach 4 scenario that was presented earlier. In Figure 19 below, time has been substituted for distances, and the target is now a threat.

Figure 19. High speed aircraft have less time to avoid sudden appearance of new RF threats than slower aircraft.

The implication here is that in negotiating a dense threat environment a high speed transit can reduce the time within a threat engagement zone, but increases the probability of entering an engagement zone in the first place. The reduced reaction time and increased turn radius of the high speed aircraft has negative ramifications in planning and negotiating a mission route through a dense threat environment. Thus any discussion of speed as a benefit to survivability must include the quality of the relative low observability and difficulties in executing a transit of a dense threat area at higher speeds.
Post Script (a gentle reminder): The very definition of ‘Stealth’ is Very Low Observables (VLO) AND Tactics. “VLO” is highly ‘reduced’ radar (RCS), IR (Radiant Intensity), visual (Contrast, Area), acoustic (Sound Pressure) and EME (Electromagnetic Emissions) signatures. VLO designs are tailored to balance those signatures based upon mission and threats. ‘Tactics’ are maneuvering, mission planning/routing, selected sensor operational techniques, and weapons application techniques. Tactics are applied to maximize the advantages of the tailored VLO design. If anyone makes any claims about ‘Stealth’ outside of, or ignoring its definition in toto, they haven’t got a clue.

External refs used in the above excerpts:

Grant, R. (2001). The B-2 goes to war. Arlington, VA: IRIS Independent Research Institute.

Committee on Future Air Force Needs for Survivability, National Research Council. (2006). Future Air Force needs for survivability. Washington, DC: National Academies Press.

Paterson, J. (1997).Measuring low observable technology's effects on combat aircraft survivability. SAE.

Paterson, J. (1999). Survivability benefits from the use of standoff weapons by stealth aircraft, AIAA.

Friday, June 03, 2011

F-35 Family Photos at Edwards AFB

Q: What happens when you're ahead of schedule during flight test and there's a long holiday weekend?
A:  See this set of pics sent by a friend from Eddy (Edwards AFB) this week.



I'd like to see a group picture or two of the Pax River branch of the family tree to go with these. 

Why India Passed on the F-18E/F Super Hornet and F-16IN Super Viper

I guess they weren't 'super' enough? Oh Well.

H/T Steve Trimble  at The Dew Line Blog

Update: If you want to view another, more 'typical' POV that (surprise!) uses the first 4-5 paragraphs to inject the F-35 (negatively) into the story you could also go here.   

Excellent analysis of India's decision (PDF) concerning its latest fighter acquisition program, AND the down-select to the Eurofighter and Rafale from an unlikely source. The elimination of the F-16IN and F-18E/F seems have boiled down to a few critical points:
1. India's requirements were dominated by ease of 'handling' (consequence of their Mig-23 experience?) with greatest maneuverability. Their Air Force is dominated by Fighter Meat Servos and they really wanted a 'yank and bank' plane.The F-16IN with the conformal tanks was at the bottom of the list in 'turning' and the F-18E/F is a 7.5 G airplane.

2. India's near-mechanical adherence to the selection criteria with little room for interpretation or recognizing and allowing for statistically 'bad data'.

3. The F-16 an F-18 were too 'long-in-the-tooth' to meet India's needs for an effective operational life of 30 years on the one hand, and some technology (F-18 engines) were too immature on the other. The F-35 and F-22 weren't on the table.

4. India was seeking greater growth potential in their new platforms AND wanted the technology transfer to  come with that growth. Neither 'winner' of this round has an AESA radar, and India is betting on the 'come' that one will be available when production begins.
Lots more info/details on the competition and logic applied therein at the link. Read it all.

I'm torn between the last two 'Eurocanards', but in the case of India, I know they really want 'numbers' as well as technology, so the edge in my mind goes to the MUCH cheaper Rafale. There's some possibility that the Indian Air Force and Navy could also get some synergy going with the Rafale, since it is already carrier qualified...

F-35 and F-18E/F: Wheels Within Wheels

Since the KC-45 clusterfark I've learned to always suspect Boeing of ulterior motives and deployment of Marketeer Maneuvering Par Excellence whenever they produce an announcement out of the blue - especially if they're claiming some 'slight'. That is why when this popped up the other day, I began waiting for the other shoe to drop.
It could be coincidence -- and if it were anyone but the 'Borg' I would insist it HAD to be just a coincidence -- but how odd is it that Boeing would pick a public bone with LockMart over F-35 vs F-18 cost claims, just days before another news item is released mentioning that up to 500 'Super Hornets' may eventually be replaced by F-35s as a possible option of future Naval Aviation recapitalization? Boeing plays the 'long' game. Do they play it this 'long'?

Just asking.

Monday, May 30, 2011

Fathers: In Memoriam

The Chief and I went to put flowers on my Father's headstone yesterday, and all the (known) veterans in the cemetery had small flags already in place. While the 'Veteran's Section' was a sea of flags as one would expect, I was surprised at the numbers/percentages of flags placed throughout the cemetery.

In Memoriam, here's a couple of photos of our late Fathers.

First my Father-In-Law, 'Rusty' in DaNang Circa 1969, with the 366th 'Gunfighters' Fighter Wing, 4th Fighter Sq. 'Fujiins'. Another photo of him flying in a formation of F-89s was posted earlier.


Next a couple of photos of my Father. The first one is a group photo of the XH-40 flight test 'crew' during evaluations of what would become the ubiquitous 'Huey' in front of one of three XH-40s. Dad is third from left.
  

The second photo is of an H-37 with my Dad in the group of four in front of it, Dad is second from left, and the caption on the backs reads 'My first forced landing'. It looks like they did a little hedge trimming on an auto rotation. It was his first, but it would not be his last.

Wednesday, May 25, 2011

Space Coast Guard?

How Quaint. How Naive. How 'Commercial'. How.....'Civilian'.
(H/T Instapundit)
A 'space entrepenuer' and 'Anglophile' James C. Bennett, (with whom I doubt I would find too many disagreements with based upon his writings) steps WAY out of his area of expertise in a new piece at New Atlantis titled "Proposing a ‘Coast Guard’ for Space" where he 'surprise!' promotes his rationale for a Space 'Coast Guard' of sorts. I note that his central reference, what he (not me) describes as: " a thoughtful article published in the Aerospace Power Journal in 2000" in which a "USAF Lt. Col. Cynthia A. S. McKinley proposed the creation of a Space Guard on the Coast Guard model", commits many of the sins of  predecessors in that the superficial 'roles and missions' point of view is used.

Needless to say I prefer another paradigm as a more rational approach to any perceived 'space force' needs.

I would welcome any civil discussion on the strengths and weaknesses of the options as presented.

How Professionals Discuss "Airpower"

The future is coming fast. Embrace it...or develop better coping skills. 

Second Line of Defense (SLD) interviewed recently-retired Air Combat Command (ACC) Commander General John D.W. Corley on the future of Airpower. Although the .pdf file at the link mispells Airpower as two words (I kid -- I kid!), and also contains a small number of transcription errors, the discussion approaches the topics of Airpower, platform/system acquisition, and Airpower purpose, priorities and strategies quite well within a short document. General Corley, as ACC Commander was responsible to train and equip the nation's Air Force. Earlier, he was also the Combined Air Operations Center Commander ('Air Boss') in Operation Enduring Freedom. While I wouldn't agree with everything the General says without some qualification or clarification, I listen to guys who are 'Theorists' as well as 'Practitioners' more than the rest. General Corley qualifies (even though he was a fighter 'meat-servo').       

An extract:
SLD: We clearly are working in a relatively constrained fiscal environment, how do we maximize the air superiority effort in these circumstances?

Corley: The approach is to leverage extant legacy assets through building upon the foundation provided by F-22s and F-35s. For example, if I’ve got a fleet of F-15s, how can I leverage those F15s in a potential future environment at the challenging end of the scale with the range of military operations? F-15s today, or F-18s, or F-16s, do not possess the needed survivability inside an anti-access environment. One can say what you will, argue what you won’t, they will not be survivable.
    And from con-ops point of view, they're being pushed further and further out due to terminal defences or country wide or regional defences that exist. And this diminishes their utility, but they can still be effectively utilised.
    For example, you may take an existing platform, like an F-15 from the Air Force and begin to apply a pod to provide for infra-red search tracking, so that it could basically begin to detect assets and then feed that information back to other assets. Or, by providing for connectivity with some advanced tactical data link, that platform, in turn, could be directed to launch weapons from it.
    Even if we have the capabilities of platforms like F-35, F-22, B-2, or a follow on long range strike platform, they ultimately will be limited; limited by what? Limited by things such as, what is their capacity to carry weapons?
    If I’m going to be able to apply persistent pressure, then I have to have some capacity to employ others’ weapons. If I eventually run my F-35s out of SDBs, or out of JDAM’s, is there a way for them to still contribute to the fight because they're inside of that anti-access bubble, still using their sensors, still communicating? Can I contribute to weapons employment from other platforms, outside the anti access bubble to enable the concept of operations and apply persistent pressure?
Read it all. Contrast the expert view with some of those frothy rants on the red-meat threads at defense 'fanboy' sites.

Monday, May 23, 2011

End of the A-12 saga?

Let us hope.

The Supreme Court today reversed a lower court ruling that reversed an even lower court ruling, and I learned a new word: “nonjusticiable”.

Defense News has a copy of the ruling.
It ends as pretty much a “Draw”. Parties were left with an option to file for other cause, but who would be that stupid?
I was fairly sympathetic to the 'Contractors' (was GD and McDonnell Douglas - Is GD and Boeing) because I felt they had a good case that the Government did withhold 'superior knowledge' but  essentially the Supreme Court observed, that even though there was 'Prima Facie' evidence the contractors were correct, national security concerns trumped the civil case.

Here's a Google Earth shot of what I believe is the only A-12 mockup in existence.
  It is in the upper left with the outer wing panels removed. It looks like 'home plate'. They put a cover on it sometime in the last three years or so, and as you work past the old F-16s down to the lower right corner, you see Lockheed's JAST engine test article.