Showing posts with label Safford L. Show all posts
Showing posts with label Safford L. Show all posts

Friday, April 3, 2009

WALKING RIGHT ACROSS THE BROKEN CODE STORY

Adam Larson / Caustic Logic
The 12/7-9/11 Treadmill and Beyond
April 3 2009


KEEPER OF SECRETS
JN-25 is the name given by US cryptanalysts to the Imperial Japanese Navy’s main operational code in 1941. More precisely, it was JN-25B, the second incarnation introduced in Dec 1940 (it was called “AN’ code at the time, and has also been referred to as “5-numeral” code, or variants thereof). A sophisticated code-and-cipher system, JN-25 was based on 5-number groups directly representing words, enciphered with random additives to scramble the number groups. It effectively concealed hundreds of thousands of intercepted IJN messages with among the most vital clues available to Japanese intentions. They believed it unbreakable, but it was finally cracked in spring 1942, helping turn the tide of the Pacific War from the Battle of Midway onward

JN-25-encoded messages include the November 1941 transmission of plans for the Pearl Harbor attack – actually a three-week-long string of communications outlining all the details multiple times in different ways. Whether these messages ever were transmitted by radio is itself an unanswered question, to my knowledge. Most sources, reputable and otherwise, seem to presume it was, but with surprisingly little reason given (I’ll try to settle this at another time). If it were sent on radio waves it would be open to interception, which would put it at the mercy of the cryptographers and code-breakers and offered every clue one would need to fully prepare for the battle of Pearl Harbor

How well the secrets would hold up at that level is a matter of some controversy – the body of evidence supports the general accepted stance that the code was at least partly recoverable, and some 10-15% of this was readable as of November 1941 (different aspects of it changed frequently, including at the end and beginning of that month). Some revisionists have suspected the code may have been completely broken by US analysts prior to December 7, and a few have gone so far as to claim to have proven this – that the intent of the Japanese force was openly available to the top levels of power but withheld from those who were to be sacrificed. I've seen two different clue tracks said to lead to this stance, offered by two different theorists. Both are absolutely worthless (the evidence tracks). [ETA: There are other allegations of pre-12/7 JN-25 penetration by either the British or the Dutch, but these, and their proponents, will be covered later]

STINNETT’S CASE: THE LIETWILER LETTER
The prime champion of JN-25 revisionism is the eminent Robert B. Stinnett, who explains his case in the afterword to the second edition of Day of Deceit, too late a discovery to make it to the first cut in 1999. The main text covering this is a remarkably slim two-and-a-half pages with scant detail, considering the truly massive implications if it were true. In May 2000 he claims to have received over 4,000 never-before-seen documents that revealed to him the “unambiguous truth” that “by mid-November 1941, as Japanese naval forces headed for Hawaii, America’s radio cryptographers had solved the principal Japanese naval codes” [1] Station CAST on Corregidor in the Philippines were the geniuses he credits with the feat. They pierced the "5-num code" as he calls it, by no later than November 16, when CAST’s commanding officer, Lieutenant John M. Lietwiler, wrote to a colleague in Washington:
“we are reading enough current traffic (messages) to keep two translators very busy.” [2]

After spending so much time in the quote mine, that's not much of a nugget to haul back. But thanks to Lietwiler’s historic “admission,” Stinnett can say with no hyperbole “the major secrets of Pearl Harbor are at last out in the open.”

The next few pages highlight some of the new finds, and elaborates on the letter that “notifies naval headquarters” about CAST’s hinted-at breakthrough. “Lietwiler bragged that his crypto yeoman, Albert E. Myers, Jr., had initiated a new technique that allowed the cryppies to “walk right across” the Japanese messages.” A further explanatory note attached to this explains Myers and another guy named Hess were transferred to CAST in September 1941 and brought a new machine, the Jeep IV “for recovering the 5 NUM code.” This wondrous device “enabled the cryppies to recover current (July to December 4, 1941) additives and subtractors for the 5-Num code.” [3]

David Kahn, author of The Codebreakers panned Stinnett's interpretation; he decided the letter "expresses discontent," not joy, over the Jeep IV, and "whatever Lietwiler is discussing, it is clearly not the Imperial Japanese Navy's main, currently used naval cryptosystem, JN 25 B." [4] He offers a fuller excerpt of the letter (parts not shown by Stinnett bolded):
"We are reading enough current traffic to keep two translators very busy, with their code recovery efforts, etc. included. In this connection, I certainly wish you could see your way clear to drop the ancient history of this cipher and work with us on each current system as it comes up."

Another researcher named Timothy Wilford assembled a detailed article on JN-25, and seems to agree with Stinnett's take. However, he offers an even fuller look at the letter, allowing me to see more context for this strangely vague discovery without doing a ton of original research. [5] (This time Stinnett quotes bolded, [...] edits by me):
"We have stopped work on the period 1 February to 31 July as we have all we can do to keep up with the current period. We are reading enough current traffic to keep two translators very busy, i.e., with their code recovery efforts, etc. included. In this connection, I certainly wish you could see your way clear to drop the ancient history side of this cipher and work with us on each current system as it comes up. With Singapore, we have adopted a system of exchanging block numbers to prevent duplication. We have more or less given them a free hand in selecting the cipher blocks they tackle on account of their more limited traffic.
[...]
Using the 400 high frequency groups we have compiled a table of 24,000
differences. When we are stuck on a column now we take any likely looking group and subtract it from every other group in the column from the master group. […] reference to the table […] reciprocals […] Two days ago I saw MYERS walk right across the first 20 columns of a sheet using this method almost exclusively. In view of this I do not believe we want a new Jeep IV."

“We are reading […] current traffic” is the operative phrase – it does seem to mean understanding the underlying code, but also could mean ‘trying to read,’ or ‘reading for, ‘reading at,’ the difference between looking and seeing just vague enough I’d need more verification than Stinnett provides (which is zero, for the record). It looks like Myers was "walking right across" columns of additives in a manual process, since the Jeep IV was a pain in the arse, rather than across the actual code. All in all, the request seems to be to get help with "work" on "cipher blocks" for the "current system," not the kind of thing you'd ask for if it was already solved.

WILLEY'S CASE: THE SAFFORD MEMO
The second clue track I'd like to look at is one cited by right-wing revisionist Mark Willey, presumably in his book Pearl Harbor: Mother of all Conspiracies, as found on one of his websites. His tip-off reads "the first paragraph of the Congressional Report Exhibit 151 says the US was "currently" (instantly) reading JN-25B and exchanging the "translations" with the British prior to Pearl Harbor." [6] I was able to locate this exhibit in its entirety online. [7] It's a years-later memorandum (May 1945) from Lt. Laurence Safford, a founding member of the US cryptologic community, aka the "Winds execute" guy. Safford lists as references "Com 14-260110 (Nov. 1941), Com 16-261331 (Nov. 1941)," whatever these mean, he seems to be referring to November 1941, and Station HYPO (Pearl Harbor, 14th Naval District or COM 14), and station CAST (Corregidor, Philippines, 16th naval district). The letter reads, in part:
"Com 16's estimates were more reliable than Com 14's, not only because of better radio interception, but because Com 16 was currently reading messages in the Japanese Fleet Cryptographic System ("5-number code" or "JN25") and was exchanging technical information and translations with the British C. I. Unit at Singapore. […] some large scale movement involving most if not all of the Japanese Navy was about to take place. […] this estimate * was based entirely on "radio intelligence," the Com 14 C. I. Unit being unable to read anything except the Weather Ciphers and other minor systems of the Japanese Navy at that particular time. This fact was known in the Navy Department, and the Director of Naval Communications and the Director of Naval Intelligence were so informed by me."
* This being "strong force may be preparing to operate in Southeastern Asia while component parts may operate from Palao and Marshalls."

Again we see the ambiguous word "reading." Further passages give context to how that word is meant here; if he meant it was readable as Japanese text, he probably wouldn't say this:
"[T]he current code (JN25B) had been in effect since 1 December 1940, remained in effect until 27-31 May, 1942, and was partially readable in November 1941. A new system of keys was introduced on 4 December 1941 and reported by Com 16_041502, but the carry over of the old code made their solution quite simple, and we were reading messages again by Christmas, Corregidor getting the "initial break" on 8 December 1941."

Reading again, partially as before... nothing new here. The question is just how much, and there has been nothing aside from conjecture to support any more than 10% or so. The next question from there is "which 10%?" Mysteries upon mysteries...

Sources;
[1] Stinnett, Robert. Day of Deceit: The Truth About FDR and Pearl Harbor. First Touchstone edition, 2001. p. 261
[2] Ibid. p. 262.
[3] Ibid. p. 269.
[4] Kahn, David. Remember Pearl Harbor: Response to Robert Stinnett. The New York Review of Books. February 8 2001. http://www.nybooks.com/articles/14086
[5] Wilford, Timothy. Decoding Pearl Harbor: USN Cryptanalysis and the Challenge of JN-25B in 1941. The Northern Mariner/Le marin du nord, XII, No. 1 (January 2002), p. 17 - 37. PDF download link.
[6] Willey, Mark. Pearl Harbor: Mother of All Conspiracies. http://www.geocities.com/Pentagon/6315/pearl.html
[7] Joint Congressional Committe on Investigation of he Pearl harbor Attacks. Exhibit no. 151. Memoranda prepared by Captain Safford. Originally for the Hewitt inquiry. http://www.ibiblio.org/pha/pha/misc/x18-151.htm

Thursday, March 12, 2009

BLAH BLAH WIND, BLAH BLAH BLAH

THE WINDS SET-UP, PART 1
Adam Larson / Caustic Logic
The 12/7-9/11 Treadmill and Beyond
March 15 2009
last edit/update 3/28


THE CODE SET-UP
Perhaps due to its poetic nature and readability enhancement it offers, the “winds code” system has figured widely into most accounts of the Pearl Harbor attack. And it cerianly became a part of the story that can’t be ignored, but not for the clues or hints of Haiku contained within. For purpose of American detectives at the time, the code proved good only for making a lot noise without any substance, indeed, like the wind.
"North wind cloudy" ("Kitano kaze kumori") = War with the USSR
"West wind clear" ("Nishi no kaze hare") = War with Great Britain
"East wind rain" ("Higashi no kaze ame") = War with the United States

These were the code phrases conveyed in the “set-up message,” sent encoded and encrypted (in the J-19 system) by Japan’s Foreign Ministry to its diplomatic posts around the world. It was intercepted by US intelligence on November 13, decrypted and read on the 28th, just before Tokyo’s stated deadline for a miracle of diplomacy (or else “things will happen automatically.”) The catchy clue was passed on to all relevant parties, including at Pearl Harbor - where it was among the few clues received, and that almost immediately.

This system was basically a back-up reminder to diplomatic staffs, in case regular communication lines should be cut, to take action consistent with the onset of warfare. These included destruction of codes and code machines and any secret files in the case of hostilities (real or imminent) with any combination of the three allied nations. Any expected delivery of the code words came to be known as a “winds execute” message to be embedded in routine weather reports. A prescribed pattern of repetition would be the tip-off the words truly mean war should be presumed.

Japan’s top spy in Hawaii, Takeo Yoshikawa claims he dismissed the Sunday morning attack as a US bombing exercise until he heard “east wind rain” repeated twice over his radio. At this cue, Time reported, “Yoshikawa immediately began burning his code books and other intelligence materials.” The evidence appears solid that those words were not transmitted before or during the attack, or ever.

ORIGINAL CLAIMS AND DISMISSALS
Yoshikawa’s memory is in a class of its own with no supporting accounts I know of, and no other evidence pointing to a Winds Execute transmission during the Pearl Harbor attack. Another oddball tack from the US intelligence arena had it that the message was transmitted days before then, when it might qualify as a viable warning. This has been the fuel for a second-tier construct often repeated in the foreknowledge discussion for decades.

The controversy we’ve inherited stems mostly from one source; the prime actor in this, at the time of the investigations in 1945-46, was Lt. Lawrence Safford; no lowly analyst, he in fact essentially founded the Navy’s cryptanalytic agency, OP-20-G, in 1936. To the Joint Congressional Committee, at least, Lt. Safford insisted he held and passed along a transcript of that message, with both east and west indicators in the patterns indicating war with both the US and Great Britain.

Lt. Safford couldn’t recall the exact date, but had it pinned at most likely December 4, and no copies or receipts could be found when he began looking in 1943. By early 1944 he was writing coded letters in search of verification, and citing a list of “about fifteen” existing witnesses. When investigators later received a copy of and followed-up on the list , the alleged witnesses claimed they never did see such a message. Beyond the immediate arena, the notions involved have, over the years, spurred charges of coercion and changed stories, cover-up of vital intelligence, disappeared documents, and general suspiciously senseless squabbling.

The Committee had to deal with at least some of that drama, and after much investigation gently dismissed Safford’s story. While remaining more open minded, the Committee’s dissenting minority report noted “The evidence before this Committee bearing on the interception of the activating message from Tokyo […] covers hundreds of pages. Admittedly the evidence is confusing and conflicting.” I’ll take this as advice then in glossing over the massive depths of this controversy.

The majority report was not so circumspect, and offered a fairly elegant explanation of this code’s irrelevance to the debate in three parts [emph mine]:
“[The winds code] was designed for use in the event ordinary commercial channels of communication were no longer available to Japan, a contemplation which did not materialize prior to Pearl Harbor.”

“Extensive evidence […] indicates that no genuine execute message was intercepted by or received in the War and Navy Departments prior to the attack on Pearl Harbor. Investigation conducted in Japan strongly indicates no execute message was dispatched before the attack and the British and Dutch, who were also monitoring for an execute message, have advised that no such message was intercepted.”

“Granting for purposes of discussion that a genuine execute message applying to the winds code was intercepted before December 7, we believe that such fact would have added nothing to what was already known concerning the critical character of our relations with the Empire of Japan.

It’s a summary brush-off, but expanded on in appendices, and offered in 1946. I see no reason to challenge these findings, although neither can I vouch for them. The third point – that this intelligence added nothing - is most important to my own tendency to move on. The clues offered if so were too vague to have been of any assistance to Pearl Harbor, offering nothing of precise time, location, or method of any attack. There may well be evidence of a cover-up over this, and there may have in fact been one. This would not, however, mean there was anything to actually cover-up other than an empty spot. If there’s any interest to me in this clue, it would be more on the level of disinformation, but that’s a side-track at the moment.

MICROCOSM MAINTAINED
That such a noisy situation did cause so much fuss in the years after the attack certainly does not mean there was any design to that end. The controversy, just by existing, would attract attention – and others have done their part to amplify the supposed relevance of this possible clue.

The New York Times described the winds code controversy, when it emerged, as a “bitter microcosm” of the investigations. “If there was such a message,” the influential paper opined, “the Washington military establishment would have been gravely at fault in not having passed it along.” And even covered it up, elaborately. Conversely, if the execute was truly never sent (or at least never received) supporters of Kimmel and Short “would have lost an important prop to their case.”

One might accuse the Times of setting up a false dichotomy to Kimmel's detriment, but the good Admiral himself claimed the thing in his defense, and to its chagrin. Apparently believing there had been a Dec 4 intercept as claimed by Safford, Kimmel told the Congressional Pearl Harbor Committee that if he had learned of this clue he “would have gone to sea with the fleet...and been in a good position to intercept the Japanese attack.” This appears to be little more than a self-serving boast, but perhaps understandable given the charges against him. A statement like this also couldn’t help but add to the shell of intrigue that allowed the winds execute controversy to continue on alongside more substantial clues.

1980s RESURGENCE; BRIGGS, COSTELLO, TOLAND, LAYTON
After a long simmer, the old contentions about Pearl Harbor re-surfaced in the late 1970s and especially early 80s, spurred largely by a round of declassification of evidentiary documents, and a slew of memoirs by aging participants nearing their own passing. At the outset of this period, another self-described witness to the winds execute message presaging US-Japanese hostilities stepped into the scene.

Ralph Briggs, a civilian intercept operator of OP-20-G had submitted to a recorded 1977 Naval history interview in which he claims he saw and copied the winds execute. When this interview was declassified in 1980, it made it into revisionist circles in little time; John Costello cited the twin cases of Safford and Briggs in the appendix to The Pacific War (1981), apparently corroborating the claim, and supporting cover-up. He reportedly backed off the charge once it was publicized and Brigg's version was shown to be inconsistent with Safford’s (or so I hear, again, I’m not going into the details here). But by then it was echoing further out.

East Wind, Rain… 
It was the Japanese code that meant war… 

Thus reads the back cover of John Toland's 1982 Infamy, which also called on Safford and Briggs and expanded the theme more explicitly as a primary part of his foreknowledge construct. The foreword lists the “crucial questions” about the attack, mentioning only one specific clue by name: “Had there truly been a “”winds” execute message in early December 1941? Had the nine investigations, in short, been an elaborate cover-up to place the blame primarily on Admiral Kimmel and General Short while whitewashing those in Washington?” Apparently no, and maybe, but this is not a good clue. I just got the book and already I know I'll have a hard time trusting it.

Pacific Fleet intelligence director as of Pearl Harbor, Rear Admiral Edwin T Layton, writing with the help of Costello in 1984, presents an interesting take. Layton was only certain that “no warning that a winds [execute] alert had been received was ever sent to us at Pearl Harbor.” He sides with Safford quite a bit throughout the book, points out that the issue "has been fiercely debated ever since,” spends six pages detailing the ins and outs of it, and leadingly refers to “the official effort to deny their ever was a winds intercept”

DISMISSALS, ROUND 2
From this 40th anniversary-era watershed, the old issue took on its most recent resurgence in the foreknowledge discussion, although it doesn’t seem to have stuck widely or for long. Robert Stinnett, in his 1999 Day of Deceit, perhaps the most widely-read recent revisionist tome, dismissed the issue out-of-hand. He seemed to hint at “the now discredited “Winds Code” as being disinformation to distract from his (unsupported AFAIK) allegation that ill-defined “naval codes” had been cracked, that may have (depending) revealed precise details of the attack:
“News of the “Winds Code” system created a media sensation during the congressional hearings. Reporters focused on the “Winds Code” and lost interest in the less fantastic naval intercepts. Eventually the controversy was dismissed when congress learned that the implementing weather message was never transmitted by Japan. By then the 5-Num dispatches had been forgotten.”

Somewhat echoing Stinnett, George Victor gets mentioned, since I bought his book The Pearl Harbor Myth (2007), hoax acceptance and all. He noted in a section on “secrecy and cover up” that “for sixty years, the [winds code] controversy distracted attention from warnings that specified Pearl Harbor as Japan’s target.” Yet he spends pages outlining in detail the stormy history of changed testimonies, apparent coercion and cover-up over the alleged receipt of the distraction without clarifying what he thinks we’re looking at.

With essentially the opposite viewpoint from Stinnett and Victor, Henry Clausen agrees in dismissing the weather controversy. A controversial but little-known special investigator for War Secretary Stimson in 1945 (who did get a detailed and semi-coherent criticism from Victor), he wrote in-depth of some of his findings in the 1990s. This was published as Pearl Harbor: Final Judgement [sic], (1992, written with Bruce Lee, app. first published in 2000?). His simple take on the issue at hand was that “the winds Code took on much greater proportions than I thought it should have.” It’s when he muses a bit on the big picture that we get an interesting insight that I will return to in another post:
“If someone wanted to create a role for the goddess of discord, and throw a golden apple over a fence to cause people to fight and waste time, the Winds Code was that golden apple. It was a red herring for men such as Safford, and Noyes, and Bratton and Sadtler to follow and let dominate their thinking.”

Finally, a recent in-depth study published by the National Security Agency’s Center for Cryptologic History seems to have put the last nail in the controversy’s coffin. And administered last rites, poured its concrete sarcophagus, and written the eulogy. In West Wind Clear [2008] Authors Robert J. Hanyok and the late David Mowry assembled what looks to be a surprisingly comprehensive document [the PDF weighs in at over 350 pages], fascinating, very detailed and loaded with original material, including dozens of raw intercepts reproduced as appendices. [PDF download link]

The interesting conclusion, from which the report draws its title, is that a winds execute message was in fact transmitted, recorded, and acted on – and it said West Wind Clear, or war with Great Britain, and it was transmitted a few hours after the attack on Oahu. I don’t have the time to read the whole thing, but I have cited a few facts from it for this piece, and it promises to leaves no doubt that Safford and Briggs are incorrect, and there was no value lost to the defenders of Pearl Harbor:
"Within the tempest of controversy about the nature and amount of available intelligence, especially communications intelligence, and its dissemination prior to the attack on Pearl Harbor, the Winds message imbroglio should have been no more than the smallest eddy."

THE WINDS SET-UP, PART 2
Having discussed this distraction from the 1940s to the present, the next installment will explain the more relevant role winds confusion played in December 1941.