Most amazing disk data recovery ever

Columbia's fragments were painstakingly and exhaustively collected. Amongst them was a 400MB Seagate hard drive which was in the sort of shape you think it would be in after being in an explosive fire and then hurled to earth from several miles up with a ferocious impact.

The Johnson Space Centre workers analysing the shuttle crash sent it off the CVX-2 (Critical Viscosity of Xenon) experiment engineers, who sent it on to Kroll Ontrack in Minneapolis, Minnesota, to see if the data, any data, could be recovered. For researcher Robert Berg and his team it was the only hope, a terribly slim hope, of salvaging significant data from the experiment looking at Xenon gas flows in microgravity.

The Kroll people managed to recover 90 percent or so of the 400MB of data from the drive with its cracked and burned casing.

Dear Lazyweb,

I suspect the answer to this is also "Apple horked it in a recent security update", but I still desire to know how to fix it. Lately, when I'm doing rsync+ssh backups of various machines, ssh craps out partway through. Ssh is running on MacOS 10.4 PPC (OpenSSH 4.7p1) with the latest updates, and is aimed at at various Linuxen that haven't been upgraded since, say, 2005 (OpenSSH 4.3). It dies like so:

rsync [...]
building file list ... done
...dozens of files get transferred successfully...
Disconnecting: Bad packet length 787964.

It's dying after transferring a bunch of data, not during connection setup. Both side are most assuredly speaking SSH2.

Googling this error message only results in very old threads where people say, "Oh, that's because you're using SSH2! You should use SSH1 instead." This answer is clearly bullshit. What's the real fix?

Dear Lazyweb, lately (this month-ish) I'm seeing that "A script in this movie is causing Adobe Flash Player 9 to run slowly" dialog all the time. Safari will go all hypnowheel for 5-10 seconds, and then that dialog appears, giving me the options of "break the web page" or "go back to the hypnowheel for another ten seconds, then everything's fine." Who broke what? No scratch that, just tell me how to fix it.

Adium's ability to search IM logs is comically bad. It's so bad, I usually resort to grep. Which is almost enough to drive me back to iChat. But I like having OTR (crypto) built in, and iChat's multi-protocol UI is stupid (I want one list of contacts, not one list per server).

Since the PearLyrics guy gave up, every now and then I look for a new iTunes plugin that downloads and displays lyrics. There are surprisingly few. But I recently came across GimmeSomeTune, which, despite the terrible name, seems reasonable. But I think it gets lyrics only from lyricwiki.org, which means it doesn't have a very big set to choose from. Still, the UI is mostly reasonable, and it has a menubar iTunes controller built in too (I had been using ByteController for that.)

Happy Run Some Old Web Browsers Day!

In honor of the ten year anniversary of the Mozilla project, home.mcom.com, the Internet Web Site of the Mosaic Communications Corporation, is now back online.

It took some doing. There is comedy.

First, the fun stuff:

• Until now, home.mcom.com and all URLs under it just redirected to netscape.com, then redirected a dozen more times before taking you to some AOL portal page. The old URLs that were baked into the toolbar buttons of the original web browsers didn't work any more. But now, if you fire up a copy of Mosaic Netscape 0.9, and click on the various toolbar buttons, they will work again! For example, in the old browsers, when you clicked on the "What's New" toolbar button, it went here.

• home.mcom.com is now a snapshot of that web site from 21-Oct-1994.

• mosaic.mcom.com is now a snapshot of that web site from July 1994. That's from just after the company was announced, but before the first browser beta was released. I think that by Oct 1994, both mosaic.mcom.com and www.mcom.com were redirects to home.mcom.com, but I can't remember any more.

• In order to make these web sites work in the old browsers, it was necessary to host them specially. In this modern world, a single server will typically host multiple web sites from a single IP address. This works because modern web browsers send a "Host" header saying which site they're actually looking for. Old web browsers didn't do that: if you wanted to host a dozen sites on a single server, that server had to have a dozen IP addresses, one for each site. So these sites have dedicated addresses!

  The web server also had to be configured to not send a "charset" parameter on the "Content-Type" header, because the old browsers didn't know what to make of that.

• Trivia Question #1: Do you remember why home1.mcom.com through home32.mcom.com exist?

• Trivia Question #2: Do you remember the behavioral difference the browsers exhibited when they were talking to a Netscape web server?

• Trivia Question #3: When was the <HYPE> tag implemented, and what was its origin?

• I had originally planned on re-hosting these web sites on an SGI Indy running Mosaic Netsite Commerce Server, just for maximal comedic value... and to see how long it took before someone Øwned it, since there must be someone out there who still remembers how to launch an assault on Irix 5.3. Unfortunately, that wasn't possible for political reasons explained below.

Trivia Answers:

1. home1.mcom.com through home32.mcom.com exist because the early browsers did client-side load-balancing: the browser itself had a special case where if it was loading "home.mcom.com" it would actually pick a random number from 1 to 32 and instead load "homeN.mcom.com"! Those were physically different servers in the Netscape data center.

2. When loading pages from a Netscape server, the caption next to the URL field in the browser would change from "Location" to "Netsite".

3. Not telling.

Enough about all that, I want to run some old browsers!

• My personal collection of old Netscape browsers is here: www.mcom.com/archives/. It's not complete, but it's all that I could find. (It is missing some key releases, such as Netscape 0.4 for Irix, which was the first release to ever leave the building; and the "non-exportable"-crypto versions of almost all of them.)

  If you can publicly mirror these, please do! I know of a few mirrors so far: edlang.org, nothings.org, fauxpaw.com, and moar.jp. Torrents, anyone?

• Linux users: You can run Mosaic Netscape binaries as old as 0.93 on modern Linux systems! You need to load the "a.out" module in the kernel, and install some really old libraries:
  • /etc/modules.conf: alias binfmt-0064 binfmt_aout
  • ld.so-1.9.5-13.i386.rpm (a.out loader)
  • aout-libs-1.4-9.i386.rpm (a.out libc 4)
  • libc-5.3.12-31.i386.rpm (elf libc 5, for NS3)
  • Reconstruct /usr/X386/lib/X11/nls/ (ancient X11 idiocy, don't ask)
  • For Java in Netscape 2 and newer:
    mv moz2_01.zip moz2_02.zip java_30 java_301 /usr/local/lib/netscape/

  Since pulling all those files out is kind of a pain, I've put together a tarball: netscape-linux-libs.tar.gz. Unpack it in your root directory. It shouldn't conflict with anything modern. I've tested that on Red Hat 9 and Ubuntu 7.10.

• Mac users: If you're using a modern Mac, you need to use an emulator.
  • Download BasiliskII from Gwenole's site. Note: there are apparently a number of projects that call themselves "BasiliskII 1.0", but the one linked here seems to be the only one that actually works.

  • Download Quad650.zip and MacStartup.img from Redundant Robot (a Mac ROM and disk image of MacOS 7.5.5).

  • Launch "BasiliskIIGUI". Under "Volumes", add "MacStartup.img", and point "Unix Root" at your desktop or something (so that you can transfer the old Netscape installers into the emulator).

  • Under "Network", set Ethernet to "slirp".

  • Under "Memory", set model to "Quadra", CPU to 68040, and ROM file to the (unzipped) Quadra ROM. Turn on JIT. Set your screen size to something sane.

  • Start the emulator, launch "StuffIt Expander" and unpack the "netscape1_0.sea.hqx" file. (You can't just double-click it.)

  • Launch the "netscape1_0.sea" self-extracting archive. And you're in business!

  • But, if you want to run 0.9, you'll have to set your (real) system clock back to 1994 to get around the time-bomb. (0.93 and later don't have a time bomb.)

• Once you've got those old browsers running, you'll find that they're working fine with the mcom.com web sites, but they fail on just about every other web site in the world (for the "Host" header reason I described above).

  I have a fix for that!

  I wrote a small proxy server that bidirectionally translates the HTTP/1.0 protocol spoken by old web browsers to the HTTP/1.1 protocol spoken on the modern web. Download and run http10proxy.pl. (You may need to install the Net::Server::Fork Perl module first.) Then, go into the preferences on your ancient browser and set "HTTP Proxy" to localhost, port 8228. This will adjust outgoing Host headers as well as incoming Content-Type headers.

What Was That About Politics?

When I heard that AOL was shutting down their Netscape division for good, I mailed a contact there and asked if they'd transfer the mcom.com domain to me, so that I could resurrect these web sites to make the old browsers work right.

My contact asked around, and much to my surprise, the answer was yes! Wheels were put in motion, AOL's operations folks removed their dependencies on those domains (no idea what those were!) and the domains were about to be transfered... when...

AOL Chief IP Counsel and Time Warner blocked it.

Why?

Because their lawyers determined that, because mcom.com is ten years old and four letters long, they could make several hundred thousand dollars by simply putting it on the market and selling it to a spammer!

And so they began the process of doing exactly that.

Fortunately, my contact (who prefers to remain anonymous) talked them out of this, pointing out that it would be perhaps not the best PR move. But still, they wouldn't transfer it to me. AOL still owns the domains. However, they were willing to host the old Netscape content there, at least for now.

So, thank you to my anonymous contact for all the help! And thank you to AOL for hosting these historic web pages. And for not (yet?) selling the domain to a spammer.

Hey kids, here's a story from the Unfrozen Caveman Files!

I was telling someone about about this the other day, and it's time that Google said something other than "Your search - most-positive-bignum - did not match any documents" so here it is.

Background:

In Common Lisp, there are two types of integers: small ones, which are what you expect; and "bignums", which the specification says should have no upper limit on their range. Fixnums are immediate values (not objects) and bignums are compound (allocated) objects. All the math functions work on either, promoting results to bignums as needed.

So, there is a constant called MOST-POSITIVE-FIXNUM, which is the largest representable "immediate" integer. C calls this MAXINT, and in a C world, it's generally 2^31-1. Because of the type bits on every word, in Lisp it's typically smaller than that. On TI Explorer Lisp Machines it was 2^24-1 (32 bit word, 7 bits of tag).

Here Comes the Dumb:

Well, I was poking around in the system's basement one day, and realized that their implementation of bignums did have an upper limit! A bignum was implemented as an array, with no facility to tack on a second array, so the limit was related to the size of the length field in the array header (instead of being limited by available memory).

So I went and consed up MOST-POSITIVE-BIGNUM.

I did this by carving out a chunk of memory of the proper size for the underlying array, filling it with the right pattern of ones, and slapping an appropriate type tag on the front so that the system would recognize it.

(These sorts of tricks are exactly the sort of things that Java goes out of its way to prevent you from doing, and that's part of why it's impossible to write efficient programs in Java. Whereas the whole Lisp Machine operating system was written in Lisp.)

Fun facts:

• It is 1,223,146 decimal digits (that's 1.0e1223146).
• The object representing it consumes 524 KB of RAM.
• The largest known prime passed it in 1999.
• If you add one to it, e.g.: (1+ MOST-POSITIVE-BIGNUM) you get zero. But it's a zero that consumes 524 KB, and is not = to 0.
• If you ever tried to print it (for example, by having it be the return value in the debugger...) a TI Explorer would lock up in a tight loop in microcode, from which only a warm boot would recover. That microcode loop was trying to grind the number into decimal. That process took more than three days.
• Printing it as a roman numeral took pretty much the same amount of time.

And finally, here's some code that doesn't run on any computer that has been manufactured in two decades.

(Coincidentally, it looks like I wrote this code eighteen years and four days ago. I guess I should have posted this on Friday.)

(  --More--(49%)  )

DNA Lounge update wherein I admit defeat in re this crap.

Hey kids! It's been a while since I've posted questions about stupid Linux crap! That's because I've been ignoring Linux for a very, very long time.

Well, I decided (for a number of individually not very good reasons that, in my head, seemed to add up) to try and upgrade the OS on the DNA Lounge kiosks.

( Dear Lazyweb... --More--(13%)  )

Hey, I remembered that I still have an SGI O2 sitting on the shelf in my laundry room! Unfortunately, what I don't remember is the root password, and I think the only sane way to reset it is with an Irix install CD. Do any of you have one that you can snail-mail to me?

Also, if you happen to have the dingus that lets you plug a normal SVGA monitor into an SGI Indy, I could give that a good home too.

Update: Nevermind, rukzise found a crack that got me back in.

Dear Lazyweb,

I want to actually run some of these old copies of Netscape that I have. I have an Intel iMac running MacOS 10.5.1. What is the easiest way to do that, without spending money? Presumably the answer involves running an emulator, of which there are many. I've tried a couple and not gotten far. (I don't have a preference on whether I run the Mac, Windows, or Linux binaries. Whichever is easiest.)

Facts please, not theories.

My Treo met an untimely death when I kicked a cup of tea into it, so I upgraded. This passing made me sad, because I had just painted the Treo's case to divest myself of the cognitive polution of the logos and text that plaster it like a NASCAR racer (Krylon Fusion FTW), but it turns out that the Centro is better in every way. Well, in one way. It has almost exactly the same specs (except for somewhat worse battery life) but it's a lot smaller. Did I mention a lot smaller?

They also switched from SD to MicroSD. Have you seen these things? They're ridiculous! Nothing removable needs to be that small. It's like a joke: like the "Noisy Cricket" gun from Men in Black.

Unfortunately, even though that's an 8GB card, the Centro seems to only see 4GB of that. What year is this? What kind of pinheads are still writing device drivers that make those kinds of assumptions?

White House Missing Emails Were "Recycled"

Last night, in a midnight filing, the Bush adminstration admitted that it did not properly archive emails. But, that's not all --- they also admit to taping over the back-up tapes containing the email records. [...]

So, there was a system in place to archive emails, and the Bush administration simply stopped using it. Is there really any doubt that this is deliberately criminal activity? Those emails contain the details of the invasion of Iraq, the outing of Valerie Plame and the endangerement of our vital intelligence network, and the scheme to fire competent US Attorneys who refused to do their dirty work. [...]

And what about all of those RNC accounts the Bush officials were using? Remember those other "missing" emails? By Dana Perino's own admission there were at least 5 million missing.

torgo_x takes us on a tour of what it's like to run a 13.5 year old copy of Mosaic Netscape 0.93b on the modern interweb.

There used to be an archive of the old mcom.com pages at dotnetat.net but that's no longer resolving.

BTW, if anyone has a copy of 0.4 for Irix, please give. That was the very first release to ever leave the building, and it's the only one missing from my archives...

Mike Akers ported Dali Clock to the iPhone. He says, "it's now installable via Installer.app, in the Utilities section."

I don't have (and don't want) an iPhone^* so I don't know what that means, but presumably those of you who do, do.

* Hate the on-screen keyboard, find their policy of making third-party software difficult to install to be offensive.

Hey, I think I found a kernel bug. It's preventing the "Phosphor" screen saver (and others) from working properly on 10.5. As far as I can tell, if you have a pipe, and the process on the other end exits, the pipe flushes: all bytes that have been written to the pipe from the child but not yet read by the parent vanish. I reported it to Apple (5606018); no response yet.

(  --More--(33%)  )

Make your Dock be flush against the corner of the desktop, instead of centered vertically or horizontally. This means your icons will stay put, regardless of how many windows are open:

defaults write com.apple.dock pinning -string start ;
killall Dock

Turn off menubar transparency on 10.5:

sudo defaults write /System/Library/LaunchDaemons/com.apple.WindowServer EnvironmentVariables -dict CI_NO_BACKGROUND_IMAGE 1

and then reboot (logging out isn't enough).