ASCII by Jason Scott

Jason Scott's Weblog

Archiveteam! The Geocities Torrent —

Well, here we are on October 26th, 2010.

Can it really be a year ago that Archive Team had dozens of people assaulting Yahoo’s servers desperately trying to save disappearing history? Well, let’s be frank — not disappearing history, but in fact history being actively and quickly destroyed on purpose.  I mean, it’s not like Yahoo! had some sort of terrible server failure or something. They in fact had made the active decision to turn off the site called Geocities, an at-that-point 15 year old hosting site that contained terabytes of user-generated content.

Oh, we were having a great time one year ago – rushing around from this server to that, faking the Googlebot user agent string, bringing our full downloading power to bear. At one point we were well past 100 megabits of bandwidth yanking onto all our archives. As October 26th leaked into the 27th, we watched as site after site disappeared. Sites that were, in the vast majority of cases, less than 10 megabytes. Remember the last time 10 megabytes mattered?

Well, apparently it mattered enough to Yahoo! to decide to kill off Geocities across a couple days, after announcing somewhat quietly that all that data was going away. The usual sarcastic-hand-wringing and point-and-laugh ensued from popular press. “Remember Geocities?” and “Good Riddance” were the order of the day. So it came as a surprise to some that Archive Team thought all of this worth saving – by any means necessary.

What we were facing, you see, was the wholesale destruction of the still-rare combination of words digital heritage, the erasing and silencing of hundreds of thousands of voices, voices that representing the dawn of what one might call “regular people” joining the World Wide Web. A unique moment in human history, preserved for many years and spontaneously combusting due to a few marks in a ledger, the decision of who-knows for who-knows-what.

Well, actually we do know what – it was to show that Yahoo!, after purchasing Geocities for nearly $3 Billion Dollars With a B, was cutting costs for the 2009 financials.  Faced with a lingering, saddened death, new management sought to save money where it could, and projects unshielded by internal advocates were thrown out with the bathwater. (And the bathtub, and probably a number of unused plumbing supplies filling one of the back offices). The amount saved? Probably very little – the servers ran themselves (it appears there was no actual team assigned to Geocities beyond maintenance for the last year of its life) but by saying that something that was there was no longer there, the illusion of progress could appear.  So an announcement happened, and then over the next few months, the death march continued, until October 26, 2009 fell and with it the sunset of Geocities.

Of course, Yahoo! might have tried spinning off the company, but it doesn’t appear to be the case that Yahoo! knows how.  So death appeared to be the only option, since shutting down Yahoo! properties was “in” that year.

But you see, websites and hosting services should not be “fads” any more than forests and cities should be fads – they represent countless hours of writing, of editing, of thinking, of creating. They represent their time, and they represent the thoughts and dreams of people now much older, or gone completely.  There’s history here. Real, honest, true history.  So Archive Team did what it could, as well as other independent teams around the world, and some amount of Geocities was saved.

How much? We’ll never know. One of the Archive Team members called Yahoo! to find out the size and was rebuffed. When we called later in the year to ask exactly when the site was going down on October 26th, we were told that the person who spoke to us last had been let go. It must be like spring break down at that place.

But we know we got a bunch of Geocities sites – a significant percentage, especially of earlier, pre-acquisition data. We archived it as best we could, we compared notes, we merged and double-checked and did whatever needed to be done with what we happened to have.

So now, on this one-year anniversary, Archive Team announces that we are going to torrent it.

YES THAT IS RIGHT, WE ARE RELEASING GEOCITIES ON A TORRENT.

This is going to be one hell of a torrent – the compression is happening as we speak, and it’s making a machine or two very unhappy for weeks on end. The hope had been to upload it today, but the reality is this is a lot of stuff – probably 900 gigabytes will be in the torrent itself. It’s not perfect, it’s not all – but it’s something.

Who will want this? Anyone who feels like browsing among the artifacts of yesterday, who wants some data to play with, who is doing research into history, who wants to get some mileage out of a few weblog postings of crazy glittery animated GIFs and MIDI music. It’s not for everyone. Some people will probably grab a few files out of the thousands of archives in the torrent, unhook and call it a day. Others will want all of it, every last bit, to put onto their $80 1TB hard drive they bought down at the local computer mart.

UPDATE: The compressed archive is 652 gigabytes, and you can stop down at that famous computer history site The Pirate Bay and get the torrent.

While it’s quite clear this sort of cavalier attitude to digital history will continue, the hope is that this torrent will bring some attention to both the worth of these archives and the ease at which it can be lost – and found again.

Clear your disk space – this one’s going to be a doozy.

FURTHER UPDATE: There’s an update on the status of the torrent on this entry.


You’re Stealing it Wrong —

This summer, for DEFCON 18, I gave a talk called “You’re Stealing it Wrong: 30 Years of Inter-Pirate Battles”.  The proposal was good enough that less than a few hours after I submitted it, Dark Tangent himself tweeted about it. That was enough pressure to ensure I had lots of backup material, lots of items to discuss. The result is pretty far out there.

Here’s the video from the speech.

You’re Stealing it Wrong: 30 Years of Inter-Pirate Battles from Jason Scott on Vimeo.

I endeavor to thank the contributors to my sabbatical, for it’s their efforts that have allowed me to get all I’ve gotten done this past year, stuff that will pay off literally for years.  (I am well aware I owe my contributors their actual awards, and that’s the plan for October.)

As for content, I have a strong opinion that a good talk isn’t a self-contained story, but a series of entertaining threads all gathered up, all of which you can then pull on and learn more about. To that end, there’s a lot to check out. Happy hunting.

I must say, I really, really like this format that DEFCON’s recording entity, The Sound of Knowledge, use for speeches. You get the slides in perfect clarity, the name of what you’re watching, and the gesticulations of the speaker all captured as great as they can be. Yeah, they glitched and lost my video for a little bit, but  you got my audio recorded properly.

And what’s up with that hat!


Still Never Shutting Up —

Photo by Johngineer

Been rather busy for the past year, here and there, with all sorts of appearances, presentations, call-ins and the sort of public speaking I’ve always enjoyed doing. And the movie, obviously. But I just took a little time just now and backfilled a good amount of talks I gave recently into the Presentations Page on the site.

It’s quite a selection and many have audio and video links, in case you’ve missed them – probably a couple hours of delight and dismay.

I love giving these, so keep me in mind, everyone out there.


A Return to the Weblog with a 40th Birthday —

Today, I’m 40.

I’ve been touring in support of GET LAMP with a tour entitled JET LAMP.

In celebration, this weblog will be starting up again for real.

But today, I’m turning 40, and I’m doing it online. For just today, September 13th, come visit me online to celebrate my birthday, harass me about projects, or ask me anything here:

http://www.tokbox.com/conf/ri0rii7w7pz04529

And let’s see if I can get this weblog back up to its old tricks.


A Lamp, Gotten —

After roughly 4 years of work (2006-2010), GET LAMP, a documentary about text adventures, is complete.

While I’ve been working on the documentary and its aftermath, this weblog has been dormant.  While some use their weblogs as day to day updates and some use them to write small “let’s talk about this” paragraphs, usually with advertisements hovering nearby, I have always primarily used this weblog to write longish essays about a subject, thoughts on said subject, and so on.  I got a great mandate last year from a Kickstarter campaign to do computer history, and as part of that, I focused on finishing this film.

And man, is it finished.

Two DVDs, with a main “GET LAMP” movie, featurettes on Infocom, Mammoth Cave, the Z-Machine, and dozens of other subjects. Over 4 hours, in total. There’s that MC Frontalot music video I did a few years ago, as well as commentary tracks, full subtitles, and a pile of easter eggs scattered around. There’s also a DVD-ROM section with many games and a few extra audio and video files.

Oh, and a coin.

Well, I guess not just a coin, as such things go. It’s a coin that’s individually numbered, gold and silver plated, and included with every copy. Text adventures did this, and it’s one of the most positive memories people had of the whole thing, so I decided to do it too.

So yes, I finished my second film. I now have a filmography, a set of films. There’s stylistic themes that run through both my films. Maybe I’ll make more.

I’ll spend the next few entries on a postmortem about various bits of my production.  Then we’ll see about the weblog entries I’ve always loved writing, when there wasn’t a movie to finish.

More soon.


Hello Friends —

…it’s been a while.

Expect that you will be hearing a lot from me, about a lot of things, very shortly.  I’ve missed our little chats, and anyone who thinks my hand or heart has been stilled can either rejoice or cower, as necessary.

As a peace offering, I invite you to see the rejected/cancelled artwork for Leather Goddesses of Phobos.

Leather Goddesses of Phobos

I have a backlog that would bring tears to the face of a statue.  I will be quite active knocking it down over the next period of time.

Talk soon. Talk very, very soon.


PLATO’s Retreat —

So part of this is let you know of the PLATO 50th Anniversary Celebration at the Computer History Museum in Mountain View, CA. It’s June 2-3rd. If you have the ability to get out there to it and you have the slightest interest in computer history, you will want to go to this. It all happened a long time ago and a lot of the people speaking won’t be around for the next time attention is paid to PLATO. And it’s free.

If you don’t know what PLATO is, it’s worth checking that out as well, it did a lot of cool stuff and there’s a lot of documentation about it.

In fact, I think that’s most of what’s relevant for people.

But I also wanted to address that Brian Dear, the co-organizer of this event related to PLATO and a historian specializing in PLATO, is a jerk.  A twerp, a knob, a dweeb.

Oh, you can bet we have a history. I could write this big long jib-jabbery thing that would show up every time someone looked up his name, but that’s not the point. Maybe you’d agree with my assessment, maybe not. I’d whip out a few hilarious metaphors and recount, line by line, the thousand injuries of Brian Dear and his venturing upon insult. But all you’d have on the takeaway is “man, that was some crazy-ass takedown action there”.

No, what I want you to understand is that this event, this PLATO 50th Anniversary, which Dear has been spearheading and co-organizing since forever, is objectively good, objectively important. It is a fantastic thing that this is happening.

PLATO was, in a back-of-napkin description, a networked collection of computers allowing students to collaborate and communicate via software.  A lot of real interesting stuff happened online, as it always does, and there were things PLATO did that didn’t grab on in a general sense for years and decades afterwards.  It was a closed system, and it was only available to a small subset of people, and it made available to people a number of technologieis that were even more restricted in the past. There’s arguments that PLATO helped inspire Lotus Notes (and Content Management Systems) as well as first person shooters. There were some damned smart folks doing some damned cool things and a lot of it has been documented.

At the PLATO 50th anniversary event, many of the movers and shakers of PLATO will be in attendance and giving presentation. PLATO’s been recognized over the years, but this being the 50th anniversary and all, a lot of people will be on various stages and various technology will be shown that hasn’t been done on this scale before.  Also, it’s held at the Computer History Museum, folks who I have seen really get their act in shape and do amazing stuff – I got to play Space War on vintage hardware against Slug Russell, for crying out loud!

Here’s some promotional material: PLATO @ 50 Conference

Too many times in my research and historical work, and reading how things went down in the past, I’ve seen where personal dislike has caused great chances to be missed. Not attending an event because someone you don’t like might be there. Refusing to work with a technology because one of its most vocal proponents is a fuck. Working with a technology because one of its most vocal opponents is a fuck.  I find locations where I wonder why someone critical to the subject didn’t get involved with another group of people, and it comes down to personal irritation and political infighting. I realize that’s always going to be the case with situations like close collaboration and partnership; so be it. But then it expands outward, with people refusing to attend something en masse because one pillowbiter is associated with something that 100+ folks are organizing, and then we’re just talking needless loss and destruction of opportunity.

Now, I’m not going, but because of scheduling, not any other reason. I really wish I could go, and I intend to get any videos and audio from the conference that I can. But if you’re local, please go to this thing. It’s big stuff.

Oh, and sure, you could walk up to Brian Dear and ask why I think he’s a twerp, a knob, a dweeb. But lay off – I’m sure he’ll be busy with all the little things associated with an event like this and he should have his 48 hours in the sun.

I’ll devote more space and time to PLATO in future entries, but for now, please make plans.  Tell your friends. If computer history matters to you, there’s going to be a lot to learn and see at this event.


BBS Documentary IMDB Entry Improved —

Just wanted to mention that the BBS Documentary IMDB Entry now has another 100 names added to it. Man, did I interview a lot of people.

Only a few people appear in my film as well as others, so I added a metric ton of entirely new people to their database, and that takes a while.

For some of them, being in the IMDB was a really big deal, and so I’m glad I could get around to adding everyone in the newest swing. I think we’re down to about 10 who aren’t in there, mostly because I’m not sure if they want hacker names or regular names, etc.

Yeah, short entry, but I wanted you to know.

Next, the GET LAMP entry.  That should be easier.  Maybe.


Information Cube Status —

The Information Cube, the new home of the TEXTFILES.COM Archives and a direct result of the Sabbatical funding I received last year, is coming along nicely.

I learned a lot about what crates and storage boxes work and do not work, I can say that – I’ve found which collapse under their own weight, which ones hold out pretty well, and even ones that are really awesome but cost way too much for what they do. I also realized I have enough stuff that if I’m not careful with how I pile things into the cube, I can fill the cube. That looks like this:

And that doesn’t look good at all, to anybody.

Anyway, a bunch of shifting around later, I have found the best crates for my needs:

Specifically, the ones on the left. They’re $11 apiece, hold a pile of stuff, and stack very well. The ones on the right, in the back behind the yellow lids, hold about 20-30% more stuff, but cost $50 apiece. Good if I have a large, fragile set of equipment that will need transport, but way too much money for what they provide. They’re fuckin’ strong, though; they could probably withstand a sledgehammer for a while until help arrives.

Right now, I’m simply packing the crates with like-themed stuff that I don’t mind disappearing for a few months, specifically magazines and journals:

Later, I will make sure that all of one kind of magazine/journal is in a crate, and have them labelled on the outside so they’re easier to find on request.

Using these crates (the yellow-tops) means a ton of the older smaller crates are temporarily unneeded. They’re piled outside the library right now, including all the ones that have snapped, broken, or exploded:

Something like 30+ crates are currently redundant within there, with many more to come.

Currently, it is once again possible to walk the whole inside of the Cube:

As you can see, there’s still a lot more work to do, and I think that middle aisle is going to widen out as I fix up more of the crates and replace smaller ones with the large yellow ones.

In the past few months, I’ve been doing all sorts of work related to GET LAMP and the moving of items into this cube and the occasional weblog entry about bad computer movies and running a demoparty and all the rest.  The Cube work is going to result in a treasure trove of posted online information, scans and writing across the latter half of this year. Tons. In an ideal world, the GET LAMP sales will help fund living expenses while I do nothing but go through this stuff and present and speak. Fingers crossed.

In the background, in a few specialized corners of the internet, a number of individuals have implied that I have hoodwinked people with the sabbatical money and have nothing to show for it.

These individuals can fuck right off.

One last detail: The Cube has an official dog. His name is Buddy.

Be sure to clear any visits with me beforehand, or you will have to deal with Buddy. Buddy will mess your shit up. Look at those eyes. THOSE ARE THE EYES OF A KILLER.

That is all.


Buffing up the BBS Documentary IMDB Entry —

Just worked a little on one of those “in the attic” projects – adding interviewees to the cast list for the BBS Documentary IMDB Entry.

If you’ve never worked with IMDB’s interface for adding or correcting details, it’s very weird to say the least.  And if you’re working in the world of Wikis and think that’s the way everything should be done, then the pace of this system will seem glacial – changes made may not show up for weeks. Normally, though, the whole point of the UI, which is to prevent you from doubling people or missing basic facts, works very well. You want to declare the filming location of a movie, add it, and then wait and your change goes in.

But with BBS Documentary, and the 205 interviewees, adding them in huge bulky groups was really harrowing. I added something like 85 when I first put together the IMDB entry, just a pile of names from the list, and then let it sit. Over time, a lot showed up. I fixed up a few name entries, added trivia, linked to stuff, but then kind of left it. Over the years, I did some minor adjustments, but people who were in it would ask about getting into the list. An IMDB entry’s a big deal, in some cases!

So finally, I added another 100 or so names. The list is much, much more accurate, and they’ve added everyone. And they fixed this minor bug where I typed “Himself” instead of “Herself” for a female interviewee, and it stuck for years. Fixed as well.

I’ll see when I have time to track down the rest. But for now, that cast list is looking pretty huge.  Man, I interviewed a lot of people!