Book Out: The No-nonsense Guide to Born-Digital Content

9781783301959

I have a new book out with my colleague Heather Ryan, The No-nonsense Guide to Born-Digital Content

I started drafting chapters for this book in late 2016 when Heather, then the head of the Archives here and now director of the department, approached me about coauthoring the title. I had never written in chapter form before, nor for more a general audience. Approaching my usual stomping ground of born-digital collection material from this vantage was really intriguing, so I jumped at the chance.

To back up a little, our subject here is collecting, receiving, processing, describing and otherwise taking care of born-digital content for cultural heritage institutions. With that scope, we have oriented this book to students and instructors, as well as current practitioners who are aiming to begin or improve their existing born-digital strategy. We’ve included lots of real world examples to demonstrate points, and the whole of the book is designed to cover all aspects of managing born-digital content. We really discuss everything from collecting policy and forensic acquisition to grabbing social media content and designing workflows. In other words, I’m hoping this provides a fantastic overview of the current field of practice.

Our title is part of Facet Publishing’s No-nonsense series, which provides an ongoing run of books on topics in information science. Facet in general is a great publisher in this space (if you haven’t checked out Adrian Brown’s Archiving Websites, I recommend it), and I’m happy to be a part of it. I thank them for their interest in the book and their immense help in getting it published!

Rearview: Wolfenstein 3D

Wolfenstein 3D Postcard
Greetings from Castle Wolfenstein – wish you were here!

Wolfenstein 3D is a gaming divide. Id’s first-person shooter introduced an experience unlike most console or computer games prior: it produced shock, suspense, disorientation and novelty. Super Mario Bros., Elevator Action, Life Force, Contra: a host of NES games felt like oddities and diversions while id’s shooter stood alone as a tense, horror gauntlet – when it wasn’t an action gala.

Reflections on the title describe the unrivaled immersive play. Id tipped the nascent action first-person genre in its favor with title, and then basically set it on its course for the next 20 or 30 years with Doom. I submit that first-person shooters are still in the shadow of that title (caveat: haven’t played many recent FPSs lately). First-person shooters which are praised for their characterization, story, atmosphere, nuance and art still never fail to deliver genre staples: adversaries to gun, the armory itself, and the gameplay to make this very straightforward action fun and interesting. Modern games have succeeded, fitfully and partially I would argue, in subverting this genre expectation, but it’s never absent. I suppose such is the nature of genre – they are shooters, after all – but still, on a very real level playing a seminal shooter like Bioshock still feels like playing Doom. And for all the expertly and artfully realized world that a game like Bioshock offers – among the very best I think – it still handles like (a slower) Doom, through and through. One begins to wonder how much artfully realized world-building and narrative the FPS genre can bear.

To widen the scope a bit I would like to point out a review of Masters of Doom (2003) by James Wagner Au. Au considers what first-person genre would have been like, and more broadly computer games at all, had id not so dominated the landscape with its games, which, for however polished their gameplay is, are steeped in frenetic action and general mayhem.

Corridor Jitters

During the first few weeks I had trouble sleeping, and I can recall a nightmare where brown-shirted guards hunted me down long, open corridors, and where each of my evasions revealed a new nest of Nazis screaming out in German some declaration of annihilation. For a time, the game was genuinely frightening and horrific.

As I became habituated to Wolfenstein’s atmosphere, a lot of that fear receded. I got familiar with the milieu of enemies and occasionally anticipated the designers’ placement of them. I became accustomed to their zig-zag approaches and with the keyboard controls themselves.

But the tension of play remained. To this day it is still an intense game. Enemies’ screams and cries are over the top but striking and memorable. Level design is often punishing, forcing you down corridors lined with tiny recessions where an enemy may or may not stand waiting, or sticking you in a maze populated entirely by silent opponents – your first indication of their presence is being fired upon, usually at point blank.

The damage model is much closer to Counter-Strike than Doom or “Doom clones.” It isn’t uncommon to die from just a handful of enemy hits. A single shot from the lowliest guard can take you from 100% to 0%. And there isn’t any armor. You get into a lot of survival situations, long and short moments alike where you know a single false step will end it. On top of this, Wolfenstein’s engine only allowed 90 degree angles, so peeking around hiding spots was quite difficult, and as often as not you would end up exposing your back to another stuffed-away guard.

It’s known that Tom Hall, one of the designers of the title, pushed for a more realistic game, one the attempted to responsibly portray Nazi prisons, offices and barracks as the game engine allowed. Some levels do flirt with that realism, but most, and the most memorable, do not. The characteristic Wolfenstein 3D level is one with a few reasonable rooms, but a whole swath of spaces that no architect would have ever constructed for any reason, transparently set to rattle you. A player can nearly hear the level designer rejoining, “Sure, and how about this?”

Legacy of Brutality

On the game’s violence: it’s true that it’s unremarkable by a modern standard, but this has more to do with graphic fidelity than anything else. It’s also true that that gore would be recycled and majorly amplified in Doom, itself quite outdone by the realism of subsequent shooters. But Wolfenstein 3D started it.

I can’t forget the audaciousness of this gore at the time. Id’s previous big seller was Commander Keen, a title that delivered the kid-oriented, all-ages console platformer to the PC. The Catacomb series, while first-person shooters, were strictly fantasy, where one aimed fireballs at neon-colored demons and skeletons. We weren’t talking about knifing guard dogs and gunning Nazi officers. The realism, and moreover the evident desire for realism (if not in level architecture, then in common character design), was not there.

I agree with Au when he detects something personally cathartic for the creators within the gore of Doom (and I extrapolate, to a lesser extent, within Wolfenstein 3D). One can certainly chalk up the morbidness to adolescence, but there’s a seriousness and realness to the depiction (if not the treatment) of bodily harm that suggests, as Au states, that Adrian and others were invested in this production much more than the flippant dismemberment and ludicrous body-splosions of successor games (Rise of the Triad, for example).

A couple of bits to know about that art in Wolfenstein 3D and Doom. For Wolfenstein, Adrian Carmack drew all sprites by hand. That means that each pixel was placed by him, and considered. And, as my interview with Bobby Prince suggests, space restrictions may have forced Adrian to return to his pixels and decide what could be cut and altered. The pixels you see in Wolfenstein are each considered. That means the dramatic descent of the officer character, say, was really worked over and decided upon.

 

Imp Pixels
The Doom Imp: Pixel by pixel

For Doom, the characters were first modeled by hand in clay, then photographed from multiple angles. Those photos were scanned, where Adrian could then begin his pixel rendition. So again, the creation of these sprites is a manual process. The computer was the tool, but it took the personal hand and labor to make the images.

Quake I - fighting knights
Physics?

Compare that to id’s own Quake. No doubt there’s labor and consideration here, but the violence has less impact in this title. When an opponent spills blood, it’s done in obvious arcs of red pixels, more the outcome of an algorithm than any person’s hand. When they explode, parts go off in mathematical arcs. Bodily harm and violence is more a computational system, not an animation articulated by hand, frame by frame and pixel by pixel. The graphic violence in Wolfenstein 3D and Doom was affecting and disturbing in a way subsequent efforts were not.

The Castle

Shooters were and still are narrow in conception and in play, and Wolfenstein 3D relies on the quick succession of tiny victories over a near-constant crisis to engage you. No matter how enjoyable this is, the six episodes in the full release are far too much game for the play mechanics at hand. Naturally, the current franchise entries now feature the same commitment to action, visceral combat and slaughter, but has added story, extensive world building, legitimate characters and high production values.

The original shooter though remains an odd beast: a sparse dungeon, remarkably isolating, where nearly every, infrequent glimpse outside reveals a total night. Moving through the game’s endless and often identical halls gives way to a repetitiveness that moves from seductive, to tedious, to fatal. It’s a place of cheap, cartoonish horrors that turn real if you let your guard down. Welcome to Castle Wolfenstein.

“Revealing our melting past: Rescuing historical snow and ice data”

For the last year I have served as Co-PI for a fantastic project, supported by CLIR’s Digitizing Hidden Special Collections and Archives grant program, which centers on the metadata gathering and digitization of the National Snow and Ice Data Center’s (NSDIC) expansive collection of glacier and polar exploration prints within the Roger G. Barry Archives here in Boulder. We have a stellar project archivist leading the work, and we expect to begin posting images on our own site over the course of the year. Stay tuned for that.

The linked article here, posted in the last (ever, actually) issue of GeoResJ is a good summary of the project scope and value from everyone on the team, including our initial PI now at the University of Denver. We’re really excited to be contributing along with NSIDC to glaciology and earth history through this collection, and are planning on further promotion as processing continues along.

Revealing our melting past: Rescuing historical snow and ice data
Author links open overlay panel (ScienceDirect)

“Aggregating Temporal Forensic Data Across Archival Digital Media”

Last year I attended the Digital Heritage 2015 conference and presented a paper on digital forensics in the archive. The paper centers on collecting file timestamps across floppy disks into a single timeline to increase intellectual control over the material and to explore the utility of such a timeline for a researcher using the collection.

As I state in the paper, temporal forensic data likely constitutes the majority of forensic information acquired in archival settings, and in most cases this information is gathered inherently through the generation of a disk image  While we may expect further use of this data as disk images make their way to researchers as archival objects (and the community’s software, institutional policies and user expectations grow to support it), it is not too soon to explore how temporal forensic data can be used to support discovery and description, particularly in the case of collections with a significant number of digital media.

Many thanks to the organizers of Digital Heritage 2015 for the support and feedback; it was a wonderful and very wide-reaching conference.

Aggregating Temporal Forensic Data Across Archival Digital Media (IEEEXplore) (CU Scholar)

KryoFlux Webinar Up

In February, I took part in the first Advanced Topics webinar for the BitCurator Consortium, centered on using the KryoFlux in an archival workflow. My co-participants, Farrell at Duke University and Dorothy Waugh at Emory University both contributed wonderful insights into the how and why of using the floppy disk controller for investigation, capture and processing. Many thanks to Cal Lee and Kam Woods for their contributions, and Sam Meister for his help in getting this all together.

If you are interested in using the KryoFlux (or do so already) I recommend checking the webinar out, if only to see how other folks are using the board and the software.

An addendum to the webinar for setting up in Linux

If you are trying to set up KryoFlux in a Linux installation (e.g. BitCurator), take a close look at the instructions found in README.linux text file located in the top directory of the package downloaded from KryoFlux site. It contains instructions on dependencies needed and the process for allowing access to floppy devices through KryoFlux for a non-root user (such as bcadmin). This setup that will avoid many permissions problems down the line as you will not be forced to use the device as root, and I have found it critical to correctly setting up the software in Linux.

On Doors in Games

It’s been a while since I’ve written about games here. This is a draft post from a few years ago; on rereading I think it’s worthwhile.

Doors in Penumbra: Overture

Some time ago, I started playing Penumbra: Overture, the debut first-person horror-adventure title from Frictional Games. I never finished the game or ever played very far in, but I wanted to comment on a satisfying mechanic seen early in the game: manual manipulation of objects — but particularly hinged, swinging doors.

Yes, I’m going to talk about doors in a video game, but I’m certainly not the first.

A little background on the game. Penumbra: Overture shares the perspective and control scheme of first-person shooters (WASD keys and a mouse), and although one combats enemies, this is not a first-person shooter. Your avatar, one Philip stuck in an abandoned mine, has panic attacks when he confronts enemies: breathing contracts, vision is marred, and Philip may stand and reveal himself in a nervous outbreak. Combat is similarly frantic and amateurish. Outside of doors, a player can manually slide, slam, stack, etc., various objects in the game by clicking and holding them, and then moving them onscreen with the mouse. This leads to some physics-based puzzles and object manipulation, and provides a strong sense of analog mechanics at work in the world.

Doors in First-Person Shooters

Let’s return to the operation of doors in the game. It makes design sense that so few (if any) first-person shooters contain hinged doors opened by degrees with a mouse. If the central activity is gunplay or melee, operating a door is a distraction.

Apart from gameplay, it is computationally much more expedient to implement a simple sliding or pocket door. This door will use the same animation every time, and if the game runs a genuine 3D engine, it may remove the need for on-the-fly numbers crunching. In a pseudo-3D system such as seen in the original Wolfenstein 3D, implementing a hinged door would be absurdly difficult and perhaps technically impossible. Thus the player is confronted with the same door sliding door for the entirety of the game and its sequel, from the opening jailbreak setting to officers’ quarters, secret labs and bunkers. Whatever the fiction of the setting, the door never changes.

Going back to gameplay however, a sliding or pocket door features only two states for the player: open or closed. Instead of the player encountering a panel on hinges which he or she must manipulate by degrees to pass through, the player encounters a flat, essentially 2D barrier (even in the case of more modern titles like Halo) that only needs a single button press (if that) to open. The player passes through such doors completely or not at all. Even when it is opening and visually between open and closed, it is functionally closed; when it is seen to be closing it is still absolutely closed and impassable. Many games that feature hinged doors use a preset animation, or use it as a loading screen (Resident Evil). In all cases, doors are a binary gate.

And this is acceptable. It is of course the point of doors, to let something in or out, or keep it in or out. We didn’t make doors for them to be halfway open, although as it happens many are.

Doors of this type are found in numerous older first-person shooters: Blake Stone, Doom, Duke Nukem 3D, Rise of the Triad. Even a modern title like the aforementioned Halo, which could easily implement a hinged door, has no need to do so. Esoteric or exotic settings have their clear attractions as game worlds for players, but they arguably have equally if not more compelling attractions for programmers, developers and designers. Automatic, two-state doors are infinitely easier to implement than a board that swings, by degrees, on hinges, and it’s reasonable to expect to find such doors in science fiction or otherwise futuristic settings. By that time superior door-tech  would have eliminated any instances of halfway open doors.

(This of course goes into the long tradition of technical constraints informing a game’s fiction. I have a growing mental catalog, from Mario’s design to the preponderance of bald space marines.)

Immersion and a Hinged Door

So Penumbra: Overture‘s doors can be neither entirely open nor entirely closed. Why is that so interesting?

I’m sure some of my interest has to do with how such creaky, realistically old doors contribute to the atmosphere of the game. But it’s also jarring to see something in a middle state, a state that’s not precisely describable. I could say the door is open just a crack, or mostly open, or even halfway open, but these are not absolutes like open and closed. I can have any number of different views into the next room depending on these highly adjustable degrees, as I try to imagine what is still obscured by the door panel.

It is the mundanity of operating the door, and of noticing the space it occupies, which is so compelling. Taking the time to operate the door feels slightly unreal – I’ve never had to think about opening a door in a game, and I mean really think about moving the hinged board over. Each door is opened differently, depending on my angle to it and the position of my mouse. Having to concentrate on this, however briefly, immerses one into the game unexpectedly, and reifies the world suggested onscreen.

Considering again the automatic sliding and pocket doors of first-person shooters: their prime function is to demarcate rooms and divide the player’s challenges appropriately. They reinforce the gameness of the world in that way, in their ability to be completely in the way or completely out of the way. Penumbra: Overture‘s developers do make use of their doors in gameplay. In some cases one needs to block the door from a pursuer. The tension here is that the door returns to its original binary function: it will either be open for the pursuer or closed, and one can watch as the door, by degrees, is forced open. Frequently however the doors are simply wonderfully described objects that exist in the game, outside of your immediate concerns.

This leads me to wonder what other games have used mundane details or provided interactions utterly unrelated to the central gameplay to enhance the realness of the world (and I do not count side quests and such as are found in RPGs: they almost all have very applicable benefits for the player)?

In any case, that lack of a definite state is refreshing, as it happens so little in games. When opponents are felled in a shooter, they are almost always absolutely felled: you do not often maim an opponent with an errant shot and have to deal with his or her suffering. Levels are completely finished, quests are definitely open or closed, achievements are either unlocked or locked, etc. How often can one badly hurt an opponent, and then move on to the next area? If you came back, would it still be there — would you have to hit the opponent a few more times to finish the job? This is the sort unsavory midway point games have dealt so well in discarding, one could argue games have to discard this aspect of our lives to be games at all. In any case, so many games belong in the province of fantasy that dealing in totalities makes thematic (along with the aforementioned technical) sense. Still, it is awfully nice to engage with a world where a few mechanics, at least, are not figured in such absolutes.

Repercussions of Amassed Data

I had the pleasure of meeting Mél Hogan while she was doing her postdoctoral work at CU Boulder. I think her research area is vital, though it’s difficult to summarize. But that won’t stop me, so here goes: investigating how one can “account for the ways in which the perceived immateriality and weightlessness of our data is in fact with immense humanistic, environmental, political, and ethical repercussions” (The Archive as Dumpster).

Data flows and water woes: The Utah Data Center is a good entry point for this line of inquiry. The article explores the above quoted concerns (humanistic, environmental, political, and ethical) at the NSA’s Utah Data Center, near Bluffdale. It has suffered outages and other operational setbacks since construction. These initial failures are themselves illuminating, but even assuming such disruptions are minimized in the future, the following excerpt clarifies a few of the material constraints of the effort:

Once restored, the expected yearly maintenance bill, including water, is to be $20 million (Berkes, 2013). According to The Salt Lake Tribune, Bluffdale struck a deal with the NSA, which remains in effect until 2021; the city sold water at rates below the state average in exchange for the promise of economic growth that the new waterlines paid for by the NSA would purportedly bring to the area (Carlisle, 2014; McMillan, 2014). The volume of water required to propel the surveillance machine also invariably points to the center’s infrastructural precarity. Not only is this kind of water consumption unsustainable, but the NSA’s dependence on it renders its facilities vulnerable at a juncture at which the digital, ephemeral, and cloud-like qualities are literally brought back down to earth. Because the Utah Data Center plans to draw on water provided by the Jordan Valley River Conservancy District, activists hope that a state law can be passed banning this partnership (Wolverton, 2014), thus disabling the center’s activities.

As hinted at in a previous post on Lanier, I often encounter a sort of breathlessness invoked when descriptions of cloud-based reserves of data and computational prowess are discussed. Reflecting on the material conditions of these operations, as well as their inevitable failures and inefficiencies (e.g. the apparently beleaguered Twitter archive at the Library of Congress, though I would be more interested in learning about the constraints and stratagems of private operations) is a wise counterbalance that can help refocus discussions on the humanistic repercussions of such operations. And to be sure, I would not exclude archives from that scrutiny.