Visualizing Digital Seriality — Demo Videos

2017-08-15 01.23.20 pm

The short videos below (all under 1 minute in length) demonstrate the interactive components included in “Visualizing Digital Seriality, Or: All Your Mods Are Belong to Us!”—a digital humanities/critical code studies project utilizing visualization and other software tools to study exchanges of code and community-building in the Super Mario Bros. modding scene—published in Kairos: A Journal of Rhetoric, Technology, and Pedagogy 22.1 (August 2017): http://kairos.technorhetoric.net/22.1/topoi/denson/index.html

The videos, which use IBM Watson’s text-to-speech generator for voiceovers, were produced just in case any of the interactive functions ever stop working, but they also serve to show what you can do with my webtext (as Kairos refers to this type of multimodal scholarship).

1 – Mods & Interfaces

This page allows users to filter and sort the title screens of 240 Super Mario Bros. mods, all taken from ROMhacking.net’s database. Sorting and filtering can be done by year, by modder, and by mod name, as well as through a quick search via text input. Dropdown lists appear when the mouse hovers over “Year,” “Modder,” or “Title,” allowing the user to select parameters by checking the relevant boxes. Sorting can be done with the buttons below: “Sort by Date,” “Sort by Modder,” or “Sort by Mod Title.”

http://kairos.technorhetoric.net/22.1/topoi/denson/screens-page/index.html

2 – Basic Metadata

This page offers visualizations of basic metadata derived from ROMhacking.net’s collection of Super Mario Bros. mods. The interactive visualizations contain basic information on the number of mods released each year, the most active modders, and trends concerning the types of mods being produced. Additional information appears when the mouse hovers over the charts.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/basic-metadata.html

3 – Modder Networks (default view)

This interactive network graph visualizes the social networks among modders, as revealed in paratextual references in files distributed with mods (i.e. “shout-outs” in README.TXT and similar accompanying files). This is the default view. Each node represents an individual modder, while edges (lines) represent connections between modders. The user can change the visual style and layout via the dropdown menus on the left, as well as zoom in and out with the mouse wheel and rearrange nodes by holding and dragging them. Scrolling is achieved by holding and dragging the background.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/community.html

4 – Modder Networks (concentric view)

This interactive network graph visualizes the social networks among modders, as revealed in paratextual references in files distributed with mods (i.e. “shout-outs” in README.TXT and similar accompanying files). This is a concentrically arranged view. Each node represents an individual modder, while edges (lines) represent connections between modders. The user can change the visual style and layout via the dropdown menus on the left, as well as zoom in and out with the mouse wheel and rearrange nodes by holding and dragging them. Scrolling is achieved by holding and dragging the background.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/community.html

5 – Modder Networks (weighted)

This interactive network graph visualizes the social networks among modders, as revealed in paratextual references in files distributed with mods (i.e. “shout-outs” in README.TXT and similar accompanying files). Each node represents an individual modder, while edges (lines) represent connections between modders. In this view, node size corresponds to the number of references it has received (the more paratextual references, the larger the node). The user can change the visual style and layout via the dropdown menus on the left, as well as zoom in and out with the mouse wheel and rearrange nodes by holding and dragging them. Scrolling is achieved by holding and dragging the background.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/community.html

6 – Modding Communities

This interactive network graph visualizes connections between modders and various online modding communities, as revealed in paratextual references in files distributed with mods (i.e. references to various online communities and modding websites). In the default view, white nodes represent various mod files, while solid red nodes represent communities and websites referenced by them. The user can change the visual style and layout via the dropdown menus on the left, as well as zoom in and out with the mouse wheel and rearrange nodes by holding and dragging them. Scrolling is achieved by holding and dragging the background.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/community.html

7 – Extent of Modification

The visualization on this page offers information about the extent of modification that a given mod patch file instructs the computer to execute with respect to the original Super Mario Bros. ROM. The visualization provides basic numerical information about the amount of change contained in a mod or set of mods. It can be sorted and filtered by modder, mod, or by a range of particular byte addresses with the sliders and checkboxes on the right. The results, displayed on the left, can be sorted by title, year, or modder.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/extent.html

8 – Code “Diff”-Maps (Sorted by Date)

These visualizations offer the core means of conducting a “distant reading” of the code of all 240 Super Mario Bros. mods contained in the data set. Sorted here by date, these Gannt charts depict the location of byte-level modifications in the game ROM. The chart can be filtered by modder, mod title, and year via the checkboxes on the upper right, or by a range of particular byte addresses via the “Start” slider at the bottom right. The results, displayed on the left, can be sorted by date, modder, or title.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/diff-maps-by-date.html

9 – Code “Diff”-Maps (Sorted by Modder)

These visualizations offer the core means of conducting a “distant reading” of the code of all 240 Super Mario Bros. mods contained in the data set. Sorted here by modder, these Gannt charts depict the location of byte-level modifications in the game ROM. The chart can be filtered by modder, mod title, and year via the checkboxes on the upper right, or by a range of particular byte addresses via the “Start” slider at the bottom right. The results, displayed on the left, can be sorted by modder, date, or title.

http://kairos.technorhetoric.net/22.1/topoi/denson/visualizations/diff-maps-by-modder.html

10 – Diff Compare Mods (Patched ROMs)

This page enables low-level analysis of mod files, accessed here through a browser-based hex editor. To use the tool, the user selects two files (from the complete collection of patched ROMs, as well as the original unpatched ROM) from the dropdown menus below and clicks the button “Choose Files.” Afterwards, the hex code and ASCII representation of the patched ROM files will appear in the two boxes, with the differences between them highlighted. Scrolling is synchronized between the files displayed in the left and right boxes.

http://kairos.technorhetoric.net/22.1/topoi/denson/hexdump-diff/hexdump-diff.html

11 – Diff Compare Patch Files (Unpatched .ips Files)

This page enables low-level analysis of mod files, accessed here through a browser-based hex editor. To use the tool, the user selects two files (from the complete collection of unpatched .ips format patch files) from the dropdown menus below and clicks the button “Choose Files.” Afterwards, the hex code and ASCII representation of the patch files will appear in the two boxes, with the differences between them highlighted. Scrolling is synchronized between the files displayed in the left and right boxes.

http://kairos.technorhetoric.net/22.1/topoi/denson/hexdump-diff/ips-hexdump-diff.html

Advertisements

Jonathan Sterne: Machine Learning, ‘AI,’ and the Politics of Media Aesthetics

Sterne poster DAW

On April 24, 2018 (4-6pm in the Stanford Humanities Center Board Room), Jonathan Sterne will be speaking at the Digital Aesthetics Workshop. The title of his talk is: “Machine Learning, ‘AI,’ and the Politics of Media Aesthetics: Why Online Music Mastering (Sort of) Works.”

Jonathan Sterne is Professor and James McGill Chair in Culture and Technology in the Department of Art History & Communication Studies at McGill University. His work is concerned with the cultural dimensions of communication technologies, especially their form and role in large-scale societies. One of his major ongoing projects has involved developing the history and theory of sound in the modern west. Beyond the work on sound and music, he has published over fifty articles and book chapters that cover a wide range of topics in media history, new media, cultural theory and disability studies. He has also written on the politics of academic labor and maintains an interest in the future of the university. His new projects consider instruments and instrumentalities; histories of signal processing; and the intersections of disability, technology and perception.

Ends of Cinema: Center for 21st Century Studies 2018 Conference at UW Milwaukee

C21-Ends-of-Cinema-poster

I am excited to be participating in the Ends of Cinema conference at the Center for 21st Century Studies, taking place May 3-5, 2018 at University of Wisconsin Milwaukee. There are some great keynote speakers, including my colleague Jean Ma and lots of other wonderful people. The C21, under the expert leadership of Richard Grusin (who is now back at the helm after a short hiatus), has put on some of my personal favorite conferences, and I expect this one to be no less exciting and thought-provoking.

My own contribution will be a paper titled “Post-Cinematic Realism” — work in progress for my current book project Discorrelated Images. Here is the abstract:

Post-Cinematic Realism

Shane Denson, Stanford University

In its classical formulation, cinematic realism is based in the photographic ontology of film, i.e. in the photograph’s indexical relation to the world, which grants to film its unique purchase on reality; upon this relation also hinged, for many realist filmmakers, the political promise of realism. Digital media, meanwhile, are widely credited with disrupting indexicality and instituting an alternative ontology of the image. David Rodowick, for example, argues that the interjection of digital code disrupts film’s “automatisms” and eradicates the index in favor of the symbolic. But while such arguments are in many respects compelling, I contend that the disruption of photographic indexicality might also be seen to open up spaces in which to explore new automatisms that communicate reality and/or realism with and through post-indexical technologies.

Whereas André Bazin privileged techniques like the long take and deep focus for their power to approximate our natural perception of time and space, theorists like Maurizio Lazzarato and Mark Hansen emphasize post-cinematic media’s ability to approximate the sub-perceptual processing of duration executed by our pre-personal bodies. The perceptual discorrelation of computational images gives way, in other words, to a more precise calibration of machinic and embodied temporalities; simultaneously, the perceptual richness of Bazin’s images becomes less important, while “poor images” (in Hito Steyerl’s term) communicate more directly the material and political realities of a post-cinematic environment. As I will demonstrate with reference to a variety of moving-image texts employing glitches, drones, and other computational objects, post-cinematic media might in fact be credited with a newly intensified political relevance through their institution of a new, post-cinematic realism.

Frankenstein@200: International Health Humanities Consortium Conference

Screen Shot 2018-04-06 at 11.40.10 AM

The 2018 International Health Humanities Consortium Conference will be held at Stanford University from April 20-22, 2018. The keynote speakers are:

Alexander Nemerov
Professor, Art and Art History at Stanford University

Lester Friedman
Professor, Media and Society at Hobart and William Smith Colleges

Alvan Ikoku
Assistant Professor, Comparative Literature and Medicine at Stanford University

Catherine Belling
Associate Professor, Feinberg School of Medicine at Northwestern University

In addition, there will be a number of great events around campus. You can find more information here.

I will be participating in the conference in two ways:

First, on Friday, April 20 (2:30-3:30pm in McMurtry 115) I will be presenting a screening session of videographic works related to “Frankenstein & Film.” I will be showing a few of my own pieces (which you can see here and here), as well as works by video essayists like Allison de Fren, alongside commercial “making of” videos, art film reimaginations, and other moving-image forms that treat the history of Frankenstein films from Thomas Edison’s 1910 production up to the present day.

Screen Shot 2018-04-06 at 12.09.56 PM

Second, on Sunday, April 22 (11:15am), I will be presenting a paper titled “Frankenstein and Bioethics Beyond Chance and Choice.” The paper draws upon and rethinks ideas that I put forward in one of my very first publications: “Frankenstein, Bioethics, and Technological Irreversibility.” That paper, published in 2007, can be found here.

Psychedelic Space and Anachronic Time: Elizabeth Kessler at Digital Aesthetics Workshop

DAW Kessler poster

On Tuesday, April 10 (4-6pm in the Board Room of the Stanford Humanities Center), Elizabeth Kessler (Stanford, American Studies) will deliver a talk, titled “Psychedelic Space and Anachronic Time: Photography and the Voyager’s Tour of the Solar System,” in the context of the Digital Aesthetics Workshop.

Elizabeth Kessler’s research and teaching focus on 20th and 21st century American visual culture. Her diverse interests include: the role of aesthetics, visual culture, and media in modern and contemporary science, especially astronomy; the interchange between technology and ways of seeing and representing; the history of photography; and the representation of fashion in different media. Her first book, Picturing the Cosmos: Hubble Space Telescope Images and the Astronomical Sublime, on the aesthetics of deep space images, was published in 2012. She’s currently writing on book on extraterrestrial time capsules, as well as developing a new project on fashion photography.

See here for more information.