Localizing a 1600 Year-old Comic Strip

Video of the production process

How it all began…

A few years ago, my former high school art teacher invited me back to campus to give a brief presentation on Chinese art history. I gushed with the students about the symbolism of jade and clouds, surprised them with fun facts about how the terracotta warriors were originally painted realistic colors, but the most interesting part was when I pulled out my own personal copy of Zhang Zeduan’s Qingming Festival Along the River. I lovingly took it out of its brocade embroidered box, gathered the students in a circle, and walked through the painting segment-by-segment, explaining how scrolls are actually meant to be read in sections like a comic strip.

My art teacher’s eyes widened. “All this time, I thought you were supposed to unroll the whole thing first,” he said.

It’s not his fault he had this misconception. Museums usually display Chinese hand scrolls completely unfurled, under shiny glass cases and big signs that scold, “no flash photography!” Crowds mull by in a clockwise rotation, glancing down at the images here and there. It’s the exact opposite of the intimate way scrolls are meant to be viewed.

How can we teach Western audiences about hand scrolls?

This experience got me thinking: there’s got to be a better way to teach Western audiences about hand scrolls. What if I made a scroll English speakers could actually read?

The New York Times has a fantastic English language demo on how to view a hand scroll.

Process

I chose one of China’s most iconic scrolls, the Admonitions of the Instructress to the Court Ladies, attributed to Gu Kaizhi (ca. 345-406) with text by Zhang Hua (232-300). This version was copied a few hundred years after Gu Kaizhi. Sadly, the original is lost. There are multiple copies of this scroll, but I selected the most well known copy, which was owned by the Qianlong Emperor (1711-1799), stolen after the Boxer Rebellion, and now lives at the British Museum an ocean away (stolen artwork at museums is a topic for a whole other blog post). The scroll is a political commentary originally meant for the murderous Empress Jia (257-300). It gives instructions on how a palace lady ought to behave, and has some hilarious advice that would make One Direction proud, like “The ‘beautiful wife who knew herself to be beautiful’ Was soon hated.”

I carried out localization in Photoshop, making thorough use of its “content aware fill” and “flip horizontally” functions. To flip some of the seals, I used a magic wand to select the right color elements.

The translation is sourced from an official translation by Shane McCausland, which is what the British Museum uses for the scroll’s main section. When no official translations were available, I made my own, such as the frontispiece that reads, “For the ladies of the court.” I considered translating the seals as well, but eventually decided against it because they would mostly be untranslatable names. Plus the Chinese is prettier. Maybe in a future iteration, I’ll experiment and try my hand at stamp effects.

Translated Qianlong stamps
An early experimentation with English seals

One of the toughest parts of the projects was deciding fonts. This wasn’t a transcreation project; I’m not trying to fool anyone into thinking this is a European artwork. If you’re interested in China-Europe art mashups, though, check out Emperor Qianlong’s court artist Giuseppe Castiglione (Lang Shining). I mulled back and forth between trying to find fonts that resembled brushwork, versus medieval block text. For the font of the main text, I chose a font common with Roman scribes of the same time period.

Comparison of original Chinese and European calligraphy
Fun fact: the font for Xiang Yuanbian’s (1525-90) inscription is based on the handwriting of Queen Isabella I of Castile (1451-1504)

Extra Thoughts

I worry some people might look at my localized version, especially my clumsy handwriting at the end, and think, “But…but you ruined it!” And that’s precisely the point. Scrolls are meant to be cut, rebound, scribbled over with drunken ramblings, and stamped with seals that scream, “I was here!” Maybe even totally modernized like Dai Xiang’s reinterpretation of that Qingming along the River scroll I mentioned. They’re a participatory event. If you want to join the conversation, leave a comment below!

Localizing Maps

Maps: they seem straightforward, but make one wrong move, and you might find yourself in hot water. Microsoft lost millions because it colored 8 pixels a different color on a map, and in this video, localization expert Robert Derf mentions how executives at his company’s Argentina office were arrested because their map was a few pixels off.

Me and a team of project management learners recently tried our hand at simulating localization project management for a company called Hipcamp, and one of the more fun and creative elements involved adapting maps for different markets. I carried out this proof-of-concept desktop publishing experiment in Photoshop, utilizing content aware fill to supplement missing elements of the image and sourcing replacement maps from the public domain.

Please note: These maps are proof-of-concept only.
The text is a machine translation.

Source

Hipcamp About Us, Accessed November 3rd, 2020, https://www.hipcamp.com/about#our-story

Source: map of the U.S.

Spanish: US

For a Spanish speaking, US locale, I added Puerto Rico to the map and the text. We would also likely recommend that the client add Puerto Rico to the English version of their map.

Map of the U.S. with Puerto Rico

German

The map I created for Western audiences like German speaking locales features an Atlantic-centric map with modified text. Though the source text had borders for states, I decided not to include borders to avoid territorial dispute issues.

Atlantic centric map

Japanese

The Japanese locale map is customized with a Pacific-centric map. Some localizers skip this step and use the same Atlantic-centric map for all their global locales, but Asian audiences will notice if you forget!

Pacific centric map

It was enjoyable to discuss the potential pros and cons of different internationalization strategies with my team. Plus I got to brush up on my Photoshop skills.

Artificial Intelligence

Mediapipe Holistic test
Screenshot selfie on Mediapipe Holistic’s demo page

A couple days ago, Google blogged about a technology it’s working on: MediaPipe Holistic. It caught my eye because the post featured a gif of the technology being used to detect body, face, and hand motions of a prominent American Sign Language (ASL) instructor, Dr. Bill Vicars (I highly recommend his website, lifeprint.com to anyone interested in learning more about sign). Google claims MediaPipe Holistic can detect human poses, facial expressions, and hand motions in real time.

Does this mean we’ll have ASL versions of Google Translate and Google Assistant? Will Dr. Vicars be able to auto-grade his students’ ASL homework assignment videos? Probably not anytime soon.

This isn’t a new technology, just three old technologies combined. First: it detects your overall body shape and creates a stick figure pose outline. Next it identifies where your face and hands are, and creates a skeleton of your hand joint landmarks and a more detailed grid outline of your face. So far, that’s all it does. No translation capabilities. Yet.

Right now, the technology is just a clunky proof of concept. You can try it out on their demo page like I did. What it does do is show that computers can do a fairly decent job of detecting what your face and hands are doing, even from different camera angles and perspectives. Somewhere far down the road, we might be able to assign these hand and face shapes meaning values in a database.

Traditionally, translation has focused solely on text, but what about emotion? ASL is a great example because it’s a language for which physical details like eyebrow placement are important grammatical components. Spoken languages could also benefit from paying closer attention to emotion as well: there’s a big difference between widening your eyes and waving your hands, smiling, “fantastic!” versus heaving your shoulders in a sigh, rolling your eyes, and saying “fantastic.”

ProjectFluent

Usually, the text translators work with is separated from the code where it’s ultimately published. Let’s be honest: many translators and linguists don’t know how to code. But what if your translation team is tech-savvy? Mozilla developed a localization system that helps create customizable code for the grammar of different languages: Fluent. The system is now Mozilla’s baseline software for web-based localization projects.

What does Fluent do differently? In traditional localization, there is often an expectation that there is a 1-to-1 equivalency for every source and target language. This just isn’t the case. Take for example, the article “the” in English, which would vary in German based on gender: “der,” “die,” or “das.” Chinese has no “the” article.

Fluent works well for text that is customized for a user based on permutations like numbers, dates, seasons, or gender. I experimented with Fluent’s “playground” to create messages for blood donors. The message can be customized based on name, donation type, blood type, and usage stage. Here are a few examples of the text in-action.

Dex donated red blood cells. He has O+ blood, so he gets a customized message about his special blood-type. His blood is currently in the testing stage.

Dex's customized message code

Billy donated whole blood, with a blood type of A+ (no extra special message for him, but he is complimented for being a hero).

Billy's generic message code

Qian donated platelets. She has O- blood, so she gets a customized message too. Unfortunately, her donation was transported improperly and had to be thrown out. Rather than give too many unhappy details, this message encourages her to donate again with a generic, “Your donation saves lives” message.

Qian's customized message code

In our increasingly digitized, world, translators roles are quickly adapting. It’s exciting to see ways we can build internationalization into code early on rather than treat it as an afterthought.

CAT Tools: Translating a Disability Housing App in Trados Studio

Me and my team of tech superstars were drawn to a local disability organization called L’Arche Wavecrest, which provides services and housing for individuals with intellectual and developmental disabilities (I/DDs for short). Wavecrest has a sizable Chinese-speaking population, but the organization’s website only offers information in English and Spanish, and thus our translation journey began!

Our team worked together to produce a Chinese language version of L’Arche Wavecrest’s information pamphlet and housing application. In addition to translating the text itself, we also simulated creating a project proposal/quote (though we donated the translation for free), generated a termbase, and created a translation memory (TM) in a computer assisted translation (CAT) tool called Trados Studio.


Here’s a brief video about our translation process and the lessons we learned along the way