Why OpenStreetMap matters: Where did Dokdo go?

One of the rocky outcrops under dispute. Photo // CC BY NC

Battle lines have always been drawn over maps. Place names are political, cultural, temporal: from Constantinople to Istanbul and Burma to Myanmar what a place is called matters.

In the digital age, however, you have no idea who is behind the changes and why.  The companies that make the maps millions of people use every day change names following opaque processes that appear to depend on who lobbies loudest at the moment. It’s a strong argument for free, public, editable maps like OpenStreetMap where both the changes and the debate are transparent.

About a week ago, I spotted this poster petitioning Google to put Dokdo back on the map at San Francisco’s Korean American Community Center of San Francisco & Bay Area.

They’re a small group of islets off the coast of South Korea with a host of potential names. The Korean name for them is Dokdo, in Japan it’s Takeshima; Liancourt comes from a whaling-era French ship that almost wrecked on these jagged rocks.

In 2012, the centuries-old fight between Korea and Japan went digital and, bowing to pressure, Apple Maps and Google Maps changed the name from Dokdo to Liancourt Rocks. The drive to change it back hasn’t ebbed, as recent as April 2018 the islands cropped up in a dessert that didn’t sit well with Japanese diplomats.

The Silicon Valley companies who reside roughly 5,400 miles away from the contentious spot never publicly stated why. And if this sounds like just arcane name-calling – at stake are fishing rights, resource rights, national security rights. (The dissection of why this matters in “Prisoners of Geography” is definitely worth a read.)

Considering the 2012 date on the poster, I wondered whether the question had been settled. Nope. Open up the map that’s an extension of your brain (aka your smartphone) and neither Google Maps or Apple Maps will get you to Dokdo.

Google does a slightly better job, at least acknowledging that the place you’re looking for when you type in Dokdo is what they’ve decided to call Liancourt Rocks.

Apple Maps assumes its users have fat fingers and shows places with “Tokyo” in the name.
The exception: if you’re searching close to South Korea, it directs you to the Dodko Museum, dedicated to the territorial question.
On OpenStreetMap, by contrast, you’ll find Dokdo.
Even if you’re not logged in, you can see when the last edit was made. Sign up for a free account and you can see the history of the edits and join the discussion. The last tag on the page shows what the “wrong name” is.
It’s not perfect. If you search for Liancourt Rocks, it’s a little confusing because there are no results on OpenStreetMap but there’s a result from database GeoNames.
Looking up just “Liancourt” gets you two OSM results  in France, with the GeoNames entries “Liancourt Rocks” rolling through France, Canada and Haiti before getting to the search term.
There’s a lot more to be done — for starters, getting OpenStreetMap as the every-pocket cellphone map. For an itch-scratching project, I’m testing a bunch of OSM-friendly apps (mainly for editing but most also provide navigation) and there is a ways to go.

But until Google and Apple launch open, community-driven forums for questions surrounding map making (much like they are proprietary-driven companies but still have open-source departments) OSM willl be the fairest, most transparent public map around.

 

Quick preview of forthcoming book “All Over the Map: A Cartographic Odyssey”

Most of us have swerved a few wrong turns or hacked through some questionable trails and cursed the map. Most of us, though, wouldn’t spend seven years and engage dozens of experts to make a better one.

Then again, most of us aren’t Bradford Washburn. This climb-every-mountain polymath was let down by the sketchy trail maps of the Grand Canyon available in 1969. At the time, age 60 and director of the Boston Science Museum, he knew what made a good map. Washburn was the first climber to scale 20,320-foot Denali and his map of the peak is still considered the definitive map of the region. A pioneer in aerial photography, he’d go on to map Mount Everest and the Presidential Range.

But it’s his National Geographic Grand Canyon map, finally published in 1978, that illustrates his “extreme dedication to the craft of map making” says Betsy Mason, co-author of Nat Geo’s All over the Map blog. Mason previewed one of the 80 stories and showed off some of the 200 maps from forthcoming book she wrote with colleague Greg Miller titled “All Over the Map: A Cartographic Odyssey” at the recent California Map Society spring meeting.

It was the best of crowds (people who readily chime in with the correct pronunciation of “theodolite” and already grasp the merits of hachuring) and the worst of crowds (after lunch on a warm Saturday) but the story behind the Grand Canyon map kept people mostly awake and ready to push over the 45-minute session limit with questions.

Mason and Miller first started the Map Lab blog back at Wired, then moved it over to National Geographic in 2013. Mason, taken with Washburn’s Grand Canyon map the first time she saw it, went archive diving at her new employer’s and found a “huge trove of boxes” about the making of the map.

Photo brewbooks on Flickr. // CC BY NC

She spotted Washburn’s pitch to fund the Grand Canyon map describing the most current 1962 map (at a scale of 1 inch = 1 mile with 80-foot contour lines) as “simply inadequate” and “disturbing” for the “incredibly rough country” with “extremely intricate trails.” His map would be an “exciting addition to world cartography and one of the most magnificent cartographic challenges.”

Komo Point. Washburn’s reference point – a globe core – used for aerial photography still marks the spot. Photo brewbooks on Flickr. // CC BY NC

The acceptance for his proposal was swift, but that was the only thing that happened fast. By the time Washburn and his intrepid volunteers had spent 147 days in the canyon, made over 700 helicopter landings and mapped 100 miles of trail, the original $30,000 cost had already ballooned to $100,000 (about $500,000 today, Mason says.)

“The hardest part was to come. Turning the field work into a map would turn out to be just as laborious,” Mason says. The tech and techniques involved in the Grand Canyon map are as fascinating as they are unfathomable to software-driven mappers today — for starters, translating aerial photos and surveying information into contouring sheets by hand etching them. Those sheets were then condensed into one map at a scale of 2,000 feet per inch with 50-foot contours. You’ll have to check out the book for more on the artistry of rendering the curves and dips of the canyon leading to the published version of the map, which was not a commercial success.

As map lovers who are journalists, Mason and Miller focused on digging up the stories behind the maps rather than on history or cartography. Some of the maps she previewed included pioneering neuroscientist Santiago Ramón y Cajal’s 19th-century map of the retina and Jerry Gretzinger’s map of a fictional world — 50 years in the making and counting.

You’ll be able to wrap your hands around the hardcover “All Over the Map: A Cartographic Odyssey” on October 23, 2018 — in time to put it on your holiday gift lists and make room on the coffee table.

Mapping UNESCO’s Intangible Cultural Heritage spots

Looking at the most recent UNESCO Representative List of the Intangible Cultural Heritage of Humanity it’s clear that these “elements,” as they’re called, are all over the map.

There’s painting, weaving, pizza making and spring rituals: but while they offer up videos, photos and text — there’s no actual map of these landmarks in sight.

Making that map shines a spotlight on why organizing data is crucial — and how every organization is a data trove and should be its own best data detective. Plotting visually can inform decision making and highlight patterns – inside trends to be worked into deeper groves or used to recalucate course. The list, according to UNESCO, is “made up of those intangible heritage elements that help demonstrate the diversity of this heritage and raise awareness about its importance.”


Get them into a spreadsheet (more on this below) and a couple of things jump out. First, most of the 2017 picks reside in Europe/Eurasia with a substantial scattering in Asia but only a handful in Africa and South America combined.

The other is that the bulk of 2017 intangibles are rituals of some kind (15) followed by music (8) crafts (7) then dance, food, games (3 each) art (2) and a justice system.  The total adds up to over 33 because they are practiced in more than one country, another reason it’s interesting to connect the dots on a map.

These classifications are mine and while a handful are arguably more than one category (is the “art of crafting and playing a musical instrument” an art, a craft or music?) the obfuscating language does a disservice to these traditions.

The third, following from the other two points, is that the list is profoundly political.

Take two of the 2017 foods. Well, I’m calling them that: technically, pizza isn’t on the list, it’s the “art of the Neapolitan pizzaiuolo.”  (Nowhere in the official entry is the product of this art mentioned.) According to the New York Times, the pizza makers of Naples owe the honor to Pier Luigi Petrillo, an Italian professor and expert in “lobbying theories and techniques,” who has three winning UNESCO bids under his belt — the Mediterranean diet and Zibibbo wine-making in Sicily.

Similarly, there’s “dolma making and sharing” in Azerbaijan. More so than the pizza — whose most classic version mimics the Italian flag — dolmas are one of those foods associated with entire regions rather than a single country. The Oxford Dictionary, for example, defines dolmas as “popular in the Balkans, the Caucasus, and the eastern Mediterranean.” The Encyclopedia Britannica is more restrictive – limiting it to “Middle Eastern and Greek cuisine” yet Wikipedia defines them broadly as “a family of stuffed vegetable dishes common in the Mediterranean cuisine and surrounding regions including the Balkans, the Caucasus, Russia, Central Asia and Middle East.” All note the term hails from Greek/Turkish origins.

It’s hard to say what the consequences of being awarded intangible treasure status are, but in this case it does seem — like Iran, awarded in this round a game called Chogan that Wikipedia re-directs to polo – that they could be contentious.

For someone with more patience: since 2008 when the quest to list intangibles began, there are 470 elements in 117 countries, it’d be interesting to see a good representation of the geographical distribution to date and see what pops out. This Wikimedia map takes a stab at it, but the color coding is eye-crossing at best. (You’ll also notice that neither the United States nor Canada have any intangibles — although they’re UNESCO members, they didn’t join the nominating countries for this project.) Continue reading

Five-minute map: San Francisco’s proposed Uber/Lyft loading zones

Update: March 23, 2018. A pilot zone geofencing Lyft drivers from picking up passengers on Valencia Street has been added in the Mission. Source: Examiner.com

If you drive, walk or bike in San Francisco you know what a nightmare the ride-hailing services can be.

And if you use them often you’re probably in the habit of trying to pin yourself on a side street or a big empty parking space/driveway and pray they don’t double park while trying to find you. (Zipping past the anecdotal, it’s been calculated that 45,000 Uber and Lyft vehicles now operating in San Francisco account for more than 200,000 trips a day.)

So now the city is interested in adding ride-hailing passenger pick-up zones in a horse- trading effort to wring more data from these startups.

The San Francisco Examiner reports there are seven proposed “loading zones” and maybe one or two will be piloted. It’s a well-reported story — except that it’s missing a map. The neighborhoods are Hayes Valley, Inner Richmond, Inner Sunset, Noe Valley, North Beach, Marina and downtown.

Five minutes later with Google Maps:

A few things jump out — there’s nothing in the traffic-choked Mission district (see update above) and two “maybes” downtown. (The mapped one on Howard Street above and another potential one left unmapped since it’s described as “between Howard and Third or Fourth streets.”)

Also, once they’re mapped, if you zoom in it’s apparent that the length of these zones varies widely. The North Beach one looks like road rage waiting to happen.

San Francisco does have passenger loading zones already — white curbs with a time limit of five minutes — which in my armchair estimation (and the name “curbs”) says they’re mostly shorter than the approximately 600 feet (two blocks) of the shortest ride-hailing zones in the Richmond and Sunset…

Thoughts?

Full story over at The Examiner.

What’s under the canals of Venice? Old boats, tires and a few surprises

Image courtesy Ismar-Cnr.

Most visitors to Venice drift through the canals on gondolas taking selfies. But a group of researchers spent seven months puttering along pointing high-resolution multibeam echosounders into the waters instead. About 30 of them in all worked aboard the powerboat Litus, intent on mapping the Venice lagoon to gauge the effects of climate change on one of the world’s most improbable cities.

Research boat Litus, courtesy Ismar-CNR

While what’s under those gray-green waters isn’t exactly surprising — boat parts, old tires and containers — scientists say the underwater elevation mapping (that’s “bathymetry,” for the technically minded) comes at a critical time.

Old boats, tires and containers. Image courtesy Ismar-Cnr.

The last 100 years have radically altered the shape and ecological makeup of the lagoon, researchers say: for starters, salt marsh areas shrunk by half and underlying sediment has radically shifted. The “floating city” already struggles to stay above water in the spring and summer floods and relative sea level rise is expected to increase their frequency. The Mose system, with its 78 mobile gates that can hold back almost 10 feet of water, construction launched in 2003 and is said to be near completion in 2018.

Entrance to Malamocco port 1) Mose gate 2) 48-meter (157-foot) trench 3) the oil refinery canal. Image courtesy Ismar-Cnr.

“Before the Mose system begins to function, it was important to have a full picture of the bathymetry and currents of the tidal channels and inlets, which are the most dynamic portion of the lagoon,” researchers say in a paper published in “Nature.” They caution that the relatively rapid erosive process could threaten the stability of the “hard structures” (read: priceless palazzos) in the near future and should certainly be periodically monitored.

If you want to dig into the datasets, the scientists from research groups (Ismar-Cnr and Iim) have CC-licensed and made them available online with the paper.

A scour hole found where two channels meet. Image courtesy Ismar-Cnr.

“The data also allows us to identify areas with large dunes at the bottom and adjacent erosion sites that document the most dynamic points in the deep lagoon, where it’s important to cyclically repeat these studies to quantify the movement of sediments,” head of the study Fantina Madricardo says in the press release (translation mine.)

Part of the reason these Venice maps look so trippy (or alarming?) is due to the city’s curious geography, perching atop 118 islands bridged by canals. On most bathymetric maps, deeper waters are represented by soothing darker shades (green, blue, violet) and warmer colors (red, orange, yellow) represent shallower waters. A bathymetric map of the San Francisco Bay by comparison looks, well, a lot more soothing despite its notorious currents.

How to investigate your government through algorithms

Some kinds of reporting-by-the-numbers are anything but lazy. Take investigations looking into algorithms — examining the formulas used by the government to determine who is more likely to commit a crime or how likely your building is to have a fire inspection.

Speaking at the recent International Festival of Journalism, Nick Diakopoulos, assistant professor at the University of Maryland’s Philip Merrill College of Journalism and a member of its Human Computer Interaction Lab, gave a solid primer on how to get started.

He’s been studying the wider reach of algorithms in society, government and industry for about four years, coming at it from a computer science background as a “techie who worked my way into journalism.” Boyish, bespectacled and occasionally prone to professorial turns of phrase like “algorithmic accountability,” Diakopoulos offered a look into the numbers that shape our lives. Continue reading

Crooked! Donald Trump’s most recent insults as a word cloud

UPDATE: The Times is still tracking the list of insults — as of January 2017 it grew to 305 — and added a visualization that shows the kinds of people and things most frequently insulted. (Spoiler alert: journalists and Democrats.)

The reporters at the New York Times combed through Republican presidential nominee Donald Trump’s Twitter feed for the most recent 250 insults to nations, people and random things – including a podium.

NYtimesThis is the kind of story that cries out for a visual representation – there has to be a better way to process the information than listing names of the people he insulted in alphabetical order and the tweets as quotes underneath them. What story does that tell?

Most commonly used words in Trump insults, by frequency.

Most commonly used words in Trump insults, by frequency. By Nicole Martinelli, via Wordle.

A quick word cloud will tell you that the most common insult for the straight-talking New Yorker is “crooked” (his go-to insult for rival Hillary Clinton) followed by “dishonest,” “bad,” and “failing.”

A couple of necessary caveats: this cloud was made with a tool called Wordle and the size of the word corresponds to the number of times it appears in the text. The text in the graphic was copied and pasted from the article on the NYT site without any additional weighting or manipulation. The program automatically cuts out common words (i.e. articles) but it would be interesting to see how the cloud shifts by cutting some filler words like “new” “news” “many” “another” etc.

Digital publishing gives public figures so many ways to broadcast a message – it’s our job as journalists to make sense of it. What would you trawl through other political figures tweets to understand?

Digital mapping finally blossoms for parks and rec

CC-licensed, thanks to KM on Flickr.

CC-licensed, thanks to KM on Flickr

If you went by the maps available today your smartphone, you’d probably think the era of paper maps went out with the Rubik’s Cube.

But the next time you’re in a garden or park, you might come across a group of volunteers huddled around an 11×17 black-and-white printout, hopelessly trying to verify what should be where, clumsily marking it up with pencils and colored highlighters. Their work trails back indoors where it adds to a pile of similar maps that have to be verified (or interpreted?) before changes are put into the data base. They are often printed out and verified again for accuracy.

The hateful verification map, SFBG.

A hateful paper verification map, SFBG.

That’s why around 40 people from zoos, gardens and parks from around the world came to a recent talk to hear how Steve Gensler, GIS manager of the San Francisco Botanical Gardens, and Veronica Nixon of the Desert Botanical Garden in Phoenix are using Collector for ArcGIS to maintaining botanical garden plant records at the ESRI User Conference.

Continue reading

The Associated Press Stylebook weighs in on data journalism

bye3nzmg6q355a3splxzCC-licensed, via hatalamas on Flickr.

If you write about tech, you’ll find the Associated Press Stylebook is a little bit like Dear Abby. By the time the bouffant-hair-and-matching-handbag set gets around to addressing an issue, it’s often already been answered by collective common sense.

Still, it’s nice to see the venerable news organization writing about data journalism in the same update where it finally relinquishes capitalizing the word internet.

The AP Stylebook entry on data journalism, added 2016-04-19, weighs in at just under 500 words.

It begins with six rules for evaluating a data set that range from the very basic (“What is the source?”) to the kind of deep dive that may prevent you from ever filing the story (“Is there a data dictionary or record layout document for the data set – which would describe the fields, types of data they contain and details and announcing detail as indicated?”) Side note: If you’re looking for an entire book of how to present data facts and figures for journalists, my favorite is still “The Wall Street journal guide to information graphics: the dos and don’ts of presenting data, facts, and figures” by Dona M Wong. [public library]

 

Screen Shot 2016-06-02 at 1.47.30 PM

The next section launches into the math of doing data journalism, a reminder that word people are often not numbers people. Or a reminder to all that, yeah, elementary school math is good to know.

“Avoid percentage and percent change comparisons from a small base. Rankings should include raw numbers to provide a sense of relative importance.
When comparing dollar amounts across time, be sure to adjust for inflation. When using averages (that is, adding together a group of numbers and dividing the sum by the quantity of numbers in the group), be wary of extreme, outlier values that may unfairly skew the result. It may be better to use the median (the middle number among all the numbers being considered) if there is a large difference between the average (mean) and the median.”

It heads into more advanced territory with a paragraph on causality, rounding numbers and sample size before winding up with a solid reminder for data-happy hacks: “Try not to include too many numbers in a single sentence or paragraph.”

Now we only have to wait and see how the Stylebook passes judgement on the proper abbreviation for “internet of things.”