This weekend I served as a judge for Come Out and Play, an experimental urban games festival held in a different location around New York every year. During the course of the festival, I had an experience that I think might be worth describing for developers thinking about the native apps vs. web apps debate. It was an experience that confirmed everything that's lead me to want to learn to build iPhone apps rather than sticking with web apps for mobile development.
The experience of trying to play this game pointed out everything that is inferior about the web app experience vs. the native experience. And not as minor technical annoyances, but in a way that completely ruined the experience of the game.
(Note: none of what follows is meant as a criticism of Pathfindr's developers. I think they are diligent individuals who's only mistake was naively believing all of the hype around web apps as a solution for mobile development. In fact the game works so well as a case study because they seem to have done everything exactly how the current conventional wisdom would have them do it.)
The app consisted of a series of menus, styled to resemble native iPhone UI, through which you signed up for the site with an email address and password and chose which game iteration you wanted to join or resume (they'd run Pathfindr once before in Minneapolis as a tour of notable locations in the life of F. Scott Fitzgerald). Once you reached a game, the play took place on a satellite map where a set of markers appeared noting three checkpoints that you had to visit in turn and a series of questions you had to answer along the way about things in the local environment. In order to eliminate a checkpoint or answer one of the questions, you had to get within a certain distance of the marker on the map and then tap that marker. The map also displayed the blue iPhone-style "you are here" indicator. The game took us an hour and a half to complete and stretched from the Brooklyn Lyceum, where the festival was based, all the way to Grand Army Plaza at the entrance of Prospect Park.
Here is a rundown of the technical problems we encountered in the course of the game:
The web app was slow. Pages took a long time to load from the server with each new question or with new map tiles when you tried to move around the map. This was not caused by the rate of the iPhone 3G connection (other pages, such as Google, loaded perfectly rapidly), but because of the 20 or 30 people simultaneously accessing the site over-and-over. The problem was worst when all the teams were standing together and trying to register at the start of the game and was slightly mitigated over the course of 90 minutes as we spread out around the course.
The app was unresponsive. Dragging and zooming around the map was sludgy and painful. Redraws took forever.
The GPS location was jumpy and inaccurate. Far worse than I've ever seen it in the iPhone Maps application or any native iPhone app that uses location.
The app sucked battery life. In an hour and a half of playing it killed one phone completely dead from about a 30% charge and was close to killing a second one.
The app's map UI was non-standard and confusing. It used satellite-only tiles which made navigation difficult; accidentally tapping the blue "you are here" dot would zoom the map all the way out, which was extremely annoying; it had extra chrome within Mobile Safari's chrome leaving only tiniest number of pixels available for the actual map.
At one point, someone in our team accidentally closed the app's tab while trying to do a google search as part of the game. We had to suffer through lost state within the game that required four or five page loads to get back to where we were and hence about 5 minutes of sitting still with 5 people all hovering around a phone.
Overall, the sludginess of the web app experience meant that, in a game designed to take us out into the neighborhood, make us more attentive to the landmarks around us, and force us to collaborate with a group of strangers, we spent a large amount of the time staring at the phone's tiny screen, waiting for pages to load. The technology's flaws overcame the game's virtues and severely damaged the experience.
I'm sure mobile web app performance experts could explain a number of ways in which Pathfindr's developers could have improved their app to avoid some of the problems I mention here. However, one of the main talking points for mobile web apps is always that developers "already know how to make them". And talking to the one of the developers after the game, he touted the fact that they'd been able to build the first version of the game platform in only a few days' development time. If there are a bunch of new skills that an average web developer will have to learn to build an effective mobile web app, then that goes a long way to mitigating the advantages of their existing experience and it makes the argument for web apps seem a lot more like an argument for familiarity rather than ease of use.
Again, the Pathfindr team was professional and polished. Their app had obviously been the subject of a great deal of loving care. Give them the benefit of the doubt. The problems with the app didn't derive from their incompetence, but from current limits in mobile browser technology in this kind of situation.
Also, as someone who's just started learning iPhone development, there was nothing in the game that was beyond the level of the first four or five chapters of a good intro iPhone development book, for example Big Nerd Ranch's iPhone Programming Guide, which I'm currently in the process of working through.
In less than a weeks' time, a dedicated developer just getting started on the iPhone could have built a native app with much the same functionality as Pathfindr's web app that would not have suffered from any of the problems I describe above. And for an experienced iPhone dev, the process would have been more like the one or two days Pathfindr themselves took.
What about device independence? In the case of Pathfindr's audience at Come Out and Play, at least, nearly every single participant used an iPhone. There may have been one or two Android players, but I didn't see them. They'd advertised the game as "smart phone-only" and said they'd tested it on Android, iPhone, and Palm Pre Plus. A few people with Blackberries came thinking they might qualify, but had to be turned away or added onto teams of players with iPhones. With the incredible battery usage my team saw, I can't imagine that an Android team would even have been able to finish the course (especially with what I've heard about the HTC 4G).
The result on the ground, then, was an application that was the worst of both worlds: device-limited without the benefits of device-specific design. It had all the performance disadvantages of a web app that I've outlined above with none of the imagined benefits of cross-device compatibility.
Advocates of web applications as the solution for mobile development need to do some observations of real world scenarios like this before they convince more developers that native apps are unnecessary or evil in some way. The new creative and surprising uses to which a big games festival like Come Out and Play puts mobile apps is a terrific proving ground for development platforms.
For my part, I want mobile apps to be weirder and more fun than their desktop ancestors and to explore all the new affordances offered by the position of phones and new devices in urban space and in our lives. And I'll take whatever development platform keeps the battery running, the GPS coordinates flowing, and the sensors sensing. Right now that means native apps.