In my last post I did quick sketches of 14 Facebook apps with a local-search element. I’m not considering Loladex at the moment, because we just launched.
OK, time for a reality check. (You may be depressed by the following.)
The most popular app of the bunch, TripAdvisor’s Local Picks, has fewer than 2,000 “active” users = daily users, more or less. Per Adonomics, it’s the 859th-ranked application on Facebook right now, lagging behind things like Vibrating Hamster at #673.
Like many Facebook apps, Local Picks rose fast and fell fast. At one point in December 2007, it clocked more than 100,000 active users, but it’s fallen below 10,000 for most of 2008 — below 5,000 for the past two months.
More worrisome is the fact that, despite its collapse, Local Picks still has more daily users than the other 13 apps on my list combined. Almost twice as many, in fact.
The second most popular app on my list is Restaurants by Hungry Machine with more than 500 daily users, down from a peak of more than 10,000.
And that application, in turn, has as many users as the remaining 12 apps combined.
In short, local-search usage on Facebook is loooooow right now. And it’s heavily concentrated in a couple of apps, both of which have cratered in 2008. Based on Adonomics charts, I suspect that only a few other apps have any life in them:
• DoYa? may be building a bit, perhaps based on its gift-cert giveaway
• My Restaurants looks to have a small core of regular users that isn’t shrinking
• iEat seems to be growing somewhat
But obviously, the numbers here are fairly inconsequential. DoYa? is the biggest of the three, with 215 active users.
So — yikes, right?
Yes and no.
On the one hand, it’s easy to see how Jon Carder of MojoPages concluded that local search isn’t worth doing on Facebook. (See earlier post.) On the other hand, I think we can learn some things that’ll help us crack the code:
• Recognize the potential. Local Picks is a good app, and it grew nicely in November and December to top 100,000 active users. That’s a number worth noting. OK, in December it suddenly crashed. Maybe someone can tell me why?
• Leverage success. The two biggest apps have more popular “sibling” products on Facebook; none of the others do. Hungry Machine explicitly presents its apps as part of a family, using a toolbar to link between them. TripAdvisor doesn’t do this, but it does some lesser cross-promotion from Cities I’ve Visited. Most of us can’t draft off an earlier app, but there are other ways to apply the lesson.
• Attract repeat users. Most local apps either never took off, or peaked and then fell off a cliff. But several — Eating and Hangouts, for instance — took off and then went into a slow fade. While a fade isn’t as good as a rise, it’s better than falling off a cliff: These apps didn’t lose people immediately. Interestingly, they share a focus on broadcasting “status”-type messages, which may be a key to keeping users engaged.
• Keep working the problem. It’s striking how many Facebook apps are abandoned, more or less, once they start losing users. The charts tell the story: No secondary upward blips as new solutions are tried. The users are allowed to melt away. This isn’t limited to local, of course. Building a Facebook app is an experiment rather than a strategy for many developers, and it shows. But given the potential of local — and its importance to some of these players — I’d expect a bit more dedication to figuring out what works.
That’s the end of this little series of posts. Soon I’ll tackle the question of how Loladex can avoid the fate of its Facebook competitors.
So who’s doing local search apps on Facebook? What follows is my brief impression of various local apps I’ve used in the past few months. I’m sure my list is incomplete. If I’ve missed something obvious, feel free to add it in the comments.
In my opinion, no one on this list competes with Loladex’s combination of functionality, comprehensive content and usability. Oh, and style. But of course I would think that.
This list is in no particular order.
MojoPages: Based on Jon Carder’s comments (see my earlier post), MojoPages is’t pushing this app anymore. It’s a bit of a shame, because (a) they put some thought into it, improving it since it launched some months ago; and (b) the MojoPages.com site continues to push some social aspects that are, in my opinion, better suited to Facebook than to their standalone version. It’s true that the FB app never got any traffic, and the execution still needs work, but I thought it deserved more promotion than they gave it.
Local Reviews: On its splash page, this app by eSesame claims to be “Facebook’s FIRST and LARGEST Local Reviews App!” Even if this was true once, by some measure, it isn’t anymore. It seems downright moribund, in fact. I find the interface a bit confusing and scattered, and the content is limited to a tight selection of categories and cities. Even in these areas, they don’t have comprehensive data — searching for Chinese restaurants in the Washington, DC area yields a single result, for instance. I guess they have just what their users enter?
Restaurant Reviews: As the name implies, limited to restaurants. This app comes from SuperPages.com, which is certainly a credible source, but it never got off the ground. I’m not sure why they restricted it to a single category since they have the whole phone book at their disposal, literally. The app is presented mostly as a way of browsing places that have reviews: You’ll need to click to uncover a search box. It’s mostly a window into user comments from the regular SuperPages site, so there are few associations with actual Facebook users. Not very social.
Local Picks: From TripAdvisor, the king of hotel reviews. Limited to restaurants, despite the generic name — base data from the worldwide but long-in-the-tooth ChefMoz database, perhaps, supplemented by members? (Someone correct me if I’m wrong.) Users appear to be griping that their additions and deletions aren’t processed quickly enough by TripAdvisor, which is also my experience with the TripAdvisor hotel database. Still, it must be said that this is a very nice Facebook app: Deep, engaging, well-designed. They are making an effort, and they have more users than most local apps. TripAdvisor also makes the “Cities I’ve Visited” app, which is far more popular but not nearly as useful.
iVouch: I recall that this app used to be a local thing, where users “vouched” for businesses, but lately it’s about users vouching for each other. The local aspect still exists, but has been subordinated. It’s not particularly useful, in any case, as I can’t search for places that others have vouched for. Or I don’t think I can, anyway. Strange. Either the app isn’t fully conceived or I’m missing something.
Search Local: This is a fairly straightforward Yellow Pages app, except that it doesn’t seem to have much data. (Or maybe its search doesn’t work properly.) Its main distinction is that it wants to broadcast all your searches to your friends’ news feeds. This may or may not be good for virality — not, I’d guess, based on its traffic — but either way it’s a bad idea. No one wants this stuff to be public by default. They have an opt-out checkbox, but it’s easy to forget and I can’t set it to opt out permanently.
DoYa? This app has some of the same ideas as Loladex. They’re trying to jump-start virality by offering $10 Amazon gift cards to people who “share” five recommendations with 10 friends. Depending on how many of those friends become DoYa users, it might make sense. I’m not crazy about the interface, but that’s mostly a matter of taste. They’re on the right track.
Eat It! Is this app working as designed? It’s a restaurant-only product by big ol’ CitySearch, and someone spent time on it, but it lacks all of CitySearch’s deep content for each listing — no information about restaurant hours, no professional reviews, no user ratings, no photos, nothing. Just an address. Whole features like “QuickRate” appear to be pretty much broken, too. Weird. I have a vague memory that it used to work, but until today I hadn’t visited it for months. Maybe its creators haven’t visited lately, either?
Eating: Yet another restaurant-only app, this one by Menuism. It doesn’t take a local-search approach, exactly; it’s got a less utilitarian, more social vibe — more like one of the various “bookshelf” applications on Facebook, where people participate to express themselves and share their interests. Or like Yelp, except with more bona fide social networking. That’s my take, anyway. Like Loladex, it incorporates Facebook networks, which is a good way to open up more friend-like content. Data is far from comprehensive, however, and the sync to the “real” Menuism site seems imperfect.
Restaurants: Bulit by our neighbors in the nation’s capital, Hungry Machine LLC, creators of Visual Bookshelf. Once again, restaurants only. Once again, data is far from comprehensive. Annoying popups that ask me to invite friends. I don’t have many friends on the app, so it’s not clear to me whether their recommendations count more than those of strangers. Be nice if they did. (Anyone know?) Generic food photos are used to illustrate specific restaurants, which can be misleading: Our local chain Ledo Pizza, for instance, is known for its square pizza; they probably aren’t thrilled to be represented by a round pie. I’m not a fan of the overall design, which is busy, but the underlying functionality seems solid.
Following are some other apps that I haven’t used much yet, but that may be worth a look. None are “big” by Facebook standards.
[Added after initial post] Hangouts: OK, so this is Yelp’s application. It’s not a local search, just a way of broadcasting what you’re supposedly doing this evening, with a search that sometimes helps you link to the right listing. It launched fairly soon after the Facebook platform launch, and has the air of a side project rather than a committed effort. Functionality is shallow and requires going to Yelp.com for detail on listings. I could be wrong, but it seems to have been abandoned by Yelp. I assume that if they ever return to Facebook it’ll be with a different approach.
My Restaurants: A modest app that seems like it’s doing many things right.
Eat-a-Rama: Bills itself as the “top-rated restaurant application on Facebook,” whatever that means. At a glance I’m not a fan: Overdesigned & gimmicky. Someone is working hard, though.
iEat: This app doesn’t really appeal to me, either, but it’s a bit interesting because it has a two-level search. If it doesn’t find a restaurant in its database (a likely scenario, it seems), it does an “Internet search” and returns matches from … well, somewhere or other. I enjoyed the stock photos shown for each restaurant; see the one for Domino’s below:
While I’m at it, I should mention a few notable absences:
Yelp: As far as I know, Yelp has no app on Facebook. A few third-party apps try to track or broadcast your Yelp.com activity. See above; thanks, Jon.
Zagat: Zagat has a Facebook app, but it’s for use by restaurants rather than regular folks — the virtual equivalent of putting a “Zagat rated” sticker in your restaurant’s window.
Angie’s List: Not terribly surprising that AL doesn’t have an app; as a subscription site, it doesn’t really translate.
(Continued in Part 3)
Responding to our TechCrunch coverage last week, Jon Carder of our competitor MojoPages said the following:
Local search just isn’t gamey or sexy enough to make a local search Facebook App worth the time.
I disagree with this analysis on several levels. It’s true, so far, that many popular Facebook apps have a game-like aspect. And it’s true that their success can teach us some lessons.
But such apps are just the baby steps of social networking; the meaningful stuff lies ahead, when we’ve learned to walk. And run. And climb. And that’s definitely “worth the time.”
Indeed, I think it’ll make Facebook as a whole “worth the time.”
Social networking is already more than games. It allows our online actions to be informed and enhanced by the participation of our friends. The Web has become more like the real world.
In the case of local search, it means we can finally get advice from our friends — something we’ve always done offline, but that’s new on the Web.
Say you’re looking for a good Italian restaurant. Offline, you can consult the Yellow Pages. Online, you can do the same. You’ll find a restaurant, but not necessarily a good one.
Offline, you can see what’s recommended by the local newspaper or magazine. Online, you can do the same. They review a very limited number of places, however. (And beyond restaurants, virtually nothing.)
Offline, you can consult Zagat. Online, you can do the same. Or check Yelp. You’ll get the wisdom of a certain crowd.
Offline, you can seek recommendations from your friends. According to every poll, these are the recommendations you’ll actually trust — the advice you’ll actually take.
Yet until recently, it’s been pretty hard to do the same thing online. Facebook has made it easier. And increasingly, Facebook is where your friends are.
To me, that means Facebook is a great fit for local search.
Of course, we’re still figuring out how local search should work in a social environment. Jon observes:
The existing apps [on Facebook] are all fairly good, well designed and user friendly yet none of them is gaining any sustained traction.
I don’t agree with the “fairly good, well designed and user friendly” part, but it’s absolutely true that no one has gotten traction.
Why? I decided to survey the current apps to see if I can draw any conclusions.
(Continued in Part 2)
Lots of blogs covered our beta launch yesterday. Here are some highlights:
• Erick Schonfeld at TechCrunch got things started late on Tuesday evening. TechCrunch is one of the most widely read blogs covering the Web industry.
• The Washington Post’s Kim Hart wrote about us for the Post I.T. blog, and the newspaper’s WashBiz blog also noted our launch.
• VentureBeat weighed in with a Chris Morrison story; the blog is a leading source of news for venture capitalists.
• Darlene Darcy covered the news for the Washington Business Journal.
• Several of the top analysts in the local-search industry wrote about us: Peter Krasilovsky, Greg Sterling, Mike Boland, and Andrew Shotland. Peter’s post was also picked up by the Kelsey Group’s blog, where he works with Mike.
• We were excited to get coverage from local bloggers here in the Washington, DC area: Nick O’Neill of Social Times; Jimmy Gardner of East Coast Blogging; Frank Gruber of Somewhat Frank; Jessie Newburn at Hometown Columbia.
• Also we heard from Adam Metz at MetzMash, who focuses on social media; John Gartner at MarketingShift, an online marketing blog; the folks at KillerStartups; and TLCStudio.
Thanks, everyone, for being interested in Loladex. Did you see coverage anywhere else? Let us know …
So it’s official: Loladex is open to the world. Find the public beta of our Facebook application at:
Loladex has changed a lot lately. Thanks to everyone who gave us feedback during our “friends & family” period — we took it seriously!
Here are some highlights:
• The overall look and feel has changed a lot. In particular, we are showing your friends’ faces a lot more. We want Loladex to feel like a community: Rather than being a search engine, it’s a place where friends gather to swap recommendations.
• The home page includes a bunch of new features. We show a nice big scorecard of the picks you’ve made so far, and how you rank among your friends & among all Loladex users. We’re featuring specific picks and comments from your friends in a few different ways. And at the top of the page, we show any current pleas for advice from your friends.
• We’ve upgraded the search results, both in content and in presentation. Importantly, we’ve added a bunch of filters that should help you find exactly what you seek: That was a common request. We’ve also added the ability to “ignore” picks from specific friends and sources, either permanently or on a search-by-search basis. (We don’t allow you to delete friends, however: Please do that via Facebook’s regular process.)
• We’ve raised the visibility of our “ask friends” feature, and made slight changes to how it works. We’ve already gotten some requests to make it even more prominent, so we’ll get working on that. For anyone who hasn’t used it, this feature allows you broadcast a request for advice — maybe you’re looking for a good local accountant to do your taxes, for instance.
By the way, a frequent question I’ve gotten about this feature is, “Can’t you put a module on the Loladex home page that allows me to skip straight to asking my friends?” My concern is that your friends may already have entered the advice you seek — that’s why we want you to perform a search first.
I consider this functionality a moving target, however: Ultimately we’ll be guided by our users. We’ll be looking for feedback in the coming weeks.
• We’ve added recommendations from your Facebook networks — we aggregate all the votes from Loladex users in your region, for instance, or your college alumni network. This functionality is very new, and we need to work on how it’s presented, but I think it’ll be incredibly useful. I welcome your thoughts on how it should work.
• We’ve significantly improved (I hope) the workflow for first-time users. Many people didn’t realize that they could rate anything during their signup process, but thought instead that they were limited to the categories in a dropdown menu. We nixed that menu, raised the profile of the search box, and streamlined the rating process. The streamlined rating process has been applied in several other parts of the site, too.
I think those are the biggest changes. We’ve made tweaks everywhere, of course, and we have plenty more improvements in the pipeline.
Let us know what you think, either here or on our Facebook discussion board.
From Canada’s Financial Post, here’s an interesting summing-up of last year’s Geosign implosion, courtesy of Ahmed Farooq of iBegin.
(Alas, I had skipped over an earlier post on this topic from Peter Krasilovsky, so this was mostly news to me.)
The short version: Geosign operated a bunch of domains that existed solely to serve ads. Some of these sites included ‘real’ content as a cynical fig leaf.
Googlers know how it goes: You search for ‘XYZ’ and click on an ad (or a result) that looks promising, only to land on a site full of more XYZ-related ads — some of which lead to yet more ad sites, the AdSense version of an infinite loop.
Since advertisers pay by the click, this provides easy money for companies that are willing to waste your time. ‘Arbitrage’ is the common — rather charitable — name for the method.
Google ultimately cut off Geosign, presumably because it was hurting the value of Google’s ads, and the company fell apart.
As a strategy, arbitrage isn’t so dissimilar from search-engine marketing (SEM), or even from search-engine optimization (SEO); it’s all a matter of degree. And when your content is advertising, as it is for Yellow Pages sites, the line gets even blurrier.
So what separates Geosign from the rest of the local universe, which also depends heavily on search-engine traffic? Witness this chart from Hitwise, recently highlighted by Mike Boland at Kelsey:
It’s arguable that Geosign is just the chart’s reductio ad absurdum. Obviously we can make distinctions, but I’d be worried if I were above, say, 35% on this chart and I weren’t Google or Yahoo.
OK, it’s definitely impressive that Local.com gets more of its traffic from search engines than does either Yahoo Local or Google Maps. Probably the same is true of Marchex, which operates domains like 20176.com.
But if Google and Yahoo want to move their own bars to the right, they can easily do so. It’ll come from the hide of Local.com, Marchex and similar companies.
And one big lesson of Geosign, scary and refreshing both, is that Google is willing to nuke a 9-digit business overnight.
R.H. Donnelley, the big Yellow Pages publisher, has lost more than 90% of its market value in the past year — much of it since last week, when it revised its 2008 outlook and announced the resignation of Jake Winebaum, head of its digital operation. The traded part of the company is now worth about $400 million, vs. $4 billion a year ago.
Same thing, more or less, for competitor Idearc: Down about 85% in the past year.
These are astonishing votes of no-confidence in what are, after all, profitable companies with billions in revenue. Seems like a few things could be happening:
• Investors are overreacting. YP companies will get punished by the economy, just like everyone else, but then they’ll recover.
• Investors are overreacting. Sure, YP companies are in a secular decline, but it’s slow & there’s no reason to panic.
• Investors are right. Still, the problem is with these specific over-leveraged companies, or the US market, or something else — not the global print YP market.
• Investors are right. For print YP, this is the last stop before oblivion.
In the world of local experts, all of whom I respect, no one takes the extreme view: See Greg Sterling, John Kelsey, Perry Evans. The consensus is that we’re looking at a slow decline — while they ought to get it in gear, YP companies have valuable assets (revenue, sales force, customer relationships) and time to react.
Hard to argue. And yet … all of this seems weirdly familiar.
In late 1989 I joined the Wall Street Journal to report on IBM. At the time, the computer giant bestrode the technology world, but there were rumblings from upstarts called Intel and Microsoft.
For the longest time, I believed analysts who — even as they acknowledged the upstarts’ importance — talked up IBM’s huge mainframe revenue, its formidable sales force, and its customer relationships.
More recently, I worked for AOL. Its planned to build something new and valuable while allowing its huge dial-up base (30 million subscribers!) to erode sloooooooowly to broadband.
In both cases, the tide came in far faster and deeper than expected.
I suspect it’s ever thus: No one here is Canute*, exactly — but when the future is lapping at your feet, big lungs aren’t a viable strategy either.
My gut tells me the tide is coming in quickly for YP publishers. Whatever the stats say about numbers of lookups, I see more & more piles of shrinkwrapped directories that sit for weeks before being tossed.
Only two things are holding back the ocean:
• The lack of a popular tool that makes the Web easier to consult than a phone book. The iPhone and similar handsets will change this within 18 months.
• Merchants’ failure to realize that their YP ad dollars are buying less and less. By 2009, this will be impossible to ignore.
What follows will be a real crisis, not just today’s crisis of confidence.
These companies aren’t 100% print YP, of course. They include online components. But they’re fitting things into a print-oriented culture, rather than starting from fundamentals. Again, it reminds me of IBM, ca. 1990, fitting PCs into its mainframe-oriented strategy.
I visited R.H. Donnelley’s Web site today. I was greeted by this slogan:
connecting you to the future
building on the past
“Building on the past.” If I were an investor, I would sell too. In today’s environment this is an epitaph, not a tagline.
*Aside: So now I read that King Canute was actually making a point to his fawning courtiers. What use is he, if not as a metaphor?
At least today’s story has a hook: Yelp just announced another round of funding, raising $15 million not because it needs the cash but because, per CEO Jeremy Stoppelman, “it’s a shaky world out there.” Well, OK.
TechCrunch tosses out a valuation of $200 million on revenue of less than $10 million, and notes (correctly) that Yelp has been on a traffic tear lately. Still not profitable, says the Post.
One interesting thing was the photo:
This is a local Virginia business giving some TLC to a group of the ‘Yelp Elite,’ which is Yelp’s clubby moniker for those it has anointed as cool kids.
I’m not a fan of the Yelp Elite concept, in part because it works only for twentysomethings, but there’s no doubt it drives engagement. Smart businesses like this health club in McLean are leveraging that engagement, while Yelp acts as the broker.
I don’t think this strategy will prove cost-effective for Yelp, but it’s definitely interesting to watch.
I continue to be fascinated, too, by the way Yelp has become a platform for self-expression. Above all, I believe, the ‘Elite’ visits Yelp in order to write artful reviews—not to read them.
It’s a different dynamic than the one we’re trying to tap at Loladex, where the substance of people’s opinions will take precedence over their mode of expression. We think this will scale better, but it’s certainly tough to argue with how Yelp is doing so far.
Not long ago I was talking with Gib Olander from Localeze, our main data supplier. The topic was local data, and how weird it can be: Some things look like they must be mistakes—except they’re not.
Gib’s example was a place that sells custom rims and also cellphone service. If you saw the business listed under both categories, you might figure one was wrong. But Gib can show you a photo of Cell ‘n’ Wheels that proves otherwise.
I laughed. The example wasn’t so terribly outrageous, and Localeze certainly has an interest in promoting this idea. Yet at the same time, I happened to know of a much better illustration.
I get my hair cut at a barber’s shop that also sells seafood. Oysters, specifically. During the holiday season it does a roaring trade in hams, too; they’re piled into a shopping cart by the door. No one seems to mind buying dinner from a place that can get ankle-deep in human hair.
Whatever about rims and phones, I’d definitely suspect an error if my search for [oysters] near [Leesburg, VA] returned Plaza & Tuffy’s Barber Shop as the top result. But it’s the only place in Leesburg that advertises oysters on a sign:
I shot this photo right before getting a haircut. When I went inside, my barber Bobby asked why I had been taking pictures. I told him I had a friend in Chicago who didn’t believe that a barber shop also sold seafood.
“We’re still country here,” he replied. “You tell him that.”
It got me to thinking: In reviewing YellowBot last year, I included a screengrab of something I portrayed as an error—YellowBot’s tags said that a hair-removal place here in Leesburg also sells bail bonds.
Perhaps I was too hasty in calling it a mistake?
Yellow Pages folks surely do love structure — especially when it comes to data. Here at the latest Kelsey conference, where YP folks abound, the only good datum is a structured datum.
Consider the title of yesterday’s most interesting panel:
Building a Better Database: Acquiring Content in a Dysfunctional Environment
The title is a bit grad school, but “dysfunctional” is a strong word that caught my eye. Here it mostly means “resistant to structure.”
And them’s fightin’ words in the world of Yellow Pages.
By now I’ve gone to a bunch of YP-oriented conferences. All of them featured a discussion about how to gather structured data. But I’m starting to suspect that this isn’t the most important problem to solve — and not just because these conference discussions never go anywhere.
Here’s my thinking:
In what a YPer would call a functional environment, every business location, small or large, would authorize a regularly updated master version of its “attributes” (hours, certifications, parking facilities, etc.), and would post this information in some microformat on its Web site, or supply it directly to each data vendor, or send it to an industry-wide data clearinghouse that’ll probably never exist.
In addition, lots of other data sources — licensing bodies, rating sites, whatever — would distribute structured information that’s already normalized and can be correlated perfectly to these master records.
All this data would then be collated by data vendors such as Localeze and sold to Web companies such as Google or, for that matter, Loladex.
Finally, the Web companies would build applications that use the structured data for searching by consumers (input) and display to consumers (output).
This worldview may be summarized thus:
More structured data in → Better answers out.
Or as Marchex‘s Matthew Berk (who’s a smart guy) said at the panel here: “We think local search is about structured search.”
Berk gave a very good example, which I also use when discussing Loladex: If you’re looking for a doctor, you need to know whether he takes your insurance. That’s true, without a doubt.
But here’s the problem I have:
The majority of information available about any company, and particularly about any small company, will never be structured. It’ll exist only on the general Web, where it must be searched on its own terms — that is, as unstructured text.
To me, this suggests that the most pressing data problem isn’t how to gather more structured data, but how to search unstructured data (on Web pages) and return structured answers.
I live on both sides of this equation, by the way. My wife runs a small cookie bakery, and I’m in charge of distributing her data to online sources.
Because of my background, I’m more informed and motivated than most small business owners. And yet, to be honest, just keeping her Web site up-to-date is a chore. On Yelp right now, I’m sorry to say, her hours are incorrect. I should update it, but I just haven’t.
Accuracy on our own Web site is always my #1 priority, because that’s our official voice. Also it’s where most people land when they search for “Lola Cookies.”
Keeping Yahoo Local accurate is on my list, too, but it’s lower down. Ditto Google and YellowPages.com and the other big sites.
I never think about the data vendors one layer back, like InfoUSA, unless they happen to call the store. (Which InfoUSA does, to its credit.)
Meanwhile, plenty of interesting and searchable information about the bakery exists in other places on the Web, in formats that aren’t even addressed by the concept of “attributes.”
A TV broadcast from the bakery aired live on the local morning news recently, for instance. If you watched the show, you might search for us with a term like “fox 5 cookies virginia.” Where does that fit in the world of structured data?
I raised this general issue at yesterday’s panel. What were the panelists doing about this wealth of unstructured Web data, which right now is the dark matter of the local-search universe?
The answer I got was, basically, “Not much.”
Most panelists said they do only highly targeted crawls, focusing on sites that have structured data that can “extend or validate” their own data, in the words of Localeze’s Jeff Beard. An example might be the site of a professional group such as the American Optometric Association.
No panelist was ready to start indexing the sites of individual businesses, or locally focused blogs, or any other sites that are unstructured but potentially rich in content.
The only (mild) exception was Erron Silverstein of YellowBot, who also said his company limits itself to targeted crawls — but included local media, such as newspapers, among his targets.
A few players are indexing the broader Web and then associating pages with specific businesses (which is the important part). Most notable are Google and Yahoo, who do it for their local search products.
Of course, they’re already indexing the entire Web. It’s less of a stretch for them.
Google and Yahoo also buy structured data from InfoUSA, Localeze and others, so it’s not like such data is obsolete. But they’re getting the same info directly from some businesses, and those updates are likely more timely, more accurate, and more complete.
Meanwhile, their Web indices are opening up a realm of data that traditional vendors like Acxiom represented by Jon Cohn on yesterday’s panel simply don’t care to address.
I suspect that, sooner than you’d imagine, Google and Yahoo will be buying structured data not so that users can search it directly, but for two less-flattering reasons:
- To help find Web pages they can associate with each business
- To fill ever-smaller gaps in the coverage that results from #1
Matthew Berk of Marchex argued that a good local search must be structured to “help someone walk down the decision trail” by using filters to narrow their search progressively:
I need a orthopedist in Boston … in the Back Bay … who accepts United Healthcare.
I think users are more likely to learn that they can go to Google and type “orthopedist back bay united healthcare” particularly if it produces a good top result the first time they try.
The burden of local search, it seems to me, is to do something that Google can’t match with an unstructured Web search.
In any case, the search portals will ultimately use their indexed Web pages to extract and cross-check structured data directly. Over time probably just a couple of years such automated processes will yield data that’s more current and detailed than anything that’s produced by scanning phone books or calling stores.
The resulting search functionality, integrating both structured and unstructured data, will be sold to other companies as a Web service, and data vendors such as InfoUSA will become irrelevant to local search.
Now that would be a dysfunctional environment for many of the Kelsey attendees.
I’m not sure exactly how companies like InfoUSA and Acxiom should tackle the unstructured Web. It’ll demand a new way of thinking, and probably a new way of selling.
But I’m certain that they ignore unstructured data at their peril.