Why search is (still) hard.

-
Techmeme led me to this write up on ReadWriteWeb.
The write-up is a summary of a talk titled "Search is a Hard Problem" given by Udi Manber, a VP of Engineering at Google.

The article confirms that the devil is still in the details. Two little things from the article struck me:

  • The query pre-processing being attempted even before the search is run:
I knew Google did little things like stripping out articles from search strings, playing with participles/prefixes/suffixed and tenses to deliver better results, but I didn't realize they did stuff like this:

"For example, Google understands that 'GM' stands for 'General Motors', while 'GM foods' is actually 'genetically modified.' If you search for 'B&B AB', Google knows that is 'bed and breakfast in Alberta', while 'Ramstein AB' is 'Ramstein Airbase'."

  • The localization that is already part of the search engine.
That is typing in "government" in the US, takes you the the US government homepage, whereas typing it in, say, Australia take you to the Australian government's page.

Effective search results are really about getting at the intent of the user from what he/she has typed in and matching it to the attributes of the data that you've chosen to store. And given, that according to him, 20-25% of the queries they see each day they haven't seen before (and most of the world is still getting online) its going to be an ever-present challenge.

Comments

Post a Comment

Popular posts from this blog

The "Rescue Me" minisodes

-
I'm a fan of the FX show " Rescue Me " I was lukewarm when Dennis Leary mentioned the mini-sodes on his Daily Show visit. But, for the Rescue Me's particular situation it works really well. First the mini-sodes are actually good! they use characters from the story and tell a little anecdote they were clearly pretty cheap to produce through what seems like a little bit of complicated mess, they're distributing like crazy: YouTube , Crackle (Sony's site), the FX site (powered by Brightcove), Hulu These do exactly what they're supposed to do new episodes aren't coming till Spring 2009 , the fans need something to tide them over and keep the show in their memory: done potentially rope in new fans (short episodes, lower commitment to start watching the show) without freaking out old school media which is loathe to risk potential DVD sales by putting older episodes/clips online: done Its not completely clear to me how much this is by their own design, and
Read more

A short love letter to ~8 years on Google Search - 8 things I’m grateful for.

-
  After a few weeks off, I started a new gig within Google yesterday and it hit me that for the first time in almost eight years I won’t be working on some part of Google Search. Eight years ago, I told the team when I was interviewing that I was “looking for a place to call home for a while and grow there”. My experiences here more than met that need.  I used to write a regular “10 things about…” listy column for a while at a college newspaper. So in that style here’s 8 things (one for each year) I feel grateful to have experienced/learned in this time. Also, like that column which I banged out the night before it was due, this post is something that I don’t need to do, yet I feel somehow compelled to do (and so it’ll likely be longer and less crisp than it should be :-))    It actually is awesome to work on something so many people use and love, and that positively touches people’s lives. There’s a talk I give externally about Search and a line I often end up using is how the mission
Read more

Avengers Endgame: how trivial passions can nudge a career

-
Image
The Internets reminded me that today was exactly 2 years since Avenger's Endgame was released. I remember that day vividly for a few reasons I woke up before sunrise (way before the alarm went off).   I wore this (now that I think about it) borderline appropriate T-shir t and then..  .. showed up before 7:00am to watch that movie at Century Shoreline before going to work.  This is still the only movie that has a scene that can make me tear up consistently every single time (I know, I know - it's ridiculous).  That day was interesting from a work perspective for another reason. Along with a few other people at work (and with some crazy last-minute negotiating), we'd pulled together the Thanos Easter Egg on Search. It was typical of a lot of Easter Eggs on Search at the time, in that it wasn't really anybody's job, but we pushed it through because we loved the idea enough to do it. My day job on Media experience on Search helped me justify it a little bit I guess.
Read more