eval.google.com - Google's Secret Rating Interface

**Matt Mickiewicz** · Jun 1, 2005, 10:45

A blog today broke the story of how Google has recruited people from around the world to rate and compare sample search results:

http://www.searchbistro.com/index.ph....html#extended

(Be sure to take a look at the Flash movie)

**ethanp** · Jun 1, 2005, 10:53

I'm almost speechless. I figured something like this existed, but kinda shocking to actually see/hear about it.

**LeoWebDesign** · Jun 1, 2005, 11:28

Couldn't view the Flash Movie and I was getting errors like crazy. I saw it's Slashdotted so possibly getting too much traffic now.

**Matt Mickiewicz** · Jun 1, 2005, 12:21

Someone mirrored the Flash file here: http://cavalkaf.frihost.net/mirror/s.../secretlab.swf

**LeoWebDesign** · Jun 1, 2005, 12:33

Originally Posted by Matt Mickiewicz

Someone mirrored the Flash file here: http://cavalkaf.frihost.net/mirror/s.../secretlab.swf

Thanks!

**ethanp** · Jun 1, 2005, 12:22

It is interesting to finally see something that Google likes to keep a secret from us. I'm glad that they are at least taking human thought into consideration when coming up with search results.

I'm wondering how this will affect Google's rep, or probably just give them a huge amount of plublicity.

**weeps** · Jun 1, 2005, 22:34

Has no one else thought that this could be fake?

**JakeJeck** · Jun 1, 2005, 23:06

Originally Posted by weeps

Has no one else thought that this could be fake?

http://www.webmasterworld.com/forum39/2677.htm

Post from sept. 2004.

Edit - quite a few people have talked about it.

http://www.google.com/search?hl=en&l....google.com%22

**SRTech** · Jun 2, 2005, 16:34

More information up now:
http://www.searchbistro.com/index.ph...valuation.html

**polvero** · Jun 2, 2005, 22:29

well...we all know Yahoo is powered by human's. it's about time google has told us they were doing something like this.

**WealthStream** · Jun 3, 2005, 00:18

I wish I was an editor for Google. Sounds like a nice job.

**Jadusoft.com** · Jun 3, 2005, 03:55

very interesting page, thanks for sharing.

**masm50** · Jun 3, 2005, 04:03

I don't think this was that much of a secret - I applied for the job

Didn't get it though

Thy advertised the jobs on their site - they actually (here in the UK anyway) recruit through another agency.

Cheers

Tim

**chrisranjana** · Jun 3, 2005, 05:12

I'm not sure whether this will give more credibility to google's results but let's hope so.

**thody** · Jun 3, 2005, 05:54

My take is the human factor isn't actually to pick sites, it's just to help Google hone the algorithms based on human input - this shouldn't be confused with Google going to a directory format.

Not sure why this is making such a commotion though, it's basically just a user satisfaction survey from the looks of it.

**webdude** · Jun 3, 2005, 07:10

I agree with Thody, the human input probably enhances the search engine. I reckon that the ratings are probably based on site popularity or some other measurable factor.

**someonewhois** · Jun 3, 2005, 07:30

Yeah, I would imagine it's all statistical as opposed to actually having an affect on the SERPs. Interesting, sort of, I guess.

**COTR** · Jun 3, 2005, 07:35

I am curious as what agency that might be that recruits for them? I hope that is not an inappropriate question.

**masm50** · Jun 3, 2005, 07:42

Here's the link:

http://www.google.com/jobs/eng/test.html#qr_ads

Cheers

Tim

**blackdog** · Jun 3, 2005, 08:23

not a big deal.... nearly every company in the world has user satisfaction surveys.

**howardroark`** · Jun 3, 2005, 10:51

Originally Posted by blackdog

not a big deal.... nearly every company in the world has user satisfaction surveys.

i agree. it's not like there's a major update coming...

**ozgression** · Jun 4, 2005, 02:38

Originally Posted by blackdog

not a big deal.... nearly every company in the world has user satisfaction surveys.

Yeah, I'd have been suprised if they didn't solicit feedback.

**asmictech** · Jun 5, 2005, 11:41

well...we all know Yahoo is powered by human's. it's about time google has told us they were doing something like this.

Is it true yahoo search is controlled by man. no wonder my sites come up in their lists why they hardly appear in google.
google needs to make listing fair by getting it controlled by man rather than robots.

**disspy** · Jun 5, 2005, 12:07

Google SecretLab interface looks pretty bad for such company ... And is that the interface for Ad Rater job position? It looks like fake to me

**Ronny** · Jun 5, 2005, 23:16

This is nice, although a little obvious. You can expect G will use human feedback.. As long as the raters don't affect search results directly I don't see any problem with that. And even if they do that, if they're not recruiting anyone who applies I suppose it could still be regarded as fair.

As for their interface.. The cobbler's shoes are never fixed. With so much to do in Google and with all these new projects every day I guess they just don't want to spend the time and resources needed to improve their inner, not-so-important network interfaces.

Personally I always love to pay special attention for the admin panels I design, of course when it comes to a client who pays for them but even when me and my pal are going to be the only ones who will see that panel, it's just so nice to have full access and permissions to a system, to pass the security means and be welcomed to a fabulous admin panel which is stacked so nicely with tons of options...

But perhaps that's just me; I can allow myself to put an effort into designing something that is not as essential as the other parts of the site may be, Google can't. Long live Pixels Heaven!

The SitePoint Forums have moved.

User Tag List

Thread: eval.google.com - Google's Secret Rating Interface

Thread Tools

Display

Hybrid View

eval.google.com - Google's Secret Rating Interface

Bookmarks

Bookmarks

Posting Permissions