Hakia Pushes Credibility Filtering – Still Flawed

By Josh Catone

A few weeks ago we discussed the idea of credibility filtering as the future of news filtering. In the age of constant information in which we live, filtering, we said, is surely the future of news. How to best sort out the signal from the noise is still to be determined.

The two most popular approaches right now — crowd-based human filtering, and algorithmic filtering — are not without their problems. As we discussed in August, filtering based on the credibility of the source is an idea that is gaining some steam. We reviewed two startups that filter news using a combination of all three approaches — crowd-based, algorithmic, and credibility. The problem with their approach, we said, was that the definition of credibility varies from person to person.

Today, semantic search engine Hakia announced that it is jumping on the credibility bandwagon by offering a way for users to restrict results to so-called “credible” sites.

Credible sites will be reviewed by “librarians and information professionals” and hand-picked to meet specific credibility requirements. Those requirements present a major problem, though. Hakia defines a credible site as one whose content is peer-reviewed, that has “no commercial intent or bias,” that is current, and whose publisher can be verified.

The no commercial intent requirement is a sticking point for me. That instantly rules out a lot of credible, well-researched media sources simply because their content is created to drive revenue to the publisher. It also means that many non-profit or governmental sources might be included even though their content includes a clear bias (just, perhaps, not a commercial one).

Filtering by credibility is a good idea — being able to weed out the credible results from the rubbish would be great, but Hakia’s approach is flawed, in my opinion. It will, by definition, pass over a large number of perfectly credible results, and potentially — and dangerously — include results that are actually less credible.

Credibility filtering is perhaps where social search might come in handy. If a search engine, like the two news sites we reviewed in August, relies on the crowd to rate the credibility of the source, and you trust your friend’s definition of credibility, the search engine could start returning results based on a customized library of sites that you and your friends have deemed the most credible. For those without a large group of trusted peers, it could suggest “people like you” after you’d begun to tag and rate sites based on credibility.

None of these approaches is perfect, but figuring out how to reliably and accurately filter all the content we’re creating will be the next big thing on the web — perhaps the next “Google” opportunity.

  • http://www.brodic.net mile-jerkovic

    Josh, I think that “no commercial intent or bias” of content refers to product placement inside articles or cases where articles are written as commercials.

    I don’t see why they wouldn’t include commercial news sites, it just seems they wanted to exclude product plugging in news articles.

  • http://www.mockriot.com/ Josh Catone

    @mile-jerkovic Perhaps, but so far it seems like all of their “credible” results come from .org and .gov and .edu domains, and don’t include credible, but commercial, science or health sites (sci and health being the two topics they cover right now).

  • Mihaela Lica

    What an excellent observation, Josh. I see hakia struggling since a long time and I am amazed to see that, despite some valid articles like yours, they still approach search from a… let’s not call it wrong but non-lucrative perspective. Somehow they manage to come up with strategies that fail to impress the industry. They bring nothing new to the search stage. Involving human filtering for “credibility” is not the first attempt of the kind. Almost all search engines employ some form of human filtering – the only difference is that not all come clean about their algorithms and indexing/filtering techniques. The so called credible search will actually deliver only subjective results…



Learn Coding Online
Learn Web Development

Start learning web development and design for free with SitePoint Premium!

Instant Website Review

Use Woorank to analyze and optimize your website to improve your website to improve your ranking!

Run a review to see how your site can improve across 70+ metrics!

Get the latest in Front-end, once a week, for free.