Google Shows the Indexing Date for Each Search Result

If you use Google's advanced options to restrict the search results to a certain period of time, you'll find that Google shows the date when each web page has been first indexed (in many cases, this is a good approximation of the date when a web page has been created).


As previously mentioned, you can edit Google's URL to customize how fresh the search results should be. For example, if you append &as_qdr=y9 to Google's search URL, you'll restrict the results to web pages first indexed by Google in the last 9 years. Since this restriction should include all web pages from Google's index, you can use it to display the timestamp next to each search result (e.g.: a search for iPod).

Maybe in the future Google will display the date next to each search result, it will try to approximate the date when a page has been created, allow users to filter results from certain periods and sort the results by date.

Read More

Interesting Results from Google Blog Search

Even it still has problems with duplicate content and spam, Google Blog Search has an important advantage over other blog search engines: it actually finds the most important search results. This is the default option for displaying results and it's recommended to use it even if you only want to read fresh news, as you can change the time interval to "last hour" or "last 12 hours".

Google's blog search engine lacks a homepage that displays the most important posts from the blogosphere, but there's a way to find interesting posts without entering a query. For some strange reason, if you search for [label:keyword] or [view:keyword] (keyword can be anything you like), Google ignores your query and displays a list of blog posts. We can assume it's a list of blog posts relevant for any query.


Related:
How Google Blog Search ranks results

Read More

Finding Places of Interest in Google Maps

Google Maps has a very useful mapplet (what's a mapplet?) that shows places of interest from a list of categories. You can select the mapplet by going to the My Maps tab and clicking on Featured content > Places of interest.

Instead of searching for bars, restaurants, hospitals, shopping malls, you can select these categories in the left sidebar and see all the places that match your selection. Unlike the standard search results, the mapplet shows many more places and you can use it to see the picture: for example, to estimate the distribution of restaurants in a certain area. Google Maps lets you select more than one mapplet, so you can also activate the distance measurement tool, the Panoramio layer with beautiful photos or the popular community maps.

Read More

Google Goes to Disneyland

This year, Google's employees didn't go on the traditional ski trip due to the size of the company, so they went to Disneyland for three days, from 4 to 6 February. Here's how Googlers described the trip:

"Monday through Wednesday, Googlers from the West Coast offices headed down to Anaheim for a visit to place of a 'million dreams.' Suffice it to say, it was an incredible experience. I got to go on rides I had gone on over 10 years ago - including Space Mountain, Matterhorn, and Star Tours. And, I got to ride the new rides - California Soarin', California Screamin', Buzz Lightyear, and Indiana Jones. From 8pm-1am, the park was open only to Googlers, with our very own fireworks show and no waits in the lines." (Reid)

"Tomorrow I'll be on my way (...) to LAX and then to Anaheim for Google's yearly ski-trip! Oh wait. There's no skiing in Anaheim. So what's this all about? Well it turns out that Google with its 16,805 employees is now so big that we cannot by any means rent enough rooms in Tahoe, so it was decided to give us a choice this year: Camping at the Pinnacles National Monument south of Salinas, CA (bring your own tent!) or Disneyland! Google's got the whole park just for Googlers after 8pm on Tuesday [February 5th]", writes Ulf Waschbusch.

"One of the things I can most prominently remember about my childhood is Disney cartoons. There was a stage when Mickey, Donald, Pluto, Goofy meant more in life than probably computers mean today. I visited Disneyland at Anaheim near Los Angeles. Many thanks to Google for the company trip. (...) Disneyland is a childhood dream come true. One less thing left to do in life." (Nirnimesh, a Googler from Hyderabad, India)


"Absolutely amazing time. The organization of the trip was second-to-none... pretty much what you'd expect from Google. I couldn't even imagine what a logistical nightmare organizing something like this must have been. They flew about 5,000 people down from three different airports in the bay area, to three different airports in Los Angeles area. Shuttles were organized to take us from those three airports to about 10 different hotels where the Googlers were staying. At the airports, for most of us who only had carry-on luggage, we were handed our boarding passes after showing ID and went straight to security (after waiting on a Google line for a quite some time but what would you expect?!). When we arrived at the airport (going down and coming back), there wasn't a single moment where the Googlers weren't informed where we were supposed to go to catch our shuttle. (...) There's definitely a reason why Google's the number one employer to work for. This was the most fun I've had since I moved out here." (Billy)



More photos of Google's trip to Disneyland: Arturo, Ana, Rosalie, Cynthia, Michael, Tessa, Gregory.

Read More

iGoogle's Settings Page

Google's personalized homepage (a.k.a. iGoogle) has a settings page where you can change the language, your location and some things related to tabs (name, theme, layout). You still can't reorder the tabs or make some special changes that aren't available in the main interface.

The settings page would probably be more useful if it had support for batch operations like deleting multiple gadgets or moving all the gadgets that contain "Google" in the title to a new tab.

Read More

Local Sections in Google News

There's a new type of section you can add to Google News: the local section. Type your location (or any other location) and Google will show you the most relevant news related to your location. Until now, you could create a custom section that showed the most important news that contained your terms, but the new location does a better job at identifying locations.

"While we're not the first news site to aggregate local news, we're doing it a bit differently -- we're able to create a local section for any city, state or country in the world and include thousands of sources. We're not simply looking at the byline or the source, but instead we analyze every word in every story to understand what location the news is about and where the source is located," mentions Google News Blog.


You can create as many local sections as you want by clicking on "Edit this personalized page" and selecting "Add a local section". It would be nice if Google News adds the layout options from iGoogle and makes it easier to rearrange the sections and add new content. Google could also display a lot of interesting content about a location (popular videos, photos, blog posts, events, community maps) in a special iGoogle tab.

Read More

Add Data to Google Spreadsheets Using Forms

Google Spreadsheets has a new feature that lets you create a form to accept data. When you go to the Share tab, there's a new option to "invite people to fill out a form". The form is very simple and can be customized by changing the order of entries, their labels and the type of answers. It's also a nice way to get feedback people who wouldn't normally collaborate on a spreadsheet.

You can create forms from spreadsheets or using this URL. To keep track of your forms, add this gadget to iGoogle.

I created a form that lets you add your favorite Google service (the form has a public page that I embedded below) and here's the entire spreadsheet with all the answers.



Update. Here are the results of your votes:

Read More

A More Powerful Google Navigation Bar

iGoogleBar is a Firefox extension that enhances Google's navigation bar by showing the number of unread Gmail messages (only from the inbox) and the number of unread posts in Google Reader. The extension also adds icons that open Google gadgets for each service so you can preview your Gmail inbox from Google Calendar or open a recent document from Google Notebook.

For example, in the screenshot below, I visit Google Docs, but I can see that there is a single new post in Google Reader, only two unread messages in my inbox and I can easily open a bookmark from Google Notebook.

Unfortunately, the new navigation bar is displayed after the page loads, it works only in Google's communication apps and it doesn't include the More dropdown. Another big drawback is that the extension is actually a Chickenfoot script that comes with its rendering engine, which is terribly slow. In fact, the extension's XPI file has 1 MB, almost the same as Google Toolbar for Firefox.


{ via Googlified }

Read More

Google Offers Security Services for Mail Servers

Google acquired last year Postini, a company that offered hosted services for email servers. "Postini invented the software as a service approach to providing communications security and compliance, and holds two fundamental patents in the space, with more patents pending." Google integrated a small part of the offering in Google Apps Premier Edition: policy management, spam/virus filtering and 90-days message recovery.

Now Google offers the rest of the Postini services under the Google Apps umbrella, but without tying them with Google Apps Premier Edition and Gmail. Google Apps Security Services work with the most important email servers (Microsoft Exchange Server, Lotus Domino, Postfix, Sendmail, Macintosh OS X Server, Novell Groupwise) and offer three levels of protection, priced differently:


* message filtering: anti-spam, anti-virus, anti-phishing, and malware protection for inbound messages - $3/user/year
* message security: inbound and outbound mail filtering, email encryption, content policy management - $12/user/year
* message discovery: the same as above plus one-year message archiving, audit reports - $25/user/year

For educational institutions and non-profit organizations, the prices are much smaller: $1, $4 and $8.33/user/year. For all the services, Google provides 99.999% service level assurance.

Here's how the service works: you change the MX records to point your mail traffic to Google's data centers and all the bad traffic will be stopped before reaching your mail server. Google processes email in RAM and doesn't write the valid messages to disk.

Google provides multiple layers of protection against viruses. The service leverages its visibility to emerging threats by monitoring attacks against our customer base and - in real-time - blocks IP addresses that are issuing virus attacks. In addition, Google utilities multiple anti-virus protections including zero-hour heuristics, coupled with multiple commercial anti-virus engines to detect existing and emerging threats.

As with our virus protection, Google leverages visibility into billions of daily message connections to monitor spam attacks and blocks the most obvious spam. Our heuristic engine then filters the incoming mail traffic and captures any suspicious messages. This is all performed in real-time (processed in RAM memory in our data centers) without delays to your email delivery. With these capabilities, Google combines an extremely effective capture rate with an exceptionally low false positive rate.

Google says that Postini already has 40,000 customers and 14 million users and these affordable prices should increase the user base. Unfortunately, the association between these security services and Google Apps might confuse the potential clients and make them think that the services are only available for Gmail.

In fact, Gmail already includes anti-spam, basic anti-virus, anti-phishing and the corporate version of Google Apps includes content policy management and basic message archiving at no additional cost. Maybe Google will use the data obtained from Postini's services to enhance Gmail's security features.

Read More

Could Google Save Yahoo from Microsoft?

Microsoft is taking over Yahoo! by Gnal.
Licensed as Creative Commons Attribution.

Even if it's hard to believe that Yahoo will accept it, there's a simple way to make Yahoo more profitable: drop its search advertising service and use Google AdWords. Google has a better technology for ranking ads, a bigger inventory and higher click-through rates. If Google accepts to offer Yahoo most of the earnings, it's likely that Yahoo's profits will make investors happy again.

According to Wall Street Journal, "Google Inc. Chief Executive Eric Schmidt called Yahoo Inc. CEO Jerry Yang to offer his company's help in any effort to thwart Microsoft Corp.'s unsolicited $44.6 billion bid for Yahoo, say people familiar with the matter. (...) Google could play a role in attempts by others to outbid Microsoft, or by Yahoo to remain independent. Google could potentially offer money, or guaranteed revenue in return for a Yahoo advertising outsourcing pact, under that scenario."

There are rumors that Yahoo already negotiates with Google the outsourcing of its search ads in Europe. This could be a good news for Google, who also provides ads for Ask.com.

In a harsh post from the official Google blog, David Drummond is worried that Microsoft's acquisition of Yahoo could jeopardize Internet's openness: "Could Microsoft now attempt to exert the same sort of inappropriate and illegal influence over the Internet that it did with the PC? While the Internet rewards competitive innovation, Microsoft has frequently sought to establish proprietary monopolies -- and then leverage its dominance into new, adjacent markets. (...) Microsoft plus Yahoo! equals an overwhelming share of instant messaging and web email accounts. And between them, the two companies operate the two most heavily trafficked portals on the Internet. Could a combination of the two take advantage of a PC software monopoly to unfairly limit the ability of consumers to freely access competitors' email, IM, and web-based services?"

It's not clear if Google is truly worried by this potential acquisition, since a Microsoft+Yahoo company would be very far from Google's dominant position in search and search ads*, while Yahoo's absorption would take a lot of time. Microsoft has already admitted that it can't compete with Google online by trying to acquire Yahoo and it chose a very bad moment in Yahoo's history to force the acquisition.

* According to Microsoft, Google gets 75% of worldwide revenues in search ads and has 65% search market share in the US and 85% in Europe.

Read More

Data Visualization Google Gadgets

Last year, Google acquired a data visualization technology from Gapminder, a Swedish non-profit organization. Gapminder's technology, Trendalyzer, was used to visualize data from United Nations Common Database in an intuitive way. To quote from Gapminder's site, "this software unveils the beauty of statistical time series by converting boring numbers into enjoyable, animated and interactive graphics." For example, you could see the evolution of carbon dioxide emissions in a country over time or find correlations between CO2 emissions and the income per capita.

Google probably intends to use this technology to visualize custom data. One of the interfaces that will allow you create your own Trendalyzer visualizations is an iGoogle gadget which creates a Flash multi dimensional chart. The input is a file with the following structure: the first column is the item's name, the second is time, the third is for x-coordinates, the forth is for y-coordinates, and the fifth is the size of a ball. I tried to upload a file that has this structure, but the gadget didn't accept it. The gadget is probably a part of a new service that also hosts your data.


This is not the only data visualization gadget developed. Another gadget creates an interactive table that supports filtering and grouping, the simple table gadget lets you perform queries, while the heat map gadget "displays a map with color intensities that match given values". There are also gadgets for pie charts, column charts, bar charts, area charts, image lines, scatter charts, organizational charts, time series.


Hopefully we'll be able to actually use these gadgets and Google will create a service around visualizing data.

Update: The gadgets are a part of a new Google Spreadsheets feature.

Read More

Search, Ads, Yahoo and Microsoft

While everyone comments about Microsoft's offer to buy Yahoo, I think it's interesting to look back at the struggle to stop Google's domination in search and PPC ads.

Yahoo Inc. yesterday announced plans to buy Internet advertising firm Overture Services Inc. for $1.63 billion in stock and cash in a move designed to help the online giant exploit the growing market for sponsored search results. (...)

Overture, formerly known as GoTo.com, pioneered the approach of letting advertisers bid for the right to place their links alongside search terms and paying only when users click through to their Web site. Overture, based in Pasadena, Calif., claims 88,000 advertisers and licenses its commercial results to Yahoo, Microsoft's MSN.com and other Web portals. Google has copied Overture's business model and claims 100,000 advertisers. (...)

Overture sells sponsored search results to other portals besides Yahoo. Microsoft Corp.'s MSN.com is one of Overture's top customers, and analysts consider it highly unlikely the Redmond, Wash., software giant will want to continue using Overture's ad network once rival Yahoo completes the takeover.

(Washington Post, July 15, 2003)

On Thursday, Microsoft CEO Steve Ballmer said he regretted not spending more on in-house search research and development in the past, but said the company has addressed the oversight and plans to unveil its own search product within the next 12 months.

"Not only do I think Microsoft is capable of building extraordinary search technology, I believe Microsoft is hell-bent on developing that technology in Redmond (Wash.) without a material acquisition," said Rohan. "That is the Microsoft way."

(CNet, March 26, 2004)

Rashtchy estimated that the search industry will reach nearly $7 billion in revenue by 2007, growing at a compounded rate of 35% each year. Those kinds of numbers attract a lot of attention. In 2003, Yahoo!, which was outsourcing its search to Google, wanted in on the action and paid $1.63 billion to buy Overture. Last month Yahoo! dumped Google and now exclusively uses Overture, officially declaring war. Sleeping giant Microsoft, meanwhile, was rumored to have made an unsuccessful stab at acquiring Google, and is now using its nearly infinite resources to improve it own search engine.

(Forbes, April 26, 2004)

Keyword search is the largest component of U.S. online advertising, and Google derives virtually all of its ad revenues from this category. The growth in that segment speaks for itself. Based on data from PricewaterhouseCoopers/IAB Internet Advertising Reports, the overall keyword search category generated $81 million in revenues in 2000, representing only 1% of overall online ad sales. Jump ahead to 2003, and keyword search accounted for $2.5 billion in revenues -- a hefty 35% of the total U.S. online ad-sales pie.

(BusinessWeek, June 11, 2004)

As previously reported, Microsoft's Internet group is developing a pay-per-click ad-bidding system that pairs search results with sponsored text messages from advertisers. Yahoo's Overture Services currently supplies MSN with sponsored search links, which complement MSN-sold "featured sites." (...) With the product, Microsoft will move into the mother lode of a multibillion-dollar ad business dominated by Google and Yahoo. Search-engine marketing is expected to be worth as much as $5 billion this year, and nearly $9 billion annually within four years, according to Jupiter Research. Microsoft's piece of the pie is smaller than the shares enjoyed by market leaders Yahoo and Google, and the software giant is hungry for more. Google fields 35.1 percent of the searches online, followed by Yahoo at 31.8 percent and MSN at 16 percent, according to ComScore QSearch.

(ZDNet, March 16, 2005)

Microsoft is taking on the great Google Money Machine with an inhouse answer to Google Adwords.

Step forward Microsoft adCenter, launched yesterday to pump out all-paid search traffic on MSN and other Microsoft online properties in the US. Microsoft’s adCenter replaces Yahoo!'s Overture as the paid-for search engine on MSN. The only surprise is how long it took Microsoft to make the switcheroo – predicted ever since Yahoo! bought Overture in 2003 – and confirmed this time last year by Microsoft at its annual MSN Strategic Account Summit.

(The Register, May 4, 2006)

The Internet search-advertising wars are getting hotter: Vowing to catch up to industry leader Google, Yahoo Monday will demonstrate an overhauled advertising system that promises to generate higher revenue and enlist more clients.

On May 4, Microsoft unveiled its own search advertising program and said it would invest up to $6 billion in a bid to catch up with Google.

Yet Google still easily dominates paid search ads — those little text ads that appear near search queries. The Internet powerhouse has made several enhancements to its search program as well.

Google says it hasn't heard anything from Yahoo or MSN to make it worry.

"There's been nothing that's announced that makes me want to change what we do," says Richard Holden, director of production management for Google's paid search programs.

(USA Today, May 14, 2006)

Struggling to make a dent in rival Google Inc.'s dominance over online search, Yahoo Inc. reported a quarterly decline in profit Tuesday but managed to match already lowered expectations. (...) During a Tuesday conference call with analysts, Susan Decker, who was promoted to president when Semel was replaced by Yang, acknowledged Yahoo's past failings.

She said the company had been slow to recognize emerging trends in online advertising and that Yahoo's management structure was overly complex, opening the door for more nimble competitors. (...)

Yahoo commanded an 18.3% share of paid-search marketing spending in June, up from May's 17.8%, Rohan said, but June's percentage is still the third lowest at Yahoo since January 2006.

"Google continues to dominate spending with over 75% market share," he wrote. "Panama stabilized Yahoo's market share slide, but has not reversed it."

Rohan said that even with Panama, advertisers see a better return on investment with Google, which boasts higher click-through rates at lower prices. "Yahoo's Panama was modestly successful but only temporarily halted Google's gains in marketshare," he said.

(Hollywood Reporter, July 18, 2007)

Despite the hopes of many and rumors that Yahoo would post "strong" earnings, Q4 2007 results were mixed, and net income was down from a year ago. In addition, CEO Jerry Yang said the company faced "headwinds" in 2008 and offered weak guidance but promised a return to growth in 2009. Investors were unhappy, and stock was down at one point 10 percent in after-hours trading (this morning it has recovered).

Total revenue in Q4 was $1.83 billion, which represented 8 percent growth of the same period a year ago ($1.7 billion). Full year 2007 revenues for Yahoo were $6.97 billion. Simultaneously, Yahoo announced it would be cutting 1,000 jobs.

(Search Engine Land, January 30, 2008)

Read More

Social Graph API

In "Thoughts on the Social Graph", Brad Fitzpatrick wrote:

There are an increasing number of new "social applications" as well as traditional application which either require the "social graph" or that could provide better value to users by utilizing information in the social graph. What I mean by "social graph" is a the global mapping of everybody and how they're related, as Wikipedia describes and I talk about in more detail later. Unfortunately, there doesn't exist a single social graph (or even multiple which interoperate) that's comprehensive and decentralized. Rather, there exists hundreds of disperse social graphs, most of dubious quality and many of them walled gardens. (...) If I had to declare the problem statement succinctly, it'd be: People are getting sick of registering and re-declaring their friends on every site., but also: Developing "Social Applications" is too much work.

Five months later, Brad Fitzpatrick announced that Google will start to index FOAF files and the XFN microformats from web pages to gather publicly defined relations between people. For example, "XFN outlines the relationships between individuals by defining a small set of values that describe personal relationships. In HTML and XHTML documents, these are given as values for the rel attribute on a hyperlink. XFN allows authors to indicate which of the weblogs they read belong to friends, whom they've physically met, and other personal relationships."

It's easy to edit the links from your blogroll to highlight your friends or your acquaintances.

<a href="http://danielboyd.com/" rel="friend">Daniel</a>

You can also link to your other site or to your pages from Flickr, del.cio.us, Twitter etc. and consolidate your online identity:

<a href="http://twitter.com/ev" rel="me">My Twitters</a>

Google allows you to access these social relationships using a simple JSON API. The API could be used by social applications to discover some of your friends that already use the same application. "So you've just built a totally sweet new social app and you can't wait for people to start using it, but there's a problem: when people join they don't have any friends on your site. They're lonely, and the experience isn't good because they can't use the app with people they know. You could ask them to search for and add all their friends, but you know that every other app is asking them to do the same thing and they're getting sick of it." Since the data is already publicly available, this API makes it easy to discover your friends and let you select the ones you want to keep in the new context.

For example, Bradfitz from LiveJournal has a friend Jane274. When Brad joins Twitter, the API could discover that he also have a LiveJournal page and his LiveJournal friend Jane274 is the same as Jane from Twitter. This way, Brad found a friend who has a Twitter account.


Of course, the problem is that few people use FOAF and XFN to declare their relationships, but Google's new API could make them more visible and social applications could use them. Ultimately, Google could also index the relationships from social networks if people are comfortable with that.

Read More