Official Google Announcement: A new tool to disavow links

As I have been watching the Pubcon Twitter stream today for any news on the recent updates by Google the past few weeks, I witnessed a large amount of tweets flying through with excitement about the new Disavow Link Tool from Google.  At 1:18 pm pst I saw three tweets come through saying there would be an announcement on the Google Webmaster Central Blog, so I quickly opened up the page and continued to hit refresh every 10 minutes.

Then suddenly - there it was:

Official Google Webmaster Central Blog: A new tool to disavow links: Webmaster level: Advanced Today we’re introducing a tool that enables you to disavow links to your site. If you’ve been notified of a manua...

To reiterate what Matt and the Google team are stressing - Most sites DO NOT need this tool. They are serious, and cannot say it enough.

That being said - here's a quick note about links, why you would want to disavow them, and how to do it...

Bad Links

A long, long time ago when SEO's could tweak and play with sites and watch the rankings happen almost instantly, a strategy call "Link Building" was provided by agencies and consultants as a quick means to obtain instant rankings. By submitting a website URL to directories, submitting articles with links to article distribution sites, and press releases with links to the URL surrounded with key terms and anchortext with longtail keywords websites began to see nearly instant rankings. But as all spammy tactics must come to an end, so did the link building strategies.

Unnatural Links

In Google Webmaster Tools, some sites are seeing a warning in their messages about "unnatural links". This is due to Google picking seeing evidence of paid links, link exchanges, or other link schemes that violate their quality guidelines. More specifically participating in "link schemes" as Google puts it.

A few examples of what a link scheme could entail:
Buying or selling links that pass PageRank (ex: paying for a link from a site with a high pagerank)
Excessive link exchanging (ex: asking a site to link to you if you link to them))
Linking to web spammers or unrelated sites with the intent to manipulate PageRank
Building partner pages exclusively for the sake of cross-linking
Using automated programs or services to create links to your site

Removing Bad or Unnatural Links

The absolute best way to remove these unnatural links is to find out where the links re coming from and contact the website owner or webmaster directly. I myself have used our agency to contact such site owners individually and receive a weekly report of how many of the low quality links have been removed. In addition, I have contact a few of the site owners myself. I have found I either do not get a response at all - or a nice email asking for more details of where the link is located and what I would like removed. It's that simple...
Of course, I have heard stories from others in the industry with not as much luck or ease in this process. Some site owners have clued into these requests and actually ask for money for removal of the link.
But you really have to put the time in to find the link, contact the website admin and ask away.
A quick tool to help you determine what are good links, and what are bad links is the SEOmoz Open Site Explorer tool. You can plug in your URL and a full report of incoming links, page authority and domain authority will help you decide which links need to be removed.

I Tried - But I Still See Unnatural Links

Ok, so you did all you can, but you're still seeing bad or unnatural links pointing to your site. This is where the Disavow Link Tool will come in handy. But remember, don't get carried away with submitting a large amount of links. Also - take note that whatever link you remove, you cannot reavow and get the credit you once had (according to Matt Cutts in this video).
1) Head to the
2) You will be asked which domain you would like to use the disavow link tool for:

3) You will be prompted to upload a file with the links you want to disavow:

Disavow Text File

The file you will upload is a simple .txt file. You can easily create this in notepad on windows, just as you would your robots.txt file.

Within the txt file you want to add a snippet after a # sign with any comments as to the domain, and what you have done to try to remove the link(s).
Example:

# Contacted owner of webdomain.com on 10/1/2012 to

# ask for link removal but didn't get a response

In the case of links from a whole domain that need to be disavowed, you can add the line "domain:" with the domain preceding.
Example:
  domain: webdomain.com
If you have worked with a webmaster that has removed some links, but not all, and you wish that more be disavowed then you can comment as to the details of the request with the date. Then add a list of individual links you want disavowed.
Example:

# Owner of otherdomain.com removed most links, but missed these

http://www.otherdomain.com/sampleA.html

http://www.otherdomain.com/sampleB.html

http://www.otherdomain.com/sampleC.html

Right now Google only supports one disavow file for each domain, so choose and create the file wisely. Naming of the file doesn't matter - as long at the file extension is a .txt. Perhaps calling it simply "disavow.txt" would be the safest route in case of Google not accepting "-", "_", "=", or spaces.

For more information visit these links:
Google Webmaster Central Blog: Disavow Link Tool
Google Webmaster Tools: Disavow Links
Matt Cutts on Youtube - Disavow Links
Matt Cutts' PPT from Pubcon
Lisa Barone's Pubcon Live Blogging:  Google Announces New & Improved Disavow Link Tool
SEOmoz post by Dr. Pete Google's Disavow Tool - Take a Deep Breath

The Dos and Don’ts for Google’s New Disavow Links Tool

Direct Link to Disavow Links Tool

SEO - Panda and the Penguins

I am now at this point 2 weeks into my position based in San Francisco and am finding myself in need of expressing my deepest concerns with how the SEO industry has been representing itself. During my first week on the job I found several questionable SEO strategies implemented on the main site that I was hired to work on. In addition, I have found very aggressive techniques for link building provided by the agency hired roughly a year ago. I'm not going to name the name's of the people or agency involved to spare them, but I will get into some detail of what was done so that we can all learn from the experience.

Panda and Penguin

To precursor what I am about to discuss, there have been some fairly recent massive updates to the Google algorithms that have caused cries heard around the world by SEO's. Those updates would be what is now known as Panda and Penguin. To help you get a better idea of what Panda and Penguin mean for SEO (no they aren't the cute bear or birds we know from the Discover Channel), check out the High-quality sites algorithm goes global, incorporates user feedback post on April 11, 2011 by Amit Singhal to the Google Webmaster Blog, and Another step to reward high-quality sites posted by Matt Cutts on April 24, 2012 (nearly one year later).  In general, what the updates themselves are about is to target websites that are "optimizing" content for the sole purpose of getting rankings, and apply techniques in link building that focus just on links, rather than quality content referring to their website.

Findings

The company I work for has hired the esteemed Laura Lippay (in addition to the agency) to bring another level of expertise to the very important SEO that drives a very large percentage of revenue to the site. In Laura's evaluation she found many odd links pointing to the website, and more specifically a large amount to lower level pages within the site. There is also a numerous amount of links from one page to the next, and content that seems to be fairly cookie cutter that doesn't quite make sense to the user. The links in particular Laura had asked about several times, with little to no response from the agency. Given that there was a lot more to be done with the site, Laura decided to focus on more important efforts.

Enter SEOGoddess...

Laura showed me what she had found in her early days working with the company and I began to dig a bit further. As she was showing me, I noticed that the content linking from random sites that had absolutely nothing to do with the site they were linking to (for example: a hair advice website linking to a data processing website - note: example has nothing to do with the site I am working on, but is a similar scenario) all seemed to be very much in the same. Each and every one of the pages of content also had a standard last paragraph with a couple of sentences containing 2 links with the most aggressive key terms in them. hmmmm (I thought).. Laura copied the first couple of sentences and searched for them in Google. One of the hundreds of results looked like an article submission domain. We clicked to it, and looked around. Lo and behold, it was an article submission site, and the article that was submitted (among several others) was represented by our company's website brand. The articles were submitted around the time the agency was hired to work on SEO.  Laura grabbed the screenshots for me to email to the agency. While Laura was talking with another staff with the company I went to the agency's website to see if I could get a better idea of how they approach SEO. From the home page I clicked "What We DO" in their navigation and proceeded to the "Link Building" section of their website. From there they listed an article "Five Surefire Ways to Build Links and Increase Traffic to Your Website or Blog" - in the article the #1 surefire way: "Article Marketing" which then lists out websites they submit articles to, including the one Laura and I had found. I went to my desk and emailed the agency. Not asking if they knew anything about the article submission, but I simply showed them what I found, how I found it, and then cited the article on their website leaving them no room to neither deny, or to not respond.

Friends Come in Handy

While drafting up the email to the agency, I wanted to make sure I was approaching the issue the best way possible. I know that Bruce Clay had talked about Link Cleanup that he has done for his clients while he was at my Search and Social Hawaii last September 2011. Bruce had advised one of our attendees in an open forum discussion that his staff would ask the websites to remove the links. In some cases he was having to pay them to remove the links, and some were just outright difficult to deal with. While I am in the process of restructuring the website I thought "Why not 404 the URLs that the sites are linking to, while I change the URL structure?" But before I go down the road (well not so easy considering some of them have good quality links, and determining which ones could stay and which would go would be a chore all its own.) I asked Bruce what he thought our best strategy would be. He of course replied with recommending that we evaluate the links pointing to the site, and which pages.

His words exactly:

How important is the target landing page?
If home page you may be stuck.
If a sub-page, then an article in our newsletter on link pruning... http://www.bruceclay.com/newsletter/volume102/link-pruning-procedure.htmIt is hard, tedious work, especially since many junk sites are easily offended by de-link requests.

After my response, he mentioned that we could add the pages that we no longer cared about to the robots.txt and Google would then make the appropriate adjustments (in short).

Industry Folks talk Quality SEO

Bruce Clay had posted this article "SEO Community Watch: Why We’re All Responsible for a Quality Industry" On May 24, 2012. After he shared it to the SEO Group on Facebook it sparked quite a lot of comments around how our industry should be policing themselves to use better strategies.

Bruce mentions in his blog post:

I believe that SEOs who openly engage in a practice that was always doomed are intentionally harming their clients, and this is grossly unethical. What’s even more unfortunate for site owners is that the repair on their sites with paid links usually costs more than the original damage. If a site owner spent $200 per month to buy links, they’ll likely spend 10 times that to correct damage bad links have caused, plus the loss of business until it’s fixed. The easy way out has led to a long, hard road to repair. The demand for an SEO penalty audit service is very high now, and the cost is significant – perhaps hundreds of hours (we happen to know; we offer a cleanup service ourselves). For example, if you are a well-known brand and your site has sufficient value, the repair can begin with just link pruning. However, if your site was based solely on paid links, it’s also very likely you won’t have enough quality content to rank even after fixing the link damage.

The Facebook post by Bruce sparked many 'Like's and over 75 comments. The discussion even started questioning and debating SEMPO's involvement in ensuring that agencies stay on the up-and-up.

In conclusion

What the agency did for our website wasn't entirely a bad thing at the time. Of course it is now with the Panda and Penguin updates knocking all these linking strategy SEO's off their perch, but if you look at any Agency I guarantee you will find that each and every one of them have "Link Building" (or the like) listed as one of their services. In fact - if I do a search on Google right now (not logged in) I see a list of paid search results in which the first links to an agency that lists "link Building" right there on the landing page. The second is another agency that lists out "Directory Listings", "Link Acquisitions", "Press Releases", and "Link Bait" as part of the strategy they provide for SEO.  

In fact moz.org (a trusted resource for all SEO's) even recommends directory submissions as a way to obtain links in their "Professional Guide to Link Building" Copyrighted in 2010 (just 2 years ago) Stating:

Directories
Directories can be a great way to obtain links. There are a large number of directories out there, and they may or may not require money in order to obtain a listing. Examples of high quality directories that are free include:
   Librarian's Internet Index
   Open Directory Project (aka DMOZ)
Examples of high quality directories which require a fee are:
   Yahoo! Directory
   Business.com
   Best of the Web
A more comprehensive list of directories is available from Strongest Links.

As I explained to my boss and our General Manager the agency was doing what they felt was a good SEO strategy. They were acting on what every SEO agency, respected leaders, and common practice that our industry has been allowing for many years. They hadn't done anything wrong really. 

I had even told the agency that I don't care who did it or why it was done, what I care about is that we get it cleaned up and move forward from here.

A Shift in Thinking

What we need to do now is shift our thinking back to what SEO was originally about before SEO's started finding ways to get quick results. Create a website that is user friendly and present your product or service to your audience in a way that makes sense to them. Don't only give them what they are searching for, but simply follow the rules that ensure the site will get crawled, that your key terms are available in an easily digestible manner, and your website is organized and structured so that every page is easily crawled. (of course there is so much more than that - but you get the general idea).

When people ask me "Can I do X to my site to generate rankings?" My answer is more often than not; "If you are thinking of doing something with the sole purpose to generate rankings... Then don't do it."

The Future of SEO

As a result of the Panda and Penguin updates I am sure we will start to see agencies list "Linking Cleanup" as a service they provide. Heck, Bruce Clay himself offers an "SEO Penalty Assessment Service" in which he evaluates and offers linking cleanup for clients (which is why I asked him for the advice in the first place). 

My hope is that we start to see less spamming of comments to our blogs, less random directories showing up in search results, and more quality content when we search for that special item we want to buy, or continue to do research online.

Why the Google Changes? Ooh Ooh - I get it!

 Stripping out "+" in searches and not providing keyword referrals in analytics
Last week I posted about Google's announcement to stop reporting on referring key terms in Analytics, and I have been keeping up to date as much as I can with all the news around it since then.

2 Days ago Barry Schwartz posted an article to SEL about the changes in how we search on Google. Google has removed the ability to use the "+" in our advanced search.

Google themselves said:
"We're streamlining the ways you can tell Google to search for the exact keywords you type, whether it's an exact phrase or a single word, by focusing on the functionality of the quotation marks operator. So, if in the past you would have searched for [magazine +latina], you should now search for [magazine "latina"] to get the same results."

So it hit me this morning...

Since the launch of Google+ several months ago, as an SEO, I have at times found it difficult to search for "Google+" or even the "+1 button". I am sure that since the launch, Google themselves are having trouble seeing referring key terms. In the past the referring URL would have "+" in between the terms. So if someone searched "Google+" then the referring URL would strip out the "+" and those monitoring the referring terms for Google+ would just see "Google" as the referring term. So their question would be: Did people search "Google" or "Google+"?

With Google+ itself being under a microscope after the dying "Google Wave" and "Google Buzz" I can see someone saying to the powers that be that this needed to get fixed. Otherwise they couldn't accurately decide if Google+ is going to succeed.

The next step in this process is to strip the referring URLs of their "+" in between key terms. This unfortunately directly affects analytics as companies won't be able to accurately see referring search terms anymore.

So now Google just needs to fix the tracking of referring terms somehow. Google doesn't want to miss out on that data any more than we do. So be patient, it will come back again...