Does Google Crawl Google Drive? and Should a SEO Use it?

Google crawls Google Drive for SEO

As an SEO that manages teams of link builders, social media optimizers, bookmarkers and article writers, this question has become paramount to the way I manage my SEO reports.  My short answer is yes, Google can spy on your docs stored within Google Drive and therefore, you should not use this service for managing your SEO reports. Especially when you are managing large websites where millions of dollars are at stake. That being said, do not use Google Drive (formerly Docs) or even Gmail for SEO reports especially, when it comes to linkwheels and link networks.

Let’s take a lesson from other cloud-based services like MegaUpload getting shut down or how about what’s happening right now with RapidShare. TorrentFreak leaked this Rapidshare Internal Manifesto that outlines how they crawl your cloud-based files and can seize the content and terminate your account on the suspension that it violates a registered copyright. Bullshit laws not only allow Google to spy on your content but actually forces them to and here’s why:

“Services should terminate account holders or subscribers not merely upon proof that they are infringers but when sufficient copyright holders have called their conduct into question. In such cases, services deserve an explanation from the users as to why the suspicions are unfounded.”

Now thanks to laws like the Digital Millennium Copyright Act (DMCA) and the completely unconstitutional Cyber Intelligence Sharing and Protection Act (CISPA), cloud-based services like Google Drive will have no choice but to spy on your files! Even though Google supported Net Neutrality back in 2006 when they were still cool, they have now given their FULL support for CISPA along with these 800+ other major companies. Of course, the attempts to pass CISPA have failed so far but they will just change a few words, give it a new name and keep trying until it finally passes.

Here’s a sentence I snagged from Googles copyright and protection policies:

We provide information to help copyright holders manage their intellectual property online. If you think somebody is violating your copyrights and want to notify us, you can find information about submitting notices and Google’s policy about responding to notices in our Help Center.

Paranoid yet? Well, your paranoia is not unfounded because in Google’s new all-encompassing privacy policy that applies to ALL Google services they straight up tell you that they can and will use any and all information you provide.

Information we get from your use of our services. We may collect information about the services that you use and how you use them, like when you visit a website that uses our advertising services or you view and interact with our ads and content.

Read carefully, especially the part where it says to interact with our ads and content that means the SERPs too. Obviously, I have no proof that Google is actively using the information in your Docs aka Google Drive but this proves that they can if they want to. You must understand that the Google Ranking Algorithms are the most valued asset Google has and they will do anything to protect and enhance these algorithms. Even if that means scanning your Drive.

Google_Spies_On_You

Google Spies on Your Gmail Too

Most people have already realized that Google crawls Gmail as well. Just send someone an email about a mortgage and you will start seeing mortgage-related advertisements in your Gmail. They use keyword scanning bots to scan all the content of your incoming and outgoing messages and when the bots find something that is related to an ad, they then display those types of ads in your inbox. Furthermore, Google even crawls your email attachments. I’ve tested this on several occasions where I will not mention anything about the targeted advertisement keyword, yet I’ll attach a keyword rich document to the email and I will still get related ads. This is why I also strongly advise against using Gmail to send SEO reports and especially if you are going to send a list of websites that are part of a linkwheel or network.

How to Use the Pagination Tags Rel= next and rel= prev

How to use Pagination Tags

Rel= next and rel= prev are brand new tags that Google just came up with to fix the dreaded pagination duplicate problem.

Here’s How to Use rel=next and rel=prev

The URLs below will be our example of how to implement this long awaited Google meta tag for Pagination content

http://www.yoursite.com/content-part1.html

http://www.yoursite.com/content-part2.html

http://www.yoursite.com/content-part3.html

http://www.yoursite.com/content-part4.html

pagination-tag-seo-300x218Step 1. On the first page of your pagination which in this case is http://www.yoursite.com/content-part1.html put the following markup in your <head>

<link rel="next" href="http://www.yoursite.com/content-part2.html">

Obviously, you don’t need to use rel=prev on the first page :-)

Step 2. On the next two pages in our example, you will include the previous page in the sequence and the next page by including both links in your markup as I have done below

<link rel="prev" href="http://www.yoursite.com/content-part1.html">
<link rel="next" href="http://www.yoursite.com/content-part3.html">

Step 3. Then on the last pagination page which is http://www.example.com/content-part4.html> you just use the previous link, as there is no next :-)

That’s it! No further adjustments needed, just a give it a few weeks for the duplicate titles to disappear in Google Webmaster Tools.

The Old School Solution

I initially wrote this post on August 8th, 2011 about Pagination Pages Causing Duplicate Content because, before the new Pagination tag that Google announced on August 15th of 2011, there was just too much misinformation out there on this topic.  (Spooky, were they reading my blog???)  Previously, not even Google gave straight answers on how to deal with it. Just look at the way a Google employee handled the question here on their webmaster’s support forum about duplicate pagination content.  Don’t you just love how Google always dances around the answers? Sometimes they make you read between the lines and sometimes they completely leave you clueless. Moving on, pagination pages create duplicate content and give you a bad mark in Google Webmaster tools for duplicate titles. Just 5 days after I posted this article, Google added this Pagination solution to WMT help section. That being said,  if you are interested in how I used to solve the problem, keep reading below.

indexing-through-pagination-pagesPrevent Pagination Junk

Part of the reason it is so difficult to answer the question is because not all sites are the same and in some cases, people might actually want to index their pagination pages and in other cases they just want them followed.

The objective is to guide the bots to the content that you want them to see and keep them away from redundant and duplicate content that is inevitably produced by many CMSs.

duplicate-content-pagination-194x300That being said, I suggest a couple of measures that in combination will work for at least 90% of all pagination duplicate content problems

1. Use the <META NAME=ROBOTS CONTENT=NOINDEX, FOLLOW> tag in the header of all your pagination pages except for the first page as you will want to get that one indexed as the category page. This allows for indexing through the pagination without actually indexing the pagination page itself.

2. Whether or not you want the pagination pages indexed or not I still suggest you use a script that rewrites your pagination titles to legitimize them. Just because Google is not indexing them, they are still crawling, following and using the data in their algorithms. Using a technique that I have seen favored by Googles video search results that they use on Youtube, simply rewrite your titles like this

Domainname.com | Category Name | Page 2 of 49

Again that was the old way of doing things prior to August 15th 20011 and now you can block duplicate content caused by pagination pages with the very simple Pagination tags, rel=“next” and rel=“prev”.

Google’s Project Glass is Badass

Google_Glass_Is_Badass

Google announces their newest pet project. The newest product is a pair of glasses that provide a virtual interface to your mobile devices. Previously named Project Glass, this product is straight out of a SciFi movie and promises to bring us leaps and bounds into the future. For years I’ve been wanting a computer with a full interface like this; Then I could build and optimize websites while sitting in a rocking chair eating a ham sandwich.

Here’s their Official Project Glass Plus page and below is the video they put to together to illustrate the possibilities. You gotta admit, project glass is bad ass.

Googles Project Glass Video Shot in NYC

Project Glass Live Demonstration

This is one of the coolest ways to demo a new product!

Google Secret Bonus Video Dark Web Operators

Secret SEO bonus video for google operators

This video cannot be searched for or viewed unless you know the secret address for it. This link was given out only to participants of the Power Searching With Google Program that is not open to public registration at this time.

Here they talk about the new Dark Web Google Operators that will crawl usually un-indexable files within a website also know as Deep Web.

Expert Keyword Research (2012 Revisited)

Expert Search Engine Optimization Keyword Research

As the ever changing algorithms evolve, so must your SEO techniques. People often ask me, what’s your favorite SEO tactic? And my answer is always KEYWORD RESEARCH. It’s the foundation of any SEO campaign and therefore, the most important aspect. Here I will talk about keyword tools, longtail keywords, 2012 post Panda changes and various keyword analysis strategies.

1. First Things First What are Longtail Keywords?

Longtail keywords are those that are found toward the long tail of the bell curve. These keywords bring in less traffic and are less competitive. In the graph below I have mapped out two keywords, [free porn] and [free Asian milf porn] to demonstrate how long tail keywords work.

expert-keyword-research

2. Studying Keyword Competition

The Google Keyword Tool gives you two pieces of data, monthly searches and competition level. The problem is that their competition ranking system is almost always inaccurate when determining the competitiveness of longtail keywords. The reason is because the true competitiveness of a keyword depends on more variables than the ones that Google uses.

Since I used to work in the Porn SEO arena, I’ll give this example [sex chat] gets 4,090,000 searches per month and Google gives it a medium competitiveness ranking while [Romanian Sex Chat] gets 490 searches per month yet it has the same competitiveness ranking. According to this metric, they have an equal amount of competition but common sense tells us this is not true. Instead of counting on their tool, I use my own little method to more accurately measure this. Using the number of monthly searches vs the number of results found when actually searching for the keyword (e.g About 4,220,000 results (0.19 seconds)) vs the amount of inbound links to the domains within the first 10 results vs the level of on-page optimization of those first 10 results. Lastly, you throw in a little bit of common sense. With these metrics, one can get a better idea of the competition level of the keyword and a better understanding of what type of content will be needed as well as how much link building will be needed to achieve 1st-page rankings.

3. The Best Expert Keyword Tools

While there are many keyword tools that require registration or even payment, the most trusted tool for adept keyword research is the human brain. Start by thinking of all the search terms that you would type in if you were looking for your product or service. The reason I suggest this is because you will always be able to think of search queries that would not and could not have been returned by automated tools. An example of this the fact then when I use keyword tools for the query strip clubs they should have also suggested girly bars or lap dance bars which also get tons of traffic but they didn’t so I had to use human intuition instead. My second most favorite is the Google Keyword Tool and it happens to be free and requires no signup as well. Once I use my own intuition to compile a list and I then plug those KWs into Googles keyword tool to expand on the list and to get the stats for each one. I still haven’t found a keyword tool or service worth paying for so save your money!

4. Use Knowledgeable Keyword Synonyms!

Prior to the year 2001, an expert keyword researcher could have simply placed the keywords on the web page hundreds of times and even hid the keywords in the background to trick Google. Then Google implemented an algorithm of around 2% keyword density as the suggested practice for proficient keyword placement within your text. Nowadays, even 2% is too much in this Post-Panda SEO era, as it disrupts the natural flow of writing and tends to look spammy. To become a true Keyword expert, use keyword synonyms or semantically related keywords because Google now loves synonyms. An example for this article could be expert keyword research, adroit search query research, keyword analysis expert or keyword inquisition. Using this strategy you can really get your keyword density up to 2% or higher without catching the attention of Google’s webspam team. Use an online thesaurus if you need help finding good synonyms.

5. What Keywords are Your Competitors Using?

Saving the best suggestion for last It doesn’t take an expert keyword researcher to find out what keywords your competitors are going after. Let someone else do all the work for you. You can easily see what keywords your competition is trying to rank for by looking at the keywords they use in their titles, meta tags, and other on-page attributes. You can also find information about what keywords your competition is ranking for by looking at SEMrush, Alexa, and Compete.com.

The Best SEO Software, Tools and Services

Best search engine optimization tools and software

strong-vpn-seo-serviceYou can lead a horse to the water but you can’t make him drink. That being said, here’s a list of SEO software, tools, and services that I use. You won’t find any fluff in my list, just the most valuable tools that I have been using for years.

When creating multiple social media and Web2.0 accounts you must have a good VPN service. This also comes in handy when doing blog comments, forum posting, and manual link building campaigns. I’ve tested all of them and settled on StrongVPN, they had the fastest service with the biggest number of IP options and they allow us to switch the IP 5 times per week for free.

C Class IP Hosting is my newest addition to the list and I’m just happy enough or I would have migrated already. It’s at least good enough for my network sites and blogs but not any of the money sites of course. The company is called C Class IP Hosting and the name says it all. They provide the best and cheapest SEO hosting service that I have been able to find online.  $1 per IP and they are spread out on multiple C-classes! I just got setup with them and here’s my feedback so far Their hosting plans are semi-managed but still give you server access via the control panel by Nodeworx, which is new for me but it was easy enough to get used to. Lastly, I also have to give them credit for their customer service. I asked for Ruby on Rails to be installed and was able to open and close the support ticket within two days and they were pleasant to deal with.  I expect these guys to grow super fast so let’s hope they can keep this level of service.

xenu-search-engine-optimization-software-toolXenu Link Sleuth– Is only one of the many free SEO software tools on my list but its also one of the most important ones. It runs a full diagnostic test on your internal link structure and tells you a lot about the crawlability of your site. If you are having problems with getting pages indexed or if you just want to take a deeper look at how the bots will crawl your site this is the best tool for the job.

linkfarmevolution-seo-tools-softwareLinkFarmEvolution– Create a blog network and easily manage hundreds even thousands of blogs with ease. This one changed my whole world.

proxybonanza-seo-toolsProxyBonanza– You’re gonna need some proxies for sure but finding a good provider wasn’t easy. I tested several and prefer these guys over the rest. These proxies are great for using linkfarmevolution, Xrumer, SEnuke or you can even use them manually when creating profiles or adding links.

xrumer-7Xrumer– Possibly the most powerful SEO tool in the world, also the most expensive at $590 but worth every penny. All the pros use this to automatically get several thousand links from forums and blogs. Please use with caution and take the time to get to know the software before you start blasting campaigns! I also suggest running this one on a dedicated server with dedicated bandwidth for the best results.

senuke-x-seo-tool-300x84SEnuke X– Equally powerful to Xrumer but this SEO tool works on almost every online platform instead of just forums and blogs. The software can create accounts and profiles on hundreds of sites all at once then once the accounts are setup SEnuke can also automatically post written content and articles to them.

PurchasePlusOne- I tried out many services to buy +1s and this company lets me test their service and gave me an inside look at their Google Plus network so I could actually verify the quality of their Plus accounts. I can contribute a lot of my high rankings to their service.

wprobot-seo-software-toolWP-Robot– Is the most sophisticated autoblogging software on the web with a content scraper and auto content poster. For $169 you can build thousands, even unlimited pages of content scraped from Yahoo answers, Youtube videos, Article sites, Clickbank, Flickr and much more! This cool SEO software also has APIs that allow you to use UCG content creator and/or thebestspinner to automatically unique-ify your articles before posting.

social-media-marketing-outsourcing-150x150
W3c HTLM Validator
is a critical SEO tool that I have been using for at least 8 years now. It’s a free online SEO service that checks your HTML, XHTML, SMIL, MathML for errors and even gives you little suggestions on how to fix them.

W3c CSS Validator Checks your CSS, W3C Atom and RSS checker can help find errors and validate your feeds and the W3c Mobile Validator is their newest free service that checks for mobile errors and assesses your sites mobile friendliness.

wso-online-seo-toolWeb Page Analyzer can help you to decrease load time which is one of my highly suggested Post Panda SEO tips. These days Google wants pages that load fast. That being said, the way your images, CSS and other on-page attributes render in browsers has become an increasing trend in Googles 2011 algorithms.

Suggest an SEO Software, Tool or Service

Would you like to add to the list or have me test a new SEO tool for you? Ask and ye shall receive. Just hit me up in the comments below or on my contact page.