In this article, we are going to explain what exactly is duplicate content, how it happens, and how to deal with it.<\/p>\n\n\n\n
Table of Contents:<\/strong><\/p>\n\n\n\n Duplicate content is such content that completely matches or is remarkably similar<\/strong> to other content on the web. This type of content is often found on different URLs, and sometimes even different domains. Most of the duplicate content happens involuntarily, sometimes being the result of technical implementations.<\/p>\n\n\n\n Because of the multiple sources of duplicate content, search engines experience trouble when deciding which URL deserves a higher spot in their results. That’s why the search engines often put all URLs with specific duplicate content at lower ranks, preferring other pages for their better spots in the search results.<\/p>\n\n\n\n With WordPress websites, content duplication is often a reason for the site not to rank<\/strong>. The traditional meaning of duplicate content is “such a piece of content that is the exact match of another (from wording to code).” With WordPress, duplicate content can be a bit different from that definition, but the issue still needs to be addressed.<\/p>\n\n\n\n Unmanaged duplicate content can cause three main problems for search engines:<\/p>\n\n\n\n As for site owners, they suffer in terms of rankings and traffic losses. The losses are caused mainly from the following issues:<\/p>\n\n\n\n There are lots of myths surrounding duplicate content and whether it’s penalized by Google or not. Yes, we said myths, because a penalty is not exactly what duplicate content gets<\/strong>. As we already mentioned, this type of content is inconvenient for search engines because it makes their job harder. In that sense, it doesn’t get actually penalized, but rather gets the “silent treatment,” if you will. And yes, for content creators, that is the equivalent of a penalty.<\/p>\n\n\n\n However, people actually keep thinking they get a penalty from search engines because their content is not ranking. It\u2019s a common misconception that duplicate content pages compete against each other because of the lack of knowledge they have on the matter.<\/p>\n\n\n\n Here are some of Google’s thoughts on duplicate content:<\/p>\n\n\n\n So, the conclusion here is\u2014there is no actual duplicate content penalty by search engines, but it still harms your SEO in a major way.<\/p>\n\n\n\n Back in February 2011, Google released a search filter, known as the Panda Update<\/strong>. This update was made in order to stop sites with poor quality content from using certain \u201ctricks\u201d to make their way to the high rankings.<\/p>\n\n\n\n The Panda algorithm update addressed more than a few problems<\/strong> when it comes to the Google Search Engine Result Pages (SERPs). Those are:<\/p>\n\n\n\n The reasons for duplicate content are plenty. In fact, there are dozens of them. Most of those reasons, as Google believes, are technical. One of the most usual cases is when someone decides to put the same content in two or more different places<\/strong>, without clearing out which one is the original. Perhaps the main problem is that developers are not used to thinking as users or browsers. So, here are some of the main causes of duplicate content in WordPress and overall.<\/p>\n\n\n\n Using tags in WordPress often results in duplicate content. When you tag a post or a page, WordPress creates a separate page<\/strong> for that particular tag, gathering snippets (or even full articles) from all pages and posts that include the tag. If this tag is the same as a category on your WordPress site, then you would create a competitor page on your own website. <\/p>\n\n\n\n Often tags are modified versions of themselves, which also creates similar content that competes with itself. If that happens, none of those pages will rank, which is definitely not good for SEO.<\/p>\n\n\n\n Category pages usually include lots of posts – similar to tags<\/strong>. They have H1 tags which are the same as in your articles. However, Category pages will not always answer a question or provide the perfect solution, mainly because they are post snippets, therefore not suitable when someone is looking for answers. That\u2019s what makes them usually considered thin content.<\/p>\n\n\n\n Another cause of duplicate content issues is using URL parameters, such as click tracking and some analytics code. Let\u2019s take, for example,<\/p>\n\n\n\n In the eyes of a search engine, those are two different URLs<\/strong>. The second one will help you with statistics about where your visitors come from, but it may also prevent your site from ranking as well as you wish.<\/p>\n\n\n\n This goes for all parameters that are added to a URL<\/strong>, without changing the primary piece of content inside said URL. No matter the purpose, such URLs count as duplicate content.<\/p>\n\n\n\n Most of the time duplicate content is just inside the borders of your website. It is not an uncommon case for generally alternative websites to take (\u201cscrape\u201d) your website content without your agreement on the assumption that increasing the volume of pages on their site is a good long-term strategy despite the relevance or uniqueness of that content. By doing this, the foreign website does not provide valuable information<\/strong> for search engines, and they may not get that a piece of content originates from your website, therefore deciding this content is duplicate.<\/p>\n\n\n\n As your website grows in popularity, more and more scrapers will start using its content.<\/p>\n\n\n\n As a website owner, and most commonly when managing an online store (WooCommerce), you would probably want to keep track of your visitors and let them keep track of their shopping cart, even if they leave it and come back later. For that to happen, you need to provide users with a Session<\/strong>, which is a form of history of the actions they took while they were on your website. There is a unique identifier called Session ID, which is to be stored somewhere with the purpose of keeping your visitors\u2019 sessions. Nowadays, the most common practice to do that is by implementing cookies.<\/p>\n\n\n\n Keep in mind that search engines usually don\u2019t store cookies<\/strong> and thus some systems go back to using Session IDs in the URL. With that, there are URLs generated for every Session ID, which is unique for that specific session and results in duplicate content.<\/p>\n\n\n\n Here\u2019s one more common cause for duplicate content \u2014 order of parameters. You should know that CMSs usually don\u2019t use clean URLs<\/strong>, meaning they tend to add stuff into a URL (numbers of ids, categories, etc.). For example, a URL that has \/?id=13&cat=21<\/em> will give you the same result as a URL with \/?cat=21&id=13<\/em>. The issue here is that the search engine sees those two URLs as different, therefore rendering the content inside duplicate.<\/p>\n\n\n\n In WordPress, as well as in some other systems, there is an option for paginating comments. This is not a recommended practice<\/strong>, because if you paginate your comments, it leads to duplicated content (\/comment-page-1<\/em>, \/comment-page-2<\/em>, etc.).<\/p>\n\n\n\n Filtered (or faceted) navigation is used mainly by e-commerce websites<\/strong>. It\u2019s the type of navigation where users can sort items on the page. Faceted navigation works by adding parameters to the URL\u2019s end.<\/p>\n\n\n\n With Ecommerce, there are usually lots of combinations with certain filters (sizes, colors, etc.), and thus using faceted navigation often results in a lot of duplicate (or near-duplicate) content<\/strong>.<\/p>\n\n\n\n See the following URLs as an example: <\/p>\n\n\n\n You can see that while the URL\u2019s are unique, their content is almost identical. What\u2019s more, the parameter order often does not even matter.<\/p>\n\n\n\n When both versions of your website (WWW and non-WWW) are accessible, search engines might consider that duplicate content.<\/p>\n\n\n\n Similar to WWW vs non-WWW<\/strong>, if you have HTTP and HTTPs versions of a website, there are still chances for the same issue to occur.<\/p>\n\n\n\n Not everyone knows that Google actually treats URLs with or without trailing slashes as unique<\/strong>. That makes example.com\/post\/<\/em> and example.com\/post<\/em> unique in the eyes of the search engine. So, in case your content is available at both URLs, that can lead to duplicate content issues. <\/p>\n\n\n\n You can easily check by inputting both versions of a page on your site. The best result would be if only one version to load and the other to redirect.<\/p>\n\n\n\n Website admins often create printer-friendly versions of page content. They do this for convenience – to help users print the content that\u2019s available on their website. Print-friendly versions of a page or a post have the same content as the original. The only difference is in the URL – example.com\/post <\/em>vs. example.com\/print\/post<\/em>. Put simply, those print-friendly URLs are PDF versions of a piece of content from the site<\/strong>. They count as duplicate content because Google can read PDF files. The content on print-friendly URLs is not only accessible via different URLs, but it has also actually been copy-pasted (on 2 or more pages).<\/p>\n\n\n\n You can identify duplicate content using a lot of methods, both manually and with the help of specific tools.<\/p>\n\n\n\n When it comes to finding duplicate content, there are plenty of tools available. It\u2019s a matter of personal choice which one you will pick to use, but it\u2019s probably best to use more than one tool<\/strong> since there are often differences in what duplicate content tools offer. <\/p>\n\n\n\n CopyScape<\/a> is pretty straightforward – all that needs to be done is insert a link in the box on the homepage. After you do that, CopyScape returns a number of results. However, be aware that without a premium account, you will get only the top 10 results.<\/p>\n\n\n\n Each of the results is clickable for more details about it. If the results are below 10% of one of your posts or pages – it\u2019s okay. However, in case someone copies more than 20% of your content, you can consider sending them an email, politely explaining that what they are doing is not professional, asking them to change the copied text.<\/p>\n\n\n\n For an internal duplicate content check, you can use Siteliner<\/a>. It will help you find duplicate content on your own website. <\/p>\n\n\n\n The Siteliner duplicate content check provides a lot of information, but the free version is limited to 250 pages once per 30 days. After doing a search, you will be able to see your internal duplicate content percentage. Seeing a high percentage, in this case, is not a reason to panic, because Siteliner also shows excerpts duplicate content.<\/p>\n\n\n\n The best thing about SeoReviewTools<\/a> is that it\u2019s free to use. What\u2019s more, you have more than 30 tools that will help you while working on your website. The duplicate content checker is one of them, and all you have to do to perform one is to confirm you are not a robot via entering a captcha. The tool will show you both internal and external duplicate content. <\/p>\n\n\n\n Keep in mind that SeoReviewTools is not as powerful as some of the premium duplicate content tools, but it\u2019s still helpful in most cases.<\/p>\n\n\n\n Serpstat<\/a> is a powerful premium all-in-one SEO platform. With it, you can also see a list of pages with identical titles or description tags. Go to the Serpstat Meta tags<\/strong> section, which is inside the Audit<\/strong> module.<\/p>\n\n\n\n Some alternatives to Serpstat are:<\/p>\n\n\n\n Using Google is one of the easiest ways<\/strong> to find out whether you have an issue with duplicate content on your WordPress site. There are various search operators which are quite helpful in such cases. <\/p>\n\n\n\n For example, if you want to find all URLs that have a specific keyword in inside their content, you need to type the following line in the Google search bar<\/strong>:<\/p>\n\n\n\n Where example.com<\/strong> is the site your site and WordPress<\/strong> is, well, the keyword you need to examine.<\/p>\n\n\n\n After you hit enter, Google will display all of the site’s pages that contain your chosen keyword. If you make the “intitle” part more specific (e.g., “WordPress is the best”), the fewer results you will get. With that in mind, you can even search for whole sentences, especially if something tells you that you have already written a piece of content in the exact same way, but you can’t put your finger on it.<\/p>\n\n\n\n Sometimes when performing this type of search, Google might display a message at the very end of your results<\/strong> (last page, at the bottom):<\/p>\n\n\n\n This is proof that Google is not displaying every single possible result<\/strong>, and that there is indeed duplicate content being scraped. Feel free to try it yourself and click on the link to see those additional results. We also recommend fixing as many of them as possible.<\/p>\n\n\n\n Sometimes you might not be able to dispose of a duplicate piece of content (mainly with articles), even if you know it’s not the correct URL. To solve this issue, search engines have introduced the element called Canonical link<\/strong>, which you need to place in the <head> section of your site. It looks like this:<\/p>\n\n\n\n In the ‘href’ section of the canonical link, you have to place the correct canonical URL for your article. Whenever a search engine that supports canonical finds that link, it will perform a soft 301 redirect <\/strong>and transfer most of the link juice to your actual canonical page.<\/p>\n\n\n\n Keep in mind that this process is a bit slower. Do it after you have no more options for the regular 301 redirect.<\/p>\n\n\n\n Sadly, there are those cases where you simply cannot prevent your system from creating improper URLs for pieces of content. In such cases, you can redirect them. So, after you resolve as much duplicate content as you can, just redirect the rest to the proper canonical URLs<\/strong>.<\/p>\n\n\n\n Once you know which one is your canonical URL, you will have to start with the canonicalization. Basically, you need to start helping search engines find the canonical version of a page and do it as quickly as possible. There are four methods<\/strong> of solving (or preventing) the duplicate content issue:<\/p>\n\n\n\n We have already given some cases for duplicate content in WordPress. Here are the fixes for them:<\/p>\n\n\n\n Your goal should be preventing duplicate content from appearing because it’s by far the best solution to the problem<\/strong>. After you are more familiar with the matter, you will be able to avoid duplicate content much easier by implementing the proper type of research.<\/p>\n\n\n\n Duplicate content is everywhere on the web. It’s extremely hard to find a WordPress site with lots of pages and complete absence of duplicate content. If you make sure to keep an eye for duplicate content and manage it correctly<\/strong>, all should be fine.<\/p>\n\n\n\n One has to keep in mind that there are certain things, such as scraping or spam, that can cause problems. However, for the most part, issues are caused by improper settings<\/strong>. For some additional info on the matter of duplicate content, you can always check out Google’s help section.<\/p>\n\n\n\n Myths about Google penalizing duplicate content need to be gone for good. For that to happen, the truth has to be shared and false information\u2014to be corrected. If not, there will always be people who believe duplicate content is seen as a penalty.<\/p>\n\n\n\n If you had any doubts yourself, we are confident that now you got the picture. There are more than enough ways to deal with duplicate content, and even if you don’t do it yourself, Google will do their best to solve the problem for you.<\/p>\n","protected":false},"excerpt":{"rendered":" WordPress is a CMS that makes website management easier for online businesses, blogs, and even online shops (WooCommerce). The platform applies most of the best practices automatically, while also having the plugin arsenal for almost everything else.<\/p>\n","protected":false},"author":13,"featured_media":5086,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[256],"tags":[72,44],"class_list":["post-5101","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-wordpress","tag-seo","tag-wordpress"],"featured_image_src":"https:\/\/www.fastcomet.com\/blog\/wp-content\/uploads\/2020\/02\/how-to-get-rid-of-the-wordpress-duplicate-content.png","author_info":{"display_name":"Joseph","author_link":"https:\/\/www.fastcomet.com\/blog\/author\/joseph"},"yoast_head":"\nWhat is Duplicate Content?<\/h2>\n\n\n\n
Why is Duplicate Content Bad for SEO?<\/h2>\n\n\n\n
Does Google Have a Duplicate Content Penalty?<\/h2>\n\n\n\n
The Panda Update<\/h3>\n\n\n\n
Causes for WordPress Duplicate Content<\/h2>\n\n\n\n
Tags<\/h3>\n\n\n\n
Categories<\/h3>\n\n\n\n
URL Parameters for Tracking and Sorting<\/h3>\n\n\n\n
http:\/\/www.example.com\/post-x\/
http:\/\/www.example.com\/post-x\/?source=rss<\/pre>\n\n\n\nScrapers and Content Syndication<\/h3>\n\n\n\n
Session ID Duplication<\/h3>\n\n\n\n
Parameters Order<\/h3>\n\n\n\n
Comment Pagination<\/h3>\n\n\n\n
Filters and Sorting<\/h3>\n\n\n\n
www.yourstore.com\/shoes.html?fresh=size=46
www.yourstore.com\/shoes.html?size=46&fresh<\/pre>\n\n\n\nWWW vs. non-WWW Consistency<\/h3>\n\n\n\n
HTTP\/HTTPS Duplication<\/h3>\n\n\n\n
Forward Slash at the End of URLs<\/h3>\n\n\n\n
Print-Friendly URLs<\/h3>\n\n\n\n
How to Identify Duplicate Content<\/h2>\n\n\n\n
Use a Duplicate Content Checker<\/h3>\n\n\n\n
CopyScape<\/h4>\n\n\n\n
Siteliner<\/h4>\n\n\n\n
SeoReviewTools<\/h4>\n\n\n\n
Serpstat<\/h4>\n\n\n\n
Manual Duplicate Content Check<\/h3>\n\n\n\n
site:example.com intitle:\"WordPress\"<\/pre>\n\n\n\n
![\"Include](\"https:\/\/www.fastcomet.com\/blog\/wp-content\/uploads\/2020\/02\/include-google-ommited-search-results.jpg\")
<\/figure>\n\n\n\nHow to Fix Common Duplicate Content Issues<\/h2>\n\n\n\n
Use Rel=Canonical<\/h3>\n\n\n\n
<link rel=\"canonical\" href=\"http:\/\/example.com\/wordpress\/seo-plugin\/\" \/><\/pre>\n\n\n\n
Use 301 Redirecting<\/h3>\n\n\n\n
How to Avoid Duplicate Content<\/h3>\n\n\n\n
\n\t
![\"Keep](\"https:\/\/www.fastcomet.com\/blog\/wp-content\/uploads\/2020\/02\/keep-comment-pagination-disabled.jpg\")
<\/figure>\n\n\n\nYou Should Fix Duplicate Content, for the Sake of SEO<\/h2>\n\n\n\n