Valid noindex Yandex. Block indexing using the noindex attribute. Noindex and closing external links

Correct use of tag and attribute noindex, nofollow – the very first step in competent SEO optimization. After all noindex And nofollow play a huge role in transferring weight from one site to another.

noindex tag

As you might guess, the noindex tag is used to prevent indexing of some part of the html code ( pictures and links cannot be blocked from indexing with this tag, but only text). If you close the anchor with the link with this tag, then only the anchor will not be indexed, but the link will still end up in the index. However, the tag is not valid, so some HTML editors refuse to accept it (in particular, the visual editor in Wordpress removes noindex). But the tag can be given validity:

in this form, the tag is absolutely valid - this way you can write it in the WordPress editor without fear that the tag will disappear. But the index is perceived exclusively by the Yandex search engine, and Google does not react to it in any way.

Don't confuse the regular tag with the noindex meta tag written at the beginning of the page, their tasks are different. A simple tag prohibits for indexing only that part of the page code that is located between the opening < noindex> and closing tags. Example:

As for the meta tag, it prohibits indexing the entire page (the prohibition is written in the file) - Yandex does not index such a page at all.

By the way, he is mistaken when he advises closing all links with nofollow noindex tags, but more on that below.

The tag works flawlessly: all text information inside it does not fall into the Yandex index. However, some optimizers claim that sometimes the text inside the noindex is indexed - alas, this really happens. The fact is that Yandex initially indexes all html code, even the one inside the tag, but then filters it. Therefore, at first the text inside the noindex can actually be indexed, but soon the tag is triggered and “everything unnecessary” flies out of the index.

By the way, it is absolutely not necessary to observe the nesting of noindex tags - the tag will work even if the nesting is incorrect (this is written in the Yandex help):

Attention!!!Using the opening tag ( ) , do not forget to put a locking one - ( ) , otherwise all text following will not be indexed.

When to use noindex and when not to

This tag should be used in cases where we want to hide an unnecessary part of the html code of the page from Yandex, so that the robot index of this search engine the “dirt” did not creep in. Based on this, we can say that noindex costs use to:

• hide the codes of various counters (liveinternet, rambler100, TCI and PR counters, etc.);
• hide a bad word or obscene speech, although it is better not to use “such” at all;
• hide duplicate or non-unique content (quote, copy-paste, etc.);
• block too frequently or constantly changing content from indexing - indexing such information is pointless;
• do not allow Yandex to see forms of mailing lists, subscriptions to mail and Rss, etc.;
• do not index unnecessary information in sidebars (banner, unnecessary text information).

But the noindex tag is not needed in some cases.

• There is no need to block advertising from Yandex.Direct, Google.Adsense, Begun from indexing.
• You should not place external or internal links inside the tag - the tag does not work on them anyway. Look at the links on my site, none of them are enclosed in a noindex tag - it makes no sense!
• There is no need to put links in blog comments in the noindex tag - again, it doesn't work!

Tag nofollow

The nofollow attribute is intended to block links from indexing for both Google and Yandex. It is used to avoid transferring weight from the linking site to the linking site. The fact that Yandex does not know about nofollow is a myth, see for yourself - link . By the way, the nofollow tag does not save weight on the page - if some link is “nofollow”, then the weight does not flow over it, but burns out, or, if there are other links on the page that are not closed by this tag, it is redistributed between them. By the way, it follows that if you have at least one active external hyperlink on your page, then the weight goes away from the page - therefore Do not close all external links with the nofollow tag. You won’t save the weight anyway (it will burn if you close all external links with nofollow).

The fundamental difference between noindex nofollow: noindex is a tag that blocks text from indexing, nofollow is an attribute of the tag , which prohibits passing weight by reference. An example of using nofollow:

text to hide , and further text.

When working with Noindex, there is a possibility that the validity of the code will decrease, since only the Russian search engine knows this tag. Therefore, the following spelling is recommended:

.

All text that needs to be hidden.

In this case, other search engines will simply miss it, and the validity of the code will remain unchanged.

The Nofollow attribute is applied to links

In this case, the anchor gets into the index, but the search engine does not follow the web link, the weight on the page remains.

If there is too much Nofollow on a page, this can negatively affect search engine loyalty.

Sharing

In order to close both the text part and the hyperlink, you should adhere to the following spelling:

All text that needs to be hidden anchor, and more text

Variants of correct use of Noindex and Nofollow to prohibit indexing of a document as a whole

The tag and the attribute go hand in hand all the time, and are often used together. They can be used in the meta name=robots of a document to indicate recommendations for indexing and following web links. An indication to prohibit indexing is necessary if duplicate pages are found, or if confidential or outdated information has appeared on the network, and pages cannot be removed in any other way.

If you want to block the entire page from indexing and prohibit the registration of links located on it, you must indicate the following in the page metadata:

Nowindex creates a command for Yandex not to index the content on the page, but the robot follows its web links. Therefore, additional Nofollow indicates not to walk on them. This instruction is accepted by both Yandex and Google.

As for removing a document from the Google index, the search engine provides an alternative method: writing X-Robots-Tag: noindex, nofollow. This indication is enshrined in http headers, which are not visible in the page code.

We talk about the difference between Nofollow and Noindex, how to use them correctly for links and hiding content on the site.

Always make sure that the tags and attributes discussed in the article are present in the right places to get exactly the result you expect.

The secrets of website optimization lie not only in promoting them for key queries, taking care of usability and increasing traffic, but also in the correct use of html code. Proper use of tags and their attributes can often help avoid days of work. There are popular and effective techniques. Probably, in SEO optimization it is impossible to separate the rel nofollow attributes and the noindex tag from each other. Therefore, this article will talk about both, as well as what they are needed for, whether they should be placed next to each other, and in what cases they should be used, and when this should not be done.

Hide links from search robots

Of course, any website is created with the goal of making some kind of profit from it. And the weight of each page is valued by the webmaster. But it’s impossible not to post it in your publications. There are reasons for this, and here are a few of them:

Buying and selling links brings profit;

Traffic to the Internet project increases.

There is an opinion that the a tag attribute - rel nofollow will help hide anchors from search robots and at the same time maintain the weight of the page. But this statement is only possible if the code is written correctly. The exact spelling of this attribute is:

>anchor

Proper linking only gives the site weight and increases its ranking. Needless to say, there is no need to use a href rel nofollow for internal links.

Usage example

Explanation in general outline does not always reveal a complete picture of the importance of using certain tags and their attributes. Hide the link, do not give the weight of the page of your site to someone else. What is this? Just greed? No, this is far from true. For example, many sites have buttons social networks. Agree that their trust is already great. Codes for social buttons while maintaining the weight of their own pages are written using target attributes blank, rel nofollow. The first of them, after clicking, will lead the visitor to third-party Internet resources, opening another browser tab. The second one will not allow you to reduce the weight of the page. For example, for a Twitter social network button it would look like this:

a rel=”nofollow”target=”_blank”href=”URL/home/.

It is worth mentioning the validity of the code - compliance with all technical requirements of html markup. The rel external nofollow tag not only replaces the target_blank attribute no worse, but is also better perceived by search engine robots.

A rel href nofollow, or When you still need it

Hiding links to “bad” or non-thematic sites from search engines;

In order to hide a large number of addresses on third-party resources;

Hiding links if the webmaster sells them;

Not transferring weight to mega-popular portals such as Yandex or Google;

Hiding links in comments.

Nofollow saves websites, and especially blogs, from spam. Unverified links closed with this attribute will appear less and less often in comments.

Noindex and why it’s worth talking about

Indexing can be prohibited not only on external and internal links, but also on individual text elements, as well as entire pages. For this, webmasters use the noindex tag. It only hides texts. Not applicable to pictures and photographs. Links that rel nofollow successfully hides, noindex cannot hide from search engines. The robot will not see the anchors, but will index the addresses. Noindex is usually used to hide part of the content:

With obscene language;

With non-unique text;

The tag definitely needs to be used. But it doesn't work on every engine. The fact is that noindex is not valid, that is, it does not meet the standards. This is why one of the most popular blogging platforms, WordPress, removes the tag from its code. The secret of validity lies in the use of several signs.. By writing the code in this form, you can be sure that Yandex will not index your WordPress blog pages.

Sharing

Should I include both the tag and the attribute in the page code? There is nothing stopping you from using noindex and a rel nofollow in pairs. The tag does not interfere with the attribute, and vice versa. They are placed side by side because search engines see the site code differently. For example, when using both a tag and an attribute, a webmaster can be sure that the Yandex robot will not recognize the anchor, nor will it see the link itself. Google will see the text, but will not transfer the weight to third-party pages of other sites.

Especially for beginners

Website optimization is a new and interesting job on the labor market. The lack of systematically planned information resources for beginners significantly complicates their activities. And naturally, young webmasters make mistakes. Some people fill the content with an insane number of links, while others leave pages without one at all. The same picture applies to the placement of the noindex tag and the rel nofollow attribute.

The desire to bring a website to the TOP of search engines is the reason for making a critical mistake. The fact is that beginners often close external links with both a tag and an attribute. This, to some extent, actually preserves the weight of each page of the site. But the truth is that the same external links increase trust from search engines. You can compensate for weight loss by promoting low- and medium-frequency queries.

Any optimizer should remember that any information will be perceived by readers with greater confidence if it is possible to follow a link to its source. Surely, webmasters themselves are unlikely to adopt a book or brochure that does not contain a list of references.

More and more Internet users are relying on authoritative sources. And if a young site does not refer to their opinion, then it will be much more difficult for it to retain readers and attract subscribers. Of course, this will negatively affect the optimization of the resource. So is it worth blindly using rel nofollow attributes?

A good webmaster cares about his reader. Remembers that one of the foundations of the Internet is links to authoritative resources that provide reliable information. Search engines love sites made for people. And page weight is not the only parameter by which pages with content get to the TOP. Yandex evaluates Internet projects using 800 parameters.

And at the end of the day, page weight only matters to publications that receive it from links from third-party sites. Experience shows that donors, leaving this ranking parameter for themselves, do not rise higher in the “eyes” of search engines.

Nofollow is an attribute that is written for a specific link or all links on a page in robots in order to prohibit search robots from following them.

Noindex is an attribute that blocks text on the page.

That is, noindex is responsible for the content in the document and prohibiting its indexing, while nofollow is responsible for the link.

Rules of application and why is nofollow needed?

To understand in what cases this attribute may be useful, let’s consider how the most popular search engines treat it.

• Yandex. When your resource contains sections designed specifically for discussing posts, writing comments on articles, or a forum, it is important to monitor what outgoing links visitors leave in them. Every comment is welcome. Thanks to this, the site owner will be able to prevent spammers from posting various malicious links. Although the search engine does not take them into account, spam greatly affects the reputation of a web resource and a filter can be applied to it. In this regard, you should check all comments, and if there are any doubts about the quality of the link being posted, write the rel=”nofollow” attribute for them. Now, in the modified Yandex manual, this text has been removed and only the rule for applying the Yandex manual about nofollow remains
• Google. If your site has a section where users can comment on posts, there is a high risk that the comments will contain links to malicious pages. Spammers love sites with unmoderated comments. The nofollow attribute for spam links will save your resource and maintain its clean reputation in the eyes of the search engine. If you trust the site to which the visitor links or you link yourself, then there is no need to register nofollow. Google's Guide to Nofollow

These messages are taken from the official websites of search engines. As you can see, similar things are written in Yandex and Google: the nofollow value should be used in cases where you want to inform the bots that you do not trust the site to which the link leads.

Let's consider a more specific example when a link requires a prohibiting attribute:

Material of questionable quality. If you do not like the content of the page to which a visitor leaves a link in a comment, and you do not want to sacrifice the reputation of your site, write the value rel=”nofollow” in the tags of this link. Spammers, having noticed a trend on your resource where a blocking attribute is added to unverified links, will soon stop trying to harm the site. If you see that a user leaves a link to high-quality material, you can delete nofollow manually or automatically.

How to correctly register nofollow?

Now nofollow allows you to manage each link separately, but once this value could only be used in the meta tag, which blocked absolutely all links on the page from the search engine. And to prevent certain links from being followed, webmasters had to block their URLs in .

Robots Nofollow

These meta tags remain to this day. If you want to block all links contained on a certain page from indexing, then on this page you need to write the following code:

It is important not to confuse this tag with the two codes below; content="none" and content="noindex, nofollow" block bots from accessing the entire page, not just its links. Therefore, if you want pages to be indexed, then under no circumstances write these two tags for them:

Above, we looked at options on how to prevent search robots from following all links on pages. But you can also set a ban on going to a specific link.

To prevent the robot from following a link for indexing, you need to add the rel=”nofollow” attribute to it; in the code it looks like this:

anchor hyperlinks

Does link weight leak through nofollow?

Although Google in its statements positions the use of the nofollow attribute as following a link. And this confirmed the appeal of the former head of the company against search spam, Matt Cuts. He stated that “Google can count links from social networks, even despite nofollow”.

But with Yandex the issue is not obvious. He clearly writes in his documentation that this attribute prohibits the indexing of such links.

And if we go to the description of the robots nofollow attribute, then here we already see a ban on the transition, and not a word about indexing.

But previously it was possible to check this if you used the following url construction in the search: your url<< inlink:(“анкор ссылки”), и Яндекс нам отображал только те страницы, где содержится наш искомый . Сейчас же этот метод не работает, поисковая система Яндекс запретила использовать такую конструкцию в поиске. Поэтому можно с большей долью вероятностью сказать, что Яндекс может учитывать такие ссылки, потому что они появляются в Яндекс Вебмастер.

In general, we can say that the use of this attribute for search robots is not always prohibited, especially if the site is authoritative.

Should you close internal links in nofollow?

In the past, SEO optimizers greatly abused this by manipulating the transmitted weight within the site. Therefore, the Google search engine stated that all internal links marked will give weight to nowhere https://www.mattcutts.com/blog/pagerank-sculpting/.

The former head of search at Google talks about this in the video. The video is in English, so please turn on Russian subtitles.

The noindex attribute: what is it and how does it differ from nofollow?

Many novice webmasters are scratching their heads, not understanding how noindex differs from nofollow. It's simple:

• nofollow - applies to links
• noindex - applies to text

If you want to prohibit text on the entire site page for indexing, but still take into account links, you need to write the following code on the page:

If you want to close part of the text, then Google does not have such an attribute, but in Yandex it is possible. The noindex tag was introduced by the Yandex search engine, since previously it did not understand nofollow, and unnecessary links had to be somehow hidden from robots.

But in 2010, the search engine began working with the rel=”nofollow” attribute, while noindex did not disappear, but remained responsible for hiding text. Now, if you want to block text or, for example, anchor links from indexing, write the command:

For example, this was convenient when Yandex introduced a new algorithm that imposed sanctions for SEO texts. As soon as you closed the foot wraps of the text in noindex, you could get out of this filter, and not lose positions in Google, since the Google search engine does not take into account the tag .

conclusions

Nofollow is responsible for ensuring that search engines follow these links, both on the entire page and for a specific link. Previously, noindex also performed a similar function, but only in relation to Yandex, which over time began to understand nofollow, as a result of which the value of noindex began to block content on the page from indexing.

The site owner must use the nofollow attribute correctly and understand in what cases to do this:

1. When the link leads to web resources with low-quality content.
2. When you post commercial content on a page.

The main task of using nofollow- help to indicate priority links for crawling, separate selling articles from informational ones, and also protect the site from spam, which, if not controlled, can lead to a decrease in ranking or, much worse, the removal of the resource from the index.

For all other situations, you can safely use ones that are open to search robots. The site’s reputation will not deteriorate at all, and will even improve if you leave links to pages that are useful to your target audience. And your documents will not lose any weight, but on the contrary, they may even gain due

Many optimizers know that TIC and PR indicators depend primarily on the quantity and quality of links to the site. But if your resource links to others, especially ones that are not relevant to the topic, then its weight drops. This article will tell you how to properly block unnecessary external links and text from indexing using tags.

Noindex

noindex tag used to disable indexing some specific part of the text. It should be remembered that this tag does not block links and images from search engines. If you still try to close an anchor with a link with this tag, then only the anchor (phrase) will not be indexed, and the link itself will definitely be included in the index.

Noindex prevents indexing of the part of the code located between the opening and closing tags. Here's an example:

Yandex does not index this text

Naturally, it should not be confused with the noindex meta tag, which is written at the beginning of the page; they have different tasks. If you take the meta tag , then it prohibits indexing the entire page and following links. This prohibition can also be specified in the robots.txt file and such pages will not be taken into account by search robots.

Valid noindex

Some HTML editors noindex is not accepted because it is not valid. For example, in WordPress the visual editor simply deletes it. But you can still give validity to the tag:

The text is closed by a valid noindex

If you write a tag in this form in an HTML editor, then it will be absolutely valid and you don’t have to be afraid that it will disappear. The noindex tag is perceived only by the Yandex search bot; the Google robot does not react to it at all.

Some optimizers make the mistake of advising to close all links with noindex and nofollow tags, but this will be discussed below. As for the operation of the noindex tag, it is trouble-free. Absolutely all information contained in these tags does not enter the index. But some webmasters claim that sometimes the text inside these tags is indexed by bots - yes, this really happens.

And this is all because Yandex initially indexes the entire html code of the page, even those located inside noindex, but then filtering occurs. Therefore, at first the entire page is actually indexed, but after a while the html code is triggered and the test enclosed in this tag “flies out” of indexing.

You don’t even need to respect the nesting of the noindex tag - it will still work (this is discussed in Yandex help desk). Don't forget when using the opening put a closing text at the end of the excluded text, otherwise all the text coming after the tag will not be indexed.

Nofollow

Attribute has a task hide links from search engines located in the text. It is used by optimizers to avoid transferring weight from the referring resource to the referenced one. Yandex is well aware of this attribute.

You need to know that nofollow does not save weight on the page - if the link is enclosed in this tag. The weight of the resource does not pass through it, but rather “burns out” or if there are other links on the page that are not closed by the attribute, the weight will be distributed between them. And if there is at least one external active link on a site page, then the weight of the page will go away.

The main difference between nofollow and noindex is that nofollow is an attribute for the tag , which prohibits the transfer of weight by link, and noindex is a tag that blocks the text you need from indexing. Here is an example of using the nofollow attribute:

Link text

Naturally, it makes no sense to set the nofollow attribute in links that lead to internal blog pages, although there are exceptions. In cases where weight from the page needs to be transferred to selected internal links, all others can be closed.