In this instruction we will consider the issue of adding our new site for indexing to various search engines.
I decided to mention both popular search engines and those that you may not have heard of.
Site indexing in Yandex
To add a site for indexing, just enter the url home page and captcha. Captcha is a few numbers that protect against automatic registrations. After you click the “add” button, several options for the development of events are possible.
1) The message “your site has been added” signals the successful addition of a resource to the queue for indexing in Yandex.
2) If the message “Your hosting is not responding” appears, it means that your server is down at this moment. You can try adding a site later or find better hosting.
3) But if a message appears that “the specified URL is prohibited from indexing,” then things are bad. This indicates that sanctions have been imposed on your resource in the form of a site ban. It is quite possible that the domain you purchased already had a website that received sanctions. Using addurl, webmasters often check sites for bans in Yandex.
Site indexing in Google (Google)
The next most important search engine for our site is Google. The process of adding a site to indexing in Google is exactly the same as on Yandex. Google also has its own adurilka, which is located at: https://www.google.com/webmasters/tools/submit-url.
You also need to enter a captcha when adding. But there are two differences. If in Yandex you can simply add a URL without unnecessary movements, then in Google you need to be logged in to your account. Otherwise it won't work. Accordingly, if you don’t have an account there yet, you will have to create one. The second difference between Google and Yandex is the speed of indexing. Google indexes websites very quickly.
Site indexing in Rambler (Rambler.ru)
Of course, Rambler is not what it used to be, as many will say, and provides very little traffic. And anyway, why neglect them? The site indexing process in Rambler is the longest among other domestic search engines. And his adurilka has not been working for a long time, it was at: robot.rambler.ru/cgi-bin/addsite.cgi
He has been using the Yandex search database for a long time. Therefore, to get into the Rambler.ru index it is enough to add to Yandex.
Site indexing in Mail.ru (Mail)
The Mail.ru search engine also has a webmaster's account. Adding a site for indexing in Mail.ru occurs through the addurl form, which is located at: go.mail.ru/addurl
Moreover, like Google, in order to apply for indexing, you need to create your own account and log into it. It won't work out otherwise. Mile in Lately tries to develop its own tools for webmasters.
Above we looked at the main domestic search engines in which we would like to index our site. I will give the following PS more for your general SEO erudition than for specific actions.
Search engine Aport.ru (Aport)
Aport.ru was once a search engine, with its own index database and adurilka. Now it has been turned into a product search engine in which you can compare prices for goods and services.
Search engine Nigma.ru (Nigma)
Nigma.ru is our Russian intelligent search engine. The total volume of its traffic is about three million requests per day. Obviously, traffic from Nygma should not be neglected. You can add your site for indexing in Nigma on the page nigma.ru/index_menu.php?menu_element=add_site.
Media navigator Tagoo.ru
The Tagoo.ru system is a media search engine that searches for media data. This includes music content, videos and programs. In order for your site to be indexed by the Tagoo system, you need to use the add form: tagoo.ru/ru/webmaster.php?mode=add_site.
Search engine Turtle.ru (Turtle)
The international search engine Turtle (Turtle) searches across the CIS countries in any language. For indexing, resources located on such sites are accepted domain zones like: ru, su, ua, am, az, ge, by, kz, kg, uz, md. To add a site for indexing in Turtle, you need to use Aduril: http://www.turtle.ru/add.html. It is advisable to wait for the message that your site has been accepted. It may not be added, but you won’t even know.
Foreign search engines
If the above were domestic search engines, then below there will be a list of foreign search engines.
Search engine Yahoo.com (Yahoo)
Search engine Bing.com (Bing)
The Bing search engine is owned by Microsoft and was created to replace Live Search. Microsoft hopes that the new brainchild will be much more popular than its predecessor. If you want your Bing.com site to be indexed, you can do so at http://www.bing.com/toolbox/submit-site-url.
Ukrainian search engines
And in conclusion of my review, I will cite two popular search engines in Ukraine.
Ukrainian search engine Meta.ua (Meta)
For the convenience of webmasters and search engines, a special sitemap format has been developed - sitemap. This is a list of links to internal pages of the site, presented in XML format. This format is also supported by Yandex. In a special section of the service you can download a sitemap for your website. This will allow you to influence the priority of the robot crawling some pages of your site. For example, if some pages are updated much more often than others, you should indicate this information so that the Yandex robot plans its work correctly.
Yandex indexes the main types of documents distributed on the Internet. But there are restrictions that determine how the document will be indexed, and whether it will be indexed at all:
A large number of cgi parameters in a URL, a large number of duplicate subdirectories and too long a total URL length can lead to poor document indexing.
The size of the document is important for indexing - documents larger than 10MB are not indexed.
Flash indexing:
*.swf files are indexed if they have a direct link or are embedded in html tags object or embed ;
if flash contains useful content, the original html document can be found by content indexed in the swf file.
IN PDF documents Only text content is indexed. Text presented in the form of pictures is not indexed.
Yandex correctly indexes documents in the format Open Office XML and OpenDocument (in particular Microsoft documents Office and Open Office). But keep in mind that implementing support for new formats may take some time.
It is acceptable to use tags
If you have overridden the server behavior for non-existent URLs, make sure that the server returns a 404 error code. When the search engine receives a 404 response code, it will remove the document from its index. Make sure that all necessary pages on the site display the code 200 OK.
- The scan may take several days or several weeks. You can find out about its progress using a special report or a URL checking tool.
- Processing times for requests submitted by any of the listed methods, are almost identical.
- There are quotas for individual URL crawl requests.
- Requesting the same URL or Sitemap to be crawled many times will not result in it being crawled any faster.
How to request a page crawl
To request a URL crawl, follow these steps:
- Check the URL using this tool.
- Select Request Indexing. The tool will check the page for indexing problems. If none are found, the page will be added to the queue for indexing. If the tool identifies problems, try to resolve them.
There are several ways to request a sitemap crawl:
- Use the special report.
- Perform a ping request. In the browser or command line send a GET request to the address below, including the full URL of the Sitemap file and making sure the file is accessible:
http://www.google.com/ping?sitemap=
Example
http://www.google.com/ping?sitemap=https://example.com/sitemap.xml - Insert a line anywhere in the robots.txt file, which points to the location of the Sitemap (this will be found during the next crawl). Example:
Sitemap: http://example.com/my_sitemap.xml
Typically, the average period for indexing by Yandex is 1–2 weeks.
Some blogs are indexed much faster. The posts that I publish on my blog are indexed by Yandex within two hours, or even within two minutes. But there are exceptions.
This happened with two pages “How to write texts to get to the top? "(04/14/2011) and "iForum 2011. What happened this year" (04/18/2011). What's wrong with them? Why aren't they in the index? So much time has already passed.
I have already reposted it on Twitter and posted links on two other blogs and used the add form //webmaster.yandex.ru/site/add.xml.
Hello.
Please tell me what could be the reason.
Sincerely yours, Ilya.
Plato's answer soon came:
Hello, Ilya!
The specified page has already been indexed by the robot and should appear in the search results after the next update of the search databases. Please wait a few more days.
—
Sincerely, Platon Shchukin
Yandex support service
help.yandex.ru
Honestly, I was comforted by this answer. But after the update search results Yandex, which happened on April 29, 2011, I became worried again. These pages never appeared in search results. But why? What's wrong with them? Promotion is inevitable only with indexed links. Otherwise, they are simply not taken into account, although they are posted on the page.
Google, by the way, indexed both documents.
Well, okay, while Yandex is updating its search results database, I bring to your attention a wonderful video about future technologies made on glass. In principle, I think websites will also develop in this direction. In particular, interfaces and navigation already partially look like this.
P.S. I checked on April 30 - the pages are already in the Yandex index. A copy of these pages was saved on April 24, 2011. Hooray!
Things don't always look good with new sites. Yandex indexes them very slowly. Yandex.Webmaster says:
Your site is not indexed by Yandex. (The site has been successfully added to the indexing queue)
If the site is new and was not previously known to the robot, then after adding it to the Yandex.Webmaster service it will begin to be indexed and then appear in the search. This usually happens within two weeks from the moment the site is added.
Yandex.Webmaster writes that the site is not indexed because it is new, but at the same time it can index 2 pages. That is why, for the “Promotion Is Inevitable” competitions, competitions are held in Russian Google.
When adding a new site to Yandex.Webmaster, a message appears that the site has been added to the queue for indexing. After two or three days there are already changes:
The site has started to be indexed. Pages should appear in search after 1-2 updates to the search database. The search may contain pages indexed by a fast robot.
Due to the delay latest ups, Yandex is asked questions to which it gives equally informative answers
As for the statistics of ups, it is displayed in the table.
The frequency of Yandex updates leaves much to be desired How to speed up site indexing
And finally, a small life hack on how to speed up site indexing. You just need to get a couple of fat ones external links to the page you need (for example, a new article on your blog). It is important that the links come from trusted sites and popular (thematic) groups social networks, Where
Adding a site for indexing in Rambler.
"Since June 23, 2011, Rambler-Search has been using Yandex search technologies, supplemented by its own services. You can add a site to the search engine index through the Yandex system".
Don't forget to add your site to Top100.Rambler, it won't hurt.
Adding a site for indexing in Mail.ru.
Adding a site is very simple, send the URL and wait, do not forget to submit a FREE application to be included in the Mail.ru catalog, if approved, it will be good. Without closing the page for adding a site to the search, follow the link to add to the Mail.ru catalog and fill out the form (in this case, you will be able to submit a free application to the catalog).
Adding a site for indexing to the Aport.ru catalog.
To add a site you will have to go through 5 simple steps. First, add the site URL. At the first stage, it is checked for the response of the site and for the presence of the site in the directory; if it is not there, then the second step will appear. In the second step, fill in information about the site, name, description, keywords, etc. In the third step, select a section (sections resemble those in the Mail.ru catalogue). The fourth step is to add the site region (also somewhat reminiscent of Mail.ru). Fifth step, enter the captcha (capitals are taken into account) and check the entered data, if everything is correct, click next. You have been added, we are waiting for moderation on Mailbox.
Adding a site for indexing in GOGO.ru.
I can’t say about the significance of this resource and being in it, but I can say one thing, it won’t hurt, and suddenly they will come from it (in practice this has not happened, but everything is changing). To add on the Internet there is a link http://gogo.ru/wmaster/add_site.html, after clicking on it, I realized that this is already the Mail.ru search engine (I left the link, just in case).
Adding a site for indexing in NIGMA.ru.
The next system is nigma.ru. They write about it that it gives an influx of people, I didn’t notice, but I added, maybe it will be useful. Moreover, it is fast. Specify the URL, mailbox and update frequency, save and that’s it.
Adding a site for indexing in TAGOO.
The Tagoo search engine apparently specializes in media content, if you have it or may appear, add it. I can’t judge the significance of this search engine, I don’t know it, but I added it.
Adding a site to Turtle indexing.
The system is focused on resources from the Commonwealth of Independent States of the CIS in any language, as well as Russian-language resources from other countries. You can add . But due to the death of its founder Dmitry Kryukov, the resource temporarily suspended its activities. As it is written on the website TEMPORARILY, this means we are not removing it from our accounts.
Now we have reached foreign search engines.
Adding a site to Yahoo and Bing indexing.
Yahoo has merged its search engine from Bing and redirects the old URL to Bing to add was http://search.yahoo.com/info/submit.html. Add to Bing. We add and rejoice, we can also register and get a webmaster panel, I didn’t register there, but this is not an indicator. Try it for clarity.
