Welcome to the Webmaster Forum.
Results 1 to 4 of 4
  1. #1
    Senior Member
    Join Date
    Oct 2016
    Posts
    160

    What is working process of spiders and bots?

    What is working process of spiders and bots?

  2. #2
    Member
    Join Date
    Aug 2016
    Posts
    78

    Re: What is working process of spiders and bots?

    Spider's search engine:
    - First Spider retrieve a list of servers and popular sites. Spider will start searching for a particular site, it indexes from its site and follow the links (links) found within this Site. Under this method, the search engine Google will do the job quickly and spread out all the sections of the most widely used web.

    - When Spider review sites (in HTML format), it noted: The words within the site & find where it's from.
    The word appears in the Title tag, Meta Description .... it says it is an important part related to the user's search later. So Google it for each website will have many ways to index the index, listed the main keywords. But how does Google use will be trying to make the system go faster search so that users can search more efficiently, or both.

  3. #3
    Senior Member
    Join Date
    Jun 2014
    Location
    Bangalore, India
    Posts
    175

    Re: What is working process of spiders and bots?

    A Search Engine Spider (also known as a crawler, Robot, SearchBot or simply a Bot) is a program that most search engines use to find what’s new on the Internet.

  4. #4
    Member
    Join Date
    Oct 2016
    Posts
    48

    Re: What is working process of spiders and bots?

    To know how spiders work, it's practical to think of them as automatic data searching robots. As I've said, spiders passage the every website to find as many new or updated web pages and links as possible. When you submit your web pages to a search engine at the "Submit a URL" page in webmaster tool, you will be added to the spider's list of web pages to visit on its next search mission out onto the internet. Your web pages could be found, even if you didn't submit them. Spiders can find you if your web page is linked from any other web page on a "known" web site.
    When spider reaches at your webpage, it head looks for a robots.txt file that used to tell spiders which areas of your site to be index and which one not. The next step of spider is to gather outbound links from the page. Spiders track links from one page to another page. This is the original indication behind spiders.

 

 

Similar Threads

  1. what is spiders,crawlers,bots?
    By william1194 in forum Search Engine Optimization (SEO)
    Replies: 6
    Last Post: 11-11-2016, 04:23 AM
  2. what is spiders,crawlers,bots?
    By access1solution7 in forum Search Engine Optimization (SEO)
    Replies: 2
    Last Post: 11-08-2016, 02:39 AM
  3. Website hits statistics - from bots
    By kai_uk in forum Affiliate Programs & Affiliate Marketing
    Replies: 0
    Last Post: 02-26-2014, 05:25 AM
  4. Search Engine Bots
    By easypr in forum Search Engine Optimization (SEO)
    Replies: 0
    Last Post: 10-17-2013, 07:06 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Back to top

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212