首頁 > seo優化知識 > 每個建站程序的Robots文件寫法都一樣嗎?
2015
05-30

每個建站程序的Robots文件寫法都一樣嗎?

每個建站程序的Robots文件寫法都一樣嗎? - 第1張  | 楓葉樹seo博客

robots.txt是搜索引擎蜘蛛訪問我們網站時第一個要看的文件。這個文件是告訴蜘蛛在爬取我們網站時,哪些文件可以看,哪些文件不能看。如果我們網站上有些信息不想被搜索引擎蜘蛛爬取,這個時候我們就可以寫一個robots.txt文件,告訴蜘蛛不要索引我們這個文件。

看完上面這段話,相信大家也可以知道robots.txt文件是干什么用的。但是我們當下有很多熱門的建站程序,例如:wordpress、dedecms、phpcms、discuz等等,那么這些建站程序的robots.txt文件的寫法都是一樣的嗎?答案肯定不是。今天我就給大家分享下這些熱門建站程序的robots.txt文件該怎么寫。

1.WordPress建站程序的robots.txt文件寫法
User-agent: *
Disallow: /wp-admin
Disallow: /wp-content/plugins
Disallow: /wp-content/themes
Disallow: /wp-includes
Disallow: /?s=
Sitemap: http://www.***.com/sitemap.xml

2.DedeCMS建站程序的robots.txt文件寫法
User-agent: *
Disallow: /plus/feedback_js.php
Disallow: /plus/feedback.php
Disallow: /plus/mytag_js.php
Disallow: /plus/rss.php
Disallow: /plus/search.php
Disallow: /plus/recommend.php
Disallow: /plus/stow.php
Disallow: /plus/count.php
Disallow: /include
Disallow: /templets
Disallow: /member

3.phpcms建站程序的robots.txt文件寫法
User-agent: *
Disallow: /admin
Disallow: /data
Disallow: /templates
Disallow: /include
Disallow: /languages
Disallow: /api
Disallow: /fckeditor
Disallow: /install
Disallow: /count.php
Disallow: /comment
Disallow: /guestbook
Disallow: /announce
Disallow: /member
Disallow: /message
Disallow: /spider
Disallow: /yp
Disallow: /vote
Disallow: /video

4.discuz論壇建站程序的robots.txt文件寫法
User-agent: *
Allow: /redirect.php
Allow: /viewthread.php
Allow: /forumdisplay.php
Disallow: /?
Disallow: /*.php

總結:以上就是當下4個熱門建站程序的robots.txt文件寫法。當然我這里并不是要大家在實際操作過程中也按照這個方法來寫,因為這里都是我用經驗總結出來的,其中有些協議大家可能都涉及不到,所以希望大家靈活的使用,不要太死板。


每個建站程序的Robots文件寫法都一樣嗎?》有 8 條評論

  1. I’m also commenting to make you be aware of of the fantastic discovery my cousin’s princess had reading yuor web blog. She noticed plenty of pieces, which included what it is like to have an awesome helping spirit to have a number of people with ease know precisely some hard to do topics. You undoubtedly did more than her desires. Thank you for presenting those warm and helpful, dependable, educational and unique thoughts on your topic to Lizeth.

  2. nike roshe 說:

    I definitely wanted to post a simple remark in order to thank you for all the nice secrets you are giving out at this site. My considerable internet look up has finally been compensated with extremely good concept to share with my colleagues. I ‘d claim that we visitors are undeniably endowed to be in a fantastic place with many perfect people with useful methods. I feel rather privileged to have come across your entire web page and look forward to many more amazing minutes reading here. Thanks a lot once more for all the details.

  3. I simply needed to say thanks again. I’m not certain the things that I would have tried without the entire thoughts documented by you concerning my situation. It previously was an absolute alarming matter in my circumstances, but seeing this professional mode you handled that took me to leap for happiness. Now i’m thankful for this support and even hope that you comprehend what a powerful job your are doing training the mediocre ones using your site. More than likely you’ve never got to know any of us.

  4. My spouse and i were absolutely happy when Jordan could finish off his preliminary research with the ideas he received out of your web site. It’s not at all simplistic to just always be giving away instructions which often many others may have been making money from. And we all remember we have got you to give thanks to for that. The main explanations you made, the straightforward website navigation, the friendships you can make it possible to promote – it is all amazing, and it’s really helping our son in addition to our family know that that content is interesting, which is pretty pressing. Many thanks for all the pieces!

  5. curry 5 說:

    I simply had to appreciate you once more. I’m not certain what I would have followed in the absence of these creative ideas shown by you over such a theme. It had become an absolute frightful problem in my opinion, however , taking note of a specialised manner you processed the issue took me to leap with joy. I’m just grateful for this support and then hope you are aware of a powerful job you happen to be undertaking educating many others through the use of your website. I am certain you’ve never encountered any of us.

  6. jordan 4 說:

    I just wanted to send a note so as to express gratitude to you for those stunning steps you are giving at this website. My time-consuming internet research has finally been paid with incredibly good tips to share with my two friends. I would tell you that we site visitors are really blessed to exist in a remarkable website with many marvellous professionals with helpful things. I feel very much blessed to have seen your weblog and look forward to tons of more pleasurable times reading here. Thanks a lot once more for a lot of things.

  7. I want to show some thanks to this writer just for rescuing me from this particular instance. Just after looking through the world wide web and obtaining notions which are not powerful, I believed my entire life was gone. Existing without the presence of solutions to the problems you’ve fixed by means of your entire article is a critical case, as well as the kind which may have adversely damaged my entire career if I had not encountered your site. Your main expertise and kindness in dealing with all areas was excellent. I don’t know what I would have done if I had not come across such a solution like this. It’s possible to now look ahead to my future. Thanks for your time very much for your specialized and effective guide. I won’t be reluctant to refer your web blog to anyone who should receive support about this subject matter.

  8. golden goose 說:

    I am just commenting to make you know of the really good discovery my cousin’s child gained viewing your blog. She learned such a lot of details, most notably how it is like to possess an excellent helping character to get the rest very easily comprehend specified grueling things. You really did more than my expectations. Thank you for producing such productive, safe, explanatory and in addition unique tips on your topic to Gloria.

留下一個回復

你的email不會被公開。