一括表示 |
---|
M - the suggestion to use robots.txt for those pages in the Webmaster Guidelines still stands. It's the easiest way to prevent crawling (and generally, indexing) of these pages. One problem with search results pages is that they generally provide a source of infinite URLs, which makes crawling a site properly very difficult. |