venkat_O2
14 years agoContributor
Search and Index questions
We are trying to come-up with a indexing strategy and below are the problems which we are facing.
During crawl the crawler is indexing the same page again and again with these different parameters and Search Engine ends up indexing same page 4-5 times.
All these urls are actually poitning to the same page, which crawler automatically discovers.
For Example:
http://o2uk.stage.lithium.com/t5/Apple/Solve-your-email-sending-problems/td-p/28/device-view=desktop
Can you please clarify about :
1. What is 'message-uid' and 'highlight/true' are used in the url?
2. What is the use of device-view query parameter, and why server appends it? will it be possible to remove it from server side? Possible values it contain are - desktop and mobile.
Or how can we ensure that single instance of the page is indexed?