Search and Index questions

Hi venkat_O2,

1. message-uid and highlight/true are both used to higlight certain messages in the thread. They're typically used in conjunction with an anchor tag to "jump" to the desired message. For example:

http://lithosphere.lithium.com/t5/Lithium-Developers/More-on-Colors-Customizing-the-Mobile-Interface/m-p/29972/message-uid/29996#U29996 - In this case, 29972 is the message uid of the thread, and 29996 is the message uid of my reply.

http://lithosphere.lithium.com/t5/Lithium-Developers/More-on-Colors-Customizing-the-Mobile-Interface/m-p/29996/highlight/true#M276

2. For communities that have enabled our Mobile view, the device-view query parameter allows you to specify whether you want to see the page optimized for desktop devices or optimized for mobile devices. For example:

http://lithosphere.lithium.com/t5/Lithium-Developers/More-on-Colors-Customizing-the-Mobile-Interface/m-p/29972?device-view=desktop

http://lithosphere.lithium.com/t5/Lithium-Developers/More-on-Colors-Customizing-the-Mobile-Interface/m-p/29972?device-view=mobile (WARNING: If you click this link, you will need to click the "Full" link at the bottom of the page to get back to Desktop view, or manually append ?device-view=desktop to the URL)

Regarding crawling in general, I'd definitely suggest you check out our Crawl List feature, which may suit your needs better than trying to crawl through the entire community. Here's more information about it:

http://lithosphere.lithium.com/t5/Customer-Connection-Private/Crawl-List/ta-p/19246

http://lithosphere.lithium.com/t5/Customer-Connection-Private/Implementing-federated-search-using-a-crawl-list/ta-p/7275

Hi Adam,

Thanks for your response.

We are currently looking on how to avoid duplicate urls in search results and as mentioned the crawler picks up the desktop url and mobile url of the same page in displays in the search results. Is there any way to aviod the additional device-view=desktop and device-view=mobile urls being index?

I have been told by Lithium that the crawl boards approach has been deprecated recently. Please confirm if this is not thecase. We had been suggested the following two approaches:

1. point the search appliance at the root of the community

2. Or utilize the REST API approach

So we started crawling from the root of the community. Here we what we realised is that the Category name is not present in the url.

e.x. below is a url for for a Thread. 

http://o2uk.stage.lithium.com/t5/News-and-Announcements/O2-Priority-Moments-is-here/td-p/196020    

Here the Board name is News-and-Announcements and Thread name is O2-Priority-Moments-is-here

The category O2-News-and-Announcements is not present anywhere in the url.

We have a requirement here to index Category wise and not the whole community as indexing the whole community is taking long times. But if we were to index staring from this below url appended with * then we are not indexing any board or thread as their structure is different. 

http://o2uk.stage.lithium.com/t5/O2-News-and-Announcements/*

The only option that remains is to index at board level but as boards are added more frequently compared to categories and every time a new board is added a new index has to be created. So is there a way to add the category also in the URL?

Please let me know your thoughts.

Thanks,

Venkat

Hi Adam,

We are now not seeing any multiple urls for a particular page after setting the user agent as a desktop browser in the search indexing. Is there a way that Lithium can configure/add the "user agent" of the seach engine we use to not return duplicate urls? 

For the other issue on the url srtucture, we have started indexing at board level rather than at Category level. Is there a way that the category name can be made available in the URL?

e.x. http://o2uk.stage.lithium.com/t5/News-and-Announcements/O2-Priority-Moments-is-here/td-p/196020

Here the category O2-News-and-Announcements is not present anywhere in the url. Can this be made part of the url??

Thanks,

Venkat