Search and Index questions

Hi Adam,

Thanks for your response.

We are currently looking on how to avoid duplicate urls in search results and as mentioned the crawler picks up the desktop url and mobile url of the same page in displays in the search results. Is there any way to aviod the additional device-view=desktop and device-view=mobile urls being index?

I have been told by Lithium that the crawl boards approach has been deprecated recently. Please confirm if this is not thecase. We had been suggested the following two approaches:

1. point the search appliance at the root of the community

2. Or utilize the REST API approach

So we started crawling from the root of the community. Here we what we realised is that the Category name is not present in the url.

e.x. below is a url for for a Thread. 

http://o2uk.stage.lithium.com/t5/News-and-Announcements/O2-Priority-Moments-is-here/td-p/196020    

Here the Board name is News-and-Announcements and Thread name is O2-Priority-Moments-is-here

The category O2-News-and-Announcements is not present anywhere in the url.

We have a requirement here to index Category wise and not the whole community as indexing the whole community is taking long times. But if we were to index staring from this below url appended with * then we are not indexing any board or thread as their structure is different. 

http://o2uk.stage.lithium.com/t5/O2-News-and-Announcements/*

The only option that remains is to index at board level but as boards are added more frequently compared to categories and every time a new board is added a new index has to be created. So is there a way to add the category also in the URL?

Please let me know your thoughts.

Thanks,

Venkat