Custom Component to Implement Multiple Crawls

If you are trying to add a sitemap to the community, you might want to consider using the community sitemap.xml generation functionality (if you haven't already). It is mentioned in the following knowledge base article:

https://community.khoros.com/t5/Tactical/Common-questions-about-Lithium-SEO/ta-p/117447?collapse_discussion=true&filter=includeTkbs&include_tkbs=true&q=sitemap&search_type=thread

Regarding what you are trying to do with the crawl page, I think I may need a little more information from you to get a better understanding of what you are trying to do. Are you trying to point a crawler of some kind at the community crawl pages? I'm not sure I understand what you need the custom components for. Don't you just want to hit the crawl pages directly?

Thanks,

-Doug

For SEO purposes, I need a simple way to populate custom page that lists all the current blog articles. We do not score well on search engines, for reasons we have been unable to determine, so we are trying to jumpstart better results. I've tried building an API call to do this, and basically get no results. (I have little experience with programming via APIs, and all of the documentation on Lithosphere expects one to already be an expert. However,  I can do a crawl of a blog and get the articles. It's just when the crawl ends, even though the component calls for another crawl, nothing happens. I tried multiple single-crawl components called by a higher-level component (think classic procedural programming), but same thing happens.

If you are calling into the community from another application to crawl the boards ,you probably don't want to call a component on a page, but want to call either an API (Here's the REST API V2 getting started page and how to make a REST call via Freemarker section of that page) or an Endpoint.

If you want to share your component code though, I could possibly offer some advice on what you might want to try.

Thanks,

-Doug

I took the < and > off each line. One of the annoyances of this editor.

<ahref="https: community-stage.ext.hpe.com="" hpeb="" crawl_boards?board.id="alliancesblog" "=""><ahref="https: community-stage.ext.hpe.com="" hpeb="" crawl_boards?board.id="AroundtheStorageBlock" "=""><ahref="https: community-stage.ext.hpe.com="" hpeb="" crawl_boards?board.id="BehindthescenesatLabs" "="">a href="https://community-stage.ext.hpe.com/hpeb/crawl_boards?board.id=alliancesblog">Alliances Blog
a href="https://community-stage.ext.hpe.com/hpeb/crawl_boards?board.id=AroundtheStorageBlock">Around the Storage Block
a href="https://community-stage.ext.hpe.com/hpeb/crawl_boards?board.id=BehindthescenesatLabs">Behind the Scenes at Labs</ahref="https:></ahref="https:></ahref="https:>

Output is three clickable links:

Alliances Blog
Around the Storage Block
Behind the Scenes at Labs

but what I want is a page that just does them all (I have 19 blogs)

I've tried a couple of other versions (pseudo code)

#assign blog3 = a href="https://community-stage.ext.hpe.com/hpeb/crawl_boards?board.id=BehindthescenesatLabs"> />
p>Behind the Scenes at Labs:
${blog3}​

(missing some < and >)

This doesn't work at all.

Warren_Brill What's the expected output of the crawl and what are you then doing with it?

Just an on-demand listing of all current blog articles, every time the page is crawled by a search engine. Otherwise, if someone wanted a listing of all current blog articles on the site for some other reason, the page would be there.