Forum Discussion
If you are trying to add a sitemap to the community, you might want to consider using the community sitemap.xml generation functionality (if you haven't already). It is mentioned in the following knowledge base article:
Regarding what you are trying to do with the crawl page, I think I may need a little more information from you to get a better understanding of what you are trying to do. Are you trying to point a crawler of some kind at the community crawl pages? I'm not sure I understand what you need the custom components for. Don't you just want to hit the crawl pages directly?
Thanks,
-Doug
For SEO purposes, I need a simple way to populate custom page that lists all the current blog articles. We do not score well on search engines, for reasons we have been unable to determine, so we are trying to jumpstart better results. I've tried building an API call to do this, and basically get no results. (I have little experience with programming via APIs, and all of the documentation on Lithosphere expects one to already be an expert. However, I can do a crawl of a blog and get the articles. It's just when the crawl ends, even though the component calls for another crawl, nothing happens. I tried multiple single-crawl components called by a higher-level component (think classic procedural programming), but same thing happens.