Forum Discussion

skapid's avatar
skapid
Contributor
11 years ago

Need to retrieve all the messages from the community (more than 10000 messages)

Hi All,

 

I am trying to retrieve all the messages posted on a forum in the past 1 year. 

To implement that, I am using an iterative approach (by using page & page_size parameters)

But what I see is that I am unable to proceed after 10000 messages.

It looks like the max value for Page_Size is 1000, and for Page is 10. (hence, the max no of messages that I can retrieve through Lithium API is 10000)

 

Is there a way (or probably a work-around) to retrieve all the messages without any limitations.

 

Thanks & regards,

Deepak.S

1 Reply

Sort By
  • Tim_h's avatar
    Tim_h
    Boss
    11 years ago
    You might be able to work around it by retrieving your messages at a smaller level and iterating through your boards etc one by one.

    Alternatively you could just find the message id for the first post of the year, and then iterate through them one by one to see if they exist and store them from there. It'd be a lot of calls, but it would get everything.

    Just make sure to do it from a user who doesn't have access to the moderation boards and test for the message ID before retrieving it. Your filter notices and abuse reports are in the same pool of ID's.