Hi HaidongG,
Thanks, but using the page_size, we could miss any recent data that is, let say any discussion that was posted recently but was not in fetched in last 30 pages because, e.g. we had 310 discussions created in last 15 minutes and in last 30 pages, for 15 minutes, with page_size 10, we would only be fetching 300 discussions, and miss the 10, and then in next 15 minutes, lets say when we have 100 more discussions created, so in next cycle, our crawler will crawl 100 new + 10 of those discussions which were missed earlier, and 190 of the 300 crawled earlier. So, we don't want to fetch them based on page size, but rather include all the discussions that were created recently, so we don't re-crawl the same data again and again. So that is why we were concerned about the time lithium considers as recent so we can query the data based on its post date and time.
