cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-325993%22%20slang%3D%22en-US%22%3EBulk%20API%20not%20giving%20all%20the%20data%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-325993%22%20slang%3D%22en-US%22%3E%3CP%3EHi%20Everyone%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20have%20been%20ingesting%20the%20bulk%20API%20data%20on%20the%20daily%20basis.%20I%20extract%20the%20data%20for%20the%20current%20date%20-%201.%26nbsp%3B%3C%2FP%3E%3CP%3EI%20have%20been%20facing%20an%20issue%20i.e%20on%26nbsp%3BOctober%26nbsp%3B9%20and%20I%20am%20fetching%20the%20data%20for%20October%26nbsp%3B8%20I%20get%20200K%20records.%20on%20October%26nbsp%3B11%20I%20fetch%20the%20data%20for%20October%208%20again%20I%20get%20210K%20records.%20I%20am%20not%20sure%20how%20with%20the%20same%20API%20call%20I%20am%20getting%20a%20different%20number%20of%20records.%3C%2FP%3E%3CP%3EDoes%20anyone%20has%20faced%20the%20same%20issue%3F%26nbsp%3Band%20is%20there%20any%20workaround%20to%20get%20all%20the%20data%20at%20once%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks%2C%3C%2FP%3E%3CP%3EManpreet%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-326252%22%20slang%3D%22en-US%22%3ERe%3A%20Bulk%20API%20not%20giving%20all%20the%20data%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-326252%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F71446%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%40RaghavendraMN%3C%2FA%3E%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks%20for%20the%20input%2C%20but%20do%20you%20have%20any%20idea%20any%20other%20using%20facing%20the%20same%20issue%3F%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks%2C%3C%2FP%3E%3CP%3EManpreet%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-326040%22%20slang%3D%22en-US%22%3ERe%3A%20Bulk%20API%20not%20giving%20all%20the%20data%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-326040%22%20slang%3D%22en-US%22%3E%3CP%3EHi%20%3CA%20href%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F70008%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%40gandhim%3C%2FA%3E%2C%3CA%20href%3D%22https%3A%2F%2Fcommunity.lithium.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F68423%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%40Manpreet%3C%2FA%3E%20In%20this%20scenario%20you%20need%20raise%20support%20ticket%20to%20lithium.%20They%20will%20guide%20you.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks%2C%3C%2FP%3E%3CP%3ERaghavendra%20MN.%3C%2FP%3E%3C%2FLINGO-BODY%3E
Highlighted
Occasional Contributor

Bulk API not giving all the data

Hi Everyone,

 

I have been ingesting the bulk API data on the daily basis. I extract the data for the current date - 1. 

I have been facing an issue i.e on October 9 and I am fetching the data for October 8 I get 200K records. on October 11 I fetch the data for October 8 again I get 210K records. I am not sure how with the same API call I am getting a different number of records.

Does anyone has faced the same issue? and is there any workaround to get all the data at once?

 

Thanks,

Manpreet

2 Replies 2
Highlighted
Occasional Commentator

Hi @gandhim,@Manpreet In this scenario you need raise support ticket to lithium. They will guide you.

 

Thanks,

Raghavendra MN.

Occasional Contributor

Hi @RaghavendraMN,

 

Thanks for the input, but do you have any idea any other using facing the same issue?

 

Thanks,

Manpreet