I have been using great Josh & company's Utility with two folders (NestRTD and Backfill) ever since they genrousy made it available. It worked flawlessly.
Recently seeing a new auto version of it I downloaded RTD and set it up as per short tutorials. It too worked nicely. However, I panicked when I tried to backfill with it recently. I'd missed two days data (june 4 & 5). So i backfilled on june 8 for two days data. first it took very long time in backfilling of two days data for about 5 scrips (in manual one through datatable it used to be so fast ... and to my horror .. I found that all my data prior to 4thjune 2015 gone. I am sure I surely did something silly.. some mistake in setting.. (fortunately I had an ami backing 15 days back.. so I was able to retrieve it and get latest data through my timetasted old data table and backfill , still I lost around 5 days data as data table provides no more than 10 days of intraday data).
What did I do wrong. I did setting according to instruction .. Is it because i have set delete quote - yes .. as it is instructed there..
What is right way to do Backfill without losing prior data of course?
Why is backfilling so slow. .. is there a way to do it fast?
I am so indebted and obliged to you people for being so patient and for poviding not just an utility but giving step by step instructions and all necessary helps. Thanks a lot!
Recently seeing a new auto version of it I downloaded RTD and set it up as per short tutorials. It too worked nicely. However, I panicked when I tried to backfill with it recently. I'd missed two days data (june 4 & 5). So i backfilled on june 8 for two days data. first it took very long time in backfilling of two days data for about 5 scrips (in manual one through datatable it used to be so fast ... and to my horror .. I found that all my data prior to 4thjune 2015 gone. I am sure I surely did something silly.. some mistake in setting.. (fortunately I had an ami backing 15 days back.. so I was able to retrieve it and get latest data through my timetasted old data table and backfill , still I lost around 5 days data as data table provides no more than 10 days of intraday data).
What did I do wrong. I did setting according to instruction .. Is it because i have set delete quote - yes .. as it is instructed there..
What is right way to do Backfill without losing prior data of course?
Why is backfilling so slow. .. is there a way to do it fast?
I am so indebted and obliged to you people for being so patient and for poviding not just an utility but giving step by step instructions and all necessary helps. Thanks a lot!
josh - If not already done, possible fix is to check the data from Backfill source and only delete if start and end time match.
Manual backfill exe does not have delete option yet - this means that if you have some data already and you backfill, your volume will be wrong.
I still use it, so as a workaround in this case i import data without volume using a modified exe. (This is used only when feed gets interrupted for short time)