In order to to utilise streaming data for any kind of index algorithm the data should stream in a fixed fashion
I have noticed some inconsistency in the streaming data which i am posting here
[{"tvalue":"16/12/2020 11:22:25","name":"tm"},{"e":"nse_cm","name":"sf","ltp":"1977.00","ltq":"11","tk":"2885","ltt":"NA"}]
[{"to":"7306167033.00","lo":"1970.05","e":"nse_cm","sp":"1977.10","c":"1974.35","ltp":"1977.00","ltq":"23","tk":"2885","bs":"7","ltt":"16/12/2020 11:22:25","tsq":"971806","v":"3687525","bp":"1977.00","cng":"02.65","bq":"787","ap":"1981.32","nc":"00.13","name":"sf","tbq":"495602"}]
[{"tvalue":"16/12/2020 11:22:26","name":"tm"},{"e":"nse_cm","name":"sf","ltp":"1977.00","ltq":"25","tk":"2885","ltt":"NA"}]
[{"to":"7306315632.00","lo":"1970.05","e":"nse_cm","sp":"1977.10","c":"1974.35","ltp":"1977.00","ltq":"32","tk":"2885","bs":"7","ltt":"16/12/2020 11:22:26","tsq":"972439","v":"3687600","bp":"1977.00","cng":"02.65","bq":"751","ap":"1981.32","nc":"00.13","name":"sf","tbq":"495582"}]
I hope you have noticed the pattern of response first line of one stream always starts with tvalue and second line with to
but after some time randomly here and there this is the response
[{"tvalue":"16/12/2020 11:22:36","name":"tm"},{"e":"nse_cm","name":"sf","ltp":"1976.65","ltq":"1","tk":"2885","ltt":"NA"}]
[{"tvalue":"16/12/2020 11:22:37","name":"tm"},{"to":"7316797530.79","lo":"1970.05","e":"nse_cm","sp":"1977.00","c":"1974.35","ltp":"1976.65","ltq":"1","tk":"2885","bs":"1019","ltt":"16/12/2020 11:22:36","tsq":"976276","v":"3692909","bp":"1976.65","cng":"02.30","bq":"32","ap":"1981.31","nc":"00.12","name":"sf","tbq":"492910"}]
[{"e":"nse_cm","name":"sf","ltp":"1976.65","ltq":"1","tk":"2885","ltt":"NA"}]
[{"to":"7316811399.96","lo":"1970.05","e":"nse_cm","sp":"1977.00","c":"1974.35","ltp":"1976.65","ltq":"5","tk":"2885","bs":"1190","ltt":"16/12/2020 11:22:37","tsq":"976505","v":"3692916","bp":"1976.65","cng":"02.30","bq":"25","ap":"1981.31","nc":"00.12","name":"sf","tbq":"493128"}]
[{"to":"7316813381.27","lo":"1970.05","e":"nse_cm","sp":"1977.00","c":"1974.35","ltp":"1976.65","ltq":"1","tk":"2885","bs":"977","ltt":"16/12/2020 11:22:38","tsq":"976246","v":"3692917","bp":"1976.65","cng":"02.30","bq":"24","ap":"1981.31","nc":"00.12","name":"sf","tbq":"493058"}]
Both the tValue and to lines get mixed up with each other
P.S : This question seems confusing, will be happy to discuss this over a call