eVIN assessment

Electronic Vaccine Intelligence Network (eVIN) assessment was conducted in 12 states (Assam, Chhattisgarh, Gujarat, Jharkhand, Manipur, Nagaland, Odisha, Bihar Himachal Pradesh, Madhya Pradesh, Rajasthan and Uttar Pradesh) where eVIN was launched initially. A pre-post comparison was used on key performance indicators for programmatic assessment. As obtaining data for one-year prior to implementation of eVIN was challenging, therefore, six months period was chosen as the reference period for pre-eVIN phase. The pre-eVIN reference period was of six months for all CCPs, however it varied for different states and districts due to different timeframe of eVIN rollout. The specific duration of pre-eVIN phase are as mentioned: most of the CCPs in a district were covered either in between the period of April 2015 to September 2015 (13 districts), April 2016 to September 2016 (12 districts), October 2015-March 2016 (11 districts) and October 2011- March 2012 (1 district). The post eVIN reference period was from October 2017 to March 2018 for the assessment. Minimum number of CCPs required for the study was calculated to be 502 considering 43% of PHCs reported instances of stock-out, 10% non-response rate and 1.2 design effect. It was further increased to 617 CCPs in order to draw valid conclusions at the state levels. Selection of CCPs in the eVIN states were done using two-stage sampling design. In the first stage, districts were selected followed by selection of CCPs in the second stage. In each eVIN state, number of sampled districts was decided based on Probability Proportion to Size of CCPs. In total 37 districts were selected using systematic random sampling technique after arranging the districts in ascending order based on the proportionate share of cold chain point in the total cold chain point in state. Further, CCPs were randomly selected in each of the selected district. A detailed methodology is available in the larger study document. Quantitative data was obtained using structured questionnaire from CCPs pertaining to stock management, temperature monitoring, cold chain equipment, and documentation aspects of vaccine supply chain. The primary data for pre-eVIN phase was done from stock registers, vaccine distribution registers, temperature log books and other important registers. Completeness and accuracy were analyzed in the assessment. Completeness was seen of Indent form, vaccine stock register, and temperature log book. Accuracy was assessed through stock register and eVIN record, eVIN record and physical count. Computer Assisted Personal Interviewing (CAPI) technique was employed using tablets/mobiles for real-time data collection and data entry