1.1. Need of the Program
As per the world health organization (WHO), Health Information System (HIS) is one of the six building blocks of the health system. Nations establish their HIS as per their context. Generally HIS regarding data management (the ability to collect, store, analyze and distribute data) is limited in Sub Saharan African countries (1).However, literatures found were not able to show the magnitude of the problems of the program implementation status.
As the result of the announcement of WHO “health for all”, global health initiatives started to improve community health aligned with millennium development goals which emphasized the need to strengthen the primary health care to decrease child mortality, improve maternal health, and combat HIV/AIDS, malaria, and other communicable and non-communicable diseases. So community health information System became public health issue in Ethiopia (2).
Cognizant of the importance of health information Federal Ministry of Health (FMOH) started reform of health information system and monitoring and evaluation (M&E) components to solve the data collection, reporting gaps and to strengthen the information Utilization (2).
As the result of the above scenario, FMOH started to strengthen the HMIS and its principles standardization, specification, integration so as to improve the data collection, summation, analysis and dissemination for decision and action. Here Community Health Information System was scaled-up along with HMIS (2).
Community Health Information System (CHIS) was designed to standardize data collection and integrate data systems to provide relevant information for decision-making at the health posts and to feed the HMIS on a regular basis. Family folder is a pouch, which is the main part of CHIS, is a data collection tool designed by the FMoH for Health Extension Workers (HEWs) to document both individual and household level data to be utilized as a source of information at the grass root level(3)
Unlike the health centers` and hospitals` in health post there were different types of unorganized registers which were used to collect information on services provided within a single health domain, sometimes requiring a large group of registers to cover all health domains related to population. In addition, there was no any mechanism to identify which group of people needs, which type of health care services .But family folder informs patient care through the data contained in individual and family records, identifies patients in need of care through a set of tickler files, and enables reporting through supplementary tally sheets and family folder cards. The overall design of the FF innovation was to simplify the workflow of the community health worker and focus health care delivery at the community level (4).
1.2. Statement of the Problem
Federal ministry of health took the lead in giving a due attention on implementation of CHIS and it also engaged various partners at country level; mainly John Snow, Tulane University, Italian Cooperation and World Health Organization (WHO) - in supporting the scale-up of HMIS in the regions (5).According to the health sector monitoring and evaluation strategic plan (Health Sector Transformation Plan) 2016-2020 (6), there were identified challenges of the CHIS implementation: Though Integrated child case management (ICCM) register is the only register permitted at health post level, some health posts use other registers like outpatient department (OPD), Expanded Program on Immunization (EPI), etc, incomplete and inappropriate recording and lack of updating FF data at health post. There was also inconsistent use of FF cards during service provision at health post and lack of FF tools revision to capture data of newly implemented services including EPI, nutrition. In addition, there was also shortage of pre-requisites required for CHIS implementation including cards, pouch, shelf and tickler file box, due to lack of knowledge and skill. Most health posts were not performing Lot Quality Assurance Sampling (LQAS) as per the standard; poor utilization of tickler file system for client monitoring (6).
Accordingly assumptions have been focused on how well the CHIS is Implemented. However, there are no scientific evaluations which can quantify the magnitude of the gaps of the system listed above. Moreover, there is limited information on the dimensions of the evaluation of CHIS (Completeness, Consistency, compliance and availability) in the study area. Therefore this study was conducted to fill the gaps by exploring the magnitude of the problem and status of the system regarding evaluation dimensions in the study area.
1.3. Rationale for evaluation
At the time of the evaluability assessment in Enderta woreda, the stake holders identified problems such as parallel reports & multiple reporting formats (not related to CHIS) that gives a burden to the HEWs and leads to ineffective implementation of CHIS.HMIS/CHIS. The stakeholders include: experts, planning process owner in Tigray regional health bureau, woreda health office heads, HMIS focal persons and HEWs. They discussed and accepted the evaluability assessment and on how they would use the findings and results of this study. So during the assessment there were shortage of CHIS tools and in appropriate reporting and recording procedures that were also identified during integrated supportive supervision in the Tigray rural health posts. In the region about 98% of rural health posts have implemented the community health information system starting from December 2013 (5). Hence, it was very important to make a process evaluation on it.
This study described the scale-up (implementation) status of CHIS in four districts and clearly indicated the achievements, challenges, and experiences which were captured from the documents during the assessments. The assessment was considered as helpful to implement CHIS in the other zones. Thus, it would help decision makers at different level to minimize the problems, to improve the status of implementation of CHIS (program improvement) and ultimately to improve service delivery. In addition it would also be important as an input to expand the lessons learned in to the urban CHIS. Generally the rationale of this evaluation has an implication in improving the data collection & information use at grass root level. Moreover, it would be used as an input for other evaluators/researchers and for vital event registration especially for births and deaths.
1.4. Description of the Program under the Evaluation
Globally, Health information systems serve multiple users and a wide array of purposes that can be summarized as the generation of information to enable decision-makers at all levels of the health system to identify problems and needs, make evidence-based decisions on health policy and allocate scarce resources optimally. Data from different sources are used for multiple purposes at different levels of the health care system (7).
The countries in the developing world face a wide variety of health-related challenges, and the health systems that address those challenges are struggling with limited resources and capability. Health leaders must therefore focus on maximizing the value of scarce resources and finding ways to make health systems operate as efficiently as possible. Having reliable data on the performance of different parts of the health system is the only way to devise, execute, and measure health interventions. Successful strengthening of health systems will require relevant, timely, and accurate information on the performance of the health system itself. The goal of a health information system (HIS) is to provide that information (8).
Ethiopia has established to have a nationally standardized comprehensive health management information system (HMIS) which is one of the cross cutting attributes in the health systems strengthening framework. HMIS is a broad system for collection, compilation, analysis and utilization of routine health service data at all level. Similarly CHIS is a system for collection, compilation, analysis and utilization of routine health service data at community (grass root) level. In the perspective of this setting, the government committed to promote a household centered health care through the community based health extension program (HEP). As part of strengthening the community health information system, the Federal Ministry of Health used the family folder (FF) as a tool of data collection and for grasping essential information at the family level. This collected information is used for decision making in terms of health promotion and disease prevention at the grass root level (9).
CHIS has different components. These are family folder pouch, Cards (Health and Integrated), Tally Sheets, Reporting Formats, MFI, Field Book, Tickler file and Shelves. The family folder pouch is a collection of individual records at the family level that encompasses the primary health domain. It has two pages (Front and Back) with five basic parts:
(1) Identification, (Region, woreda, kebele, Kushet, name of head of the family, household number)
(2) Household description, (list of the names of each individual member of the household/family)
(3) Household characteristics, (latrine, Hand washing facility, waste disposal system, drinking water source and LLITN issued)
(4) HEP training status, (training status based on the model household training schedule, training start & completion dates.)
(5) Household implementation status (the HEP Package registration, training, graduation and advance training dates.) (10).
Health cards are usually used when a client is sick and came to health post seeking medical service and be kept inside the family pouch. In addition we can record information regarding family planning services. It can be divided in to two types called Male Card which is colored by blue and Female Card which is colored by Yellow. Every member of the family who is ≥5 years of age is issued a health card; for those <5 years, their records are kept in their mother’s Health Card till they reach the age of 5 years. Integrated Card is used to record services such as ANC, Delivery, PNC, New Born Care, and Immunization and so on. And it is issued to a mother who is pregnant, laboring or lactating mother and her new born (11).
A tickler file is one component of the FF shelf which is essential for CHIS implementation. It is used for tracing the defaulters from the appointment. Family folder shelf used to contain the family folder pouches and segregated into different kushets and house numbers. It holds also tickler file.
Tally sheets used for tallying the diseases and service delivered. There are four types of tally sheets service, disease, family planning dispensed count and tracer drug tally sheets.
Reporting formats used to collect the monthly and quarterly data are out patient (OPD) and Service delivery reporting formats.
Master family index is also one component of CHIS which is important for recording the house hold heads alphabetically and use to retrieve the family folder from the shelf.
Field book used to record the identification details and service data of clients receiving service at household or outreach and for whom the HEW did not carry the Family Folder.
Completing all components of the CHIS is a simple HMIS recordkeeping and reporting procedure that feeds community level health information (11).
1.4.1. Goal of Community Health Information system
The goal of the program is improving availability, quality and utilization of information so as to ensure quality of service delivery at community level.
1.4.2. Program Specific Objective
The specific objectives of CHIS are:-
- Promoting a family-centered health care at community level through an innovative community health services extension program (HEP)
- Ensuring standardized recording & reporting tools at health post level and produce quality information.
- Strengthen information use at grass root level
- Minimize duplicate & parallel report
1.4.3. Expected effect of CHIS
The expected effect of the CHIS is to register or enumerate all households in the Tabia throughout the region in family folder in order to minimize parallel recording and reporting formats. And the health extension workers also use all the CHIS tools in recording and reporting activities. It also helps to have improved family centered health service. In addition, information use at grass root level will be maintained. Besides, CHIS would support the vital event registration by providing information about births and deaths.
1.4.4. Program Resources and Activities of Community health information System
1.4.4.1.The resources needed to implement and run community health information system
Resources are very crucial to implement and run any program, so the resources needed for implementation and run community health information system include: family folder/pouch cards (male, female and integrated cards), master family index, guidelines, and field books. On top of that standardized shelves with tickler files, inks& brushes for coding house number, four types of tally sheets(service delivery tally sheet, disease tally sheet, tracer drug tally sheet and family planning tally sheet) and reporting formats are also required as part of resources. Skilled information experts, HEWs and supervisors including the capacity building are also vital components of the human resources. As part of the infrastructure and furniture, buildings (health posts), chairs and tables, bags are other important resources.
1.4.2.1.Major activities of Community health information System
To overcome the goals and objectives of a program, certain activities should be performed according to its guidelines and principles. The major activities of CHIS are registering or recording of households, coding the household number in FF and in houses, and preparing MFI for all HHs & all kushets in the Tabia. The CHIS is also designed for organizing the family folder according to their house numbers and kushets, use the family folder and its cards (Male, Female and Integrated cards), tally sheets in their daily activities. In addition it is also used for reporting to next level and using the family folder information at grass root level for different purposes. For example, preparing Tabia profile, use tickler files for appointment and tracing defaulters, use field books during their outreach and updating the FF (new births, new deaths and for new household).
1.4.5. Stage of Community Health Information System
CHIS has been implemented in Tigray region starting from May 2013 in 712 health posts found in 34 rural woredas of Tigray. More than 770,000 rural households were registered and have issued a family folder. House numbering and registration was carried out mainly by the health extension workers. In Tigray recording and reporting of data through cards was introduced in the beginning of the fiscal year 2013/14. Full implementation of CHIS was started after preparing Tabia profile; Master Family Index and Tickler file.
Currently 2016, Data recording and reporting using CHIS tools (full implementation) were completed and scaled up in to 646 (98%) health posts. More than 831,141 rural Households were registered and have issued a family folder (5). CHIS implementation in south east zone Tigray is 99.0% more than 112747 households were registered in family folder in 87 health posts.
1.4.6. Program Logic Model of Community Health Information System
The graphical representation and linkage between/ among the components of the CHIS/Family folder program Input , Activities /Process , output , outcome and impact of the program to depict the monitoring and evaluation activities clearly. (See Figure 1)