PROJECT EVALUATION REPORT OF O.D.I.S.A. 2022.

A Program implemented by ODISA in 40 villages of Kothagarh & Daringabadi Block in Kandhamal District of Odisha.

Supported by:

Prepared By

Sudhir Kumar Nayak.

Ambapua Main Road, Near New DePaul School, Berhampur- 760011. Dist. Ganjam, Odisha. Email: [email protected]

Mobile no: +91 9438039026

1

TABLE OF CONTENTS:

SL. NO.

CONTENTS

PAGES

1

Acknowledgement

3

2

Abbreviations

4

3

Summary

5-6

➢ Vision ➢ mission 4

Overview of the project: ➢ ➢ ➢ ➢

7-9

Project goal Project objectives Key activities of the project Key achievements of the project

5

Objectives of the evaluation

9-10

6

Methodology

10-11

7

Relevance of the project

11-12

8

Objectively key findings

12-19

9

Overall major recommendations

20

10

Overview of the evaluation

21-22

11

Key respondents

22

12

Conclusions, lessons and recommendations to 22-24 ODISA

2

ACKNOWLEDGEMENT

I am thankful to Organisation for Development Integration and Social Action (ODISA) for giving the opportunity to conduct the Evaluation of the “Tribal and Dalit Women and small farmer’s Skill Development and Livelihood Program in 40 Villages of Kotagarh & Daringabadi Block. “in Kandhamal District of Odisha” supported by Manos Unidas, Spain, that is being implemented in the Kandhama district of Odisha.

My special thanks to Fr.Patras Lakra ,The Director of Organisation for Development Integration and Social Action (ODISA) for his whole hearted support during the entire evaluation process. I also take this opportunity to thank the project team members for their support and cooperation during the evaluation which made the entire process an enriching one. I am thankful to all the Animators of the 40 villages that we visited during the evaluation. SHG women, Farmer’s club members, Community members, PRI members all participated in the evaluation and helped me to understand the implementation of the project in the area. They too shared their experiences of working in the field, the challenges they face and the assistance they received throughout this project implementation. The discussions with all these stakeholders have helped us analyse the situation and the project outcomes, thereby enabling us to provide relevant feedback on the same. I again thank the project staff for providing us with an opportunity to understand and evaluate the interventions in a participatory and holistic manner. We hope that this evaluation will help Manos Unidas and ODISA, based in Odisha to understand the overall strengths and concerns of the program and help pave the way for future interventions.

Thanking you, Sudhir Kumar Nayak, Consultant.

3

ABBREVIATIONS

ODISA SHG

Organisation for Development Integration and Social Action Self Help Group

FC

Farmers Club

PRI

Panchayat Raj Institution

CBO

Community Based Organisations

IGP

Income Generation Program

IGA

Income Generation Activities

OLM

Odisha Livelihood Mission

MIS

Management Information System

SMART

Specific, Measurable, Achievable, Realistic, Timely.

4

SUMMARY India is a welfare state and there are number of policy and legal obligations under the constitutional framework including govt. schemes to protect the rights of the women and farmers. Out of the total rural poor families in Odisha, 87.36% families are agricultural labour, marginal and small farmers. Odisha is one of the Poorest states in India, Odisha occupies 4.75 percent of India’s landmass and accounts for 3.74 percent of the country’s population. The state comprises 30 districts, 58 subdivisions, 314 blocks and 51,048 administrative villages. Total population of Orissa as per 2011 census is 41,974,218 of which male and female are 21,212,136 and 20,762,082 respectively. The overall literacy rate is 72.87 percent and the female literacy rate is 50.97 percent, which is below the national averages of 65.38 percent and 54.16 percent, respectively. The project is being implemented in the Kandhamal district of Odisha, which is one of the most backward districts in the state of Odisha. The 40 villages of Kothogarh & Daringabadi Blocks are mostly populated with tribal and dalit people. The indigenous people are backward not only in economic aspects but also in education and access to development opportunities. This including their attitude of being happy with the little what they have had excluded them from the mainstream of development. Though farming was their main source of livelihood yet except a few most of them were following the traditional way of cultivation. Similarly, due to illiteracy and ignorance, most of them were also not well aware of the availability of different departmental schemes related to livelihood and economic development except the social security or safety net schemes. Against such background ODISA with the support of Manos Unidas, Spain, had started a life-transforming program known as “Tribal & Dalit Women and small farmers’ skill development and livelihood program”. The program continued for 3 years and has been able to bring change in the areas of women empowerment, economic reform and organizing people into the institutions like Farmers Clubs, Self Help Groups and SHGs Federation. These, institutions have realized their roles and responsibilities in shaping their present and future but are lacking appropriate leadership and managerial skills that could organize them constructively for the greater interest of the target people. All the 104 SHGs who were with the fund but without its utility during the intervention, now are 5

financially improving by adopting different economic ventures of their choice and capacity. But still, they are facing problems in marketing their products to get a better price, due to lack of marketing viability the people scared to yield more produces and due to inadequate knowledge and information among women they still depend on male members & due to lack of opportunities the women unable to participate equally in different decision making process.

The current project has been completed in December 2021 to know the progress of the project, ODISA decided to conduct project evaluation of the above-said project (period: 2019-2021) and requested an external consultant (Evaluator)to conduct the evaluation. The consultant conducted the evaluation of the above said project to assess the importance, success, productivity, area of improvement & its sustainability. The evaluator met a wide range of respondents / stakeholders including the community members, male and female members of various CBOs, SHGs members, Farmer’s club members. The Evaluation was conducted in the month of December, 2022 and the field visit was conducted in Kandhamal district.

Vision: To build a just, self-reliant, healthy and happy society based on human values of love justice, peace, freedom, equality, brotherhood and respect for life, culture, history and nature at level of existence, so that KINGDOM OF GOD is established.

Mission: The mission of ODISA is working for the most neglected classes of Orissa such as: Dalits, Tribal, Oppressed, Women, Children, Backward and Sick people to promote Human Values & Human Rights. The development of the people in the process of integrated development programme for self-dignity, self-reliant and empowerment through Education, Health, Agriculture& Economic development. This leads to moral technical knowledge & self-confidence of people to manage the resources for their livelihood.

6

OVERVIEW OF THE PROJECT: With the support Manos Unidas, Spain, ODISA implemented a project named as “Tribal and Dalit Women and small farmer’s Skill Development and Livelihood Program in 40 Villages of Kotagarh & Daringabadi Block. “in Kandhamal District of Odisha” in the district of Kandhamal, Odisha. With regards to its geographical coverage, it is implemented in 2 blocks, 4 Gram Panchayats, 40 villages, covering 2800 direct beneficiaries. The project had the following Goal, Objectives/ Outcomes, and key activities: Goal of Project: Tribal and Dalit Women and small farmer’s Skill Development and Livelihood Program in 40 Villages of Kotagarh & Daringabadi Block. “in Kandhamal District of Odisha” Objective 1: 1200 Dalit & Tribal families and small and marginal farmers have access to cultivable land, increased income and nutritional intake by increasing their crop yields & eco-friendly improved technology and sustainable livelihood. Objective 2: 1200 nos. of disadvantaged tribal & dalit women, have improved access to govt. welfare schemes and financial services as well as alternative livelihood options through skill and cooperative/federation development, market linkages and technical guidance. Objective 3: 300 nos. of women CBO leaders enhanced their leadership ability through organized SHGs. Objective 4: The project staffs are well aware of conceptual clarity on proposed project, capacitated on management, implementation, planning & documentation of the project to achieve its goal & objectives. Key activities of the project: •

Conducted base line of new project villages of land and landless families.

•

Training on Lobby & advocacy with 5th line department to leaders.

•

Exposure visit of farmers

7

•

Training on various information & knowledge transformation on government programes and promoting mixed crops to improve agriculture products.

•

Demonstration plots are promoted for imparting improved agricultural practices.

•

Providing plants to families to develop horticulture products and eco-friendly orchard for environmental protection.

•

Training to SHG members on linkages with different business people for marketability of IGP products.

•

Training to women leaders on cooperative/federation management and record maintenance.

•

Start-up

support

for

income

generation

activities(IGA)

for

sustainable

development. •

Support of vegetable seeds to women SHGs for the development of kitchen garden.

•

Training on alternative livelihood to teach SHG representatives to train other members of the SHGs.

•

Training to women on cooperative management, small scale entrepreneurship and market linkage.

•

Capacity building on agriculture, livelihood & new technologies to farmers.

•

Interface meeting with the office in-charge of line departments and nodal officers at Block level.

•

Lobby & advocacy training to tribal women leaders on proper implementation of government programme and schemes for the proper transparency and accountability.

•

Observation of international women’s day.

•

Training on lobby & advocacy and different govt. schemes & programmes.

•

Capacity building training to CBO leaders on leadership development, monitoring skill, various government resources.

•

Training to women leaders & PRI members on PRI & self-governance.

•

Workshop on women rights & opportunities, domestic violence, legal aid & women atrocities to women leaders.

•

Interface meeting with line departments at block level about schemes of Odisha livelihood Mission (OLM).

8

•

Capacity building training to staff on conceptual clarity, project cycle management, MIS and their roles and responsibilities.

•

Training on monitoring, reporting, documentation, communication and liaison with government & non-government institution.

•

Annual review & planning workshop.

•

Staff monthly review & planning meeting.

Key achievements of the project: (Sources: Annual and half yearly report received) •

200 households have access to cultivable land.

•

400 Households earns at least Rs.20000/- to Rs. 25000/- per year

•

450 farmers households have adopted multi crops specially paddy, pulses, ragi, vegetables and turmeric. Now about 600 households have 3 full meals. 400 farmers households have increased their harvest by 40%

•

350 women have regular income through different income generation activities in group (kitchen garden, bricks making,, backyard poultry, seasonal business goat & sheep rearing, ) etc

•

200 women from SHGs earn at least Rs. 10000/- to Rs. 15000/- per 12 months.

•

750 families have accessed government schemes.

•

400 women are sensitized on Management & functioning of cooperative society and undertake different entrepreneurship activities

•

1050 families have availed government resources like MGNREGA, NRHM, DPEP etc.

•

300 tribal and Dalit women increased their leadership quality & participated equally & actively in community, GP & Block level decision making process.

•

350 women Increased knowledge & information on Law & policies meant for the women & do lobby & Advocacy to access equal rights & opportunities.

OBJECTIVES OF THE EVALUATION The broad & overall objectives of the proposed “Evaluation” were: •

To assess whether the set objectives of the project have been accomplished

9

•

To assess the level of autonomy (social and economic) aimed at and achieved by the SHGs (leaders emerging from the SHGs, their future role and commitment, savings, internal loans, linkage with financial institutions and the effect and impact of the income generating programmes (IGP).

•

To assess the quantitative and qualitative outcomes using the proposed indicators given in the log frame work of the project.

•

To assess the role of the staff- project leaders, professional staff and animators.

•

To assess the level of sustainability attained by the project.

•

To suggest strategic recommendations for the continuation of the programme.

METHODOLOGY Samples were selected and tools designed for the data collection during the field visits in the project area. a. Sampling: A random sampling method was applied for selection of the sample villages from the target area of 40 villages. This was further finalised after discussion with ODISA staff depending on feasibility of the location and its accessibility, given the time constraint. Finally, the 6 nos. of villages of 2 Block are selected for the study.

The following villages were covered in the evaluation: Sl.no

Villages

Panchayat

Block

District

1

Sarliguda

Judabali

Kottagada

Kandhamal

2

Kalisiguda

Dharakut

Kottagada

Kandhamal

3

Kanaguda

Dharakut

Kottagada

Kandhamal

4

Marlanga

Marlanga

Kottagada

Kandhamal

5

Manengajodi

Sirkabarga

Daringabadi

Kandhamal

6

Atinbadi

Sirkabarga

Daringabadi

Kandhamal

10

b. Tools used: The evaluation was conducted using qualitative tools suited to the stakeholders that were being met with. The tools were designed keeping in mind the stakeholder that it was being administered upon, and also in line with the scope mentioned above. The following tools were used: 1. Focus group discussions 2. Semi-structured Interviews 3. Review of records and documents 4. On site Observations c. Data sources for the Evaluation Process: The evaluation was largely based on primary information based on the above-mentioned tools, along with the use of secondary data as and where required for the validation and triangulation or understanding the external environment in which the project operates. The following project records and documents were reviewed for this purpose: 1. Project Proposal of ODISA 2. Annual Report 3. Case studies 4. Other relevant documents of project activities shared by the organization.

RELEVANCE OF THE PROJECT: The livelihoods of the targeted households are not secured, they are highly dependent on agriculture, but it was seen that most of the households are able to do one time cultivation due to irrigation problem in most of the villages. Due to this reason people face heavy loss on agriculture, it meets the food requirement and contribute little bit in the income generation, so migration to other states is existing in every village. The areas in which the project has been implemented are located in remote areas, with poor connectivity and poor social infrastructure. The villages are in isolation and have low levels of literacy. The people are not so empowered to demand their rights and avail government welfare schemes. 11

Therefore, the project and its objectives held relevance in the given area.

OBJECTIVELY KEY FINDINGS: The key findings of the evaluation are as follow: The key findings of the evaluation are divided into three parts; Observation, area of concerns & recommendations and the overall recommendation of the evaluation are mentioned below: OBJECTIVE-1. Dalit & Tribal families and small and marginal farmers have access to cultivable land, increased income and nutritional intake by increasing their crop yields & eco-friendly improved technology and sustainable livelihood. Observation: The areas in which the project is carried out are remote villages with poor connectivity and poor social infrastructure. The villages are characterized by geographical isolation and low levels of literacy. The people are not empowered to assert their rights and avail government welfare schemes. Their livelihoods too are unsecured with high dependence on the land. Most of the households are highly dependent on agriculture, but it was seen that every year at least once or twice the natural calamities take place in this area. Due to this reason people face heavy loss on agriculture, which affects their food availability, hardly agriculture contribute in the income generation of the family. Migration to other states is existing in every village. Anyhow people have to go for alternative livelihood to meet the basic requirements of their family. However, there are different government schemes and facilities available for the farmers but due to lack of knowledge, information and motivation of the people they are not implemented adequately. Areas of Concern: While the project sincerely worked on mobilizing, organizing and sensitizing the rural communities on the importance and need for different types of livelihood options, but still people face difficulties in sustaining their livelihoods. No doubt, the Farmer’s club have initiated some agriculture activities for livelihood but its sustainability phase is yet to come. People have food security but food sovereignty and sustainability in their livelihood is yet to come, which is not possible within these 2 years of the project period, 12

looking into the context of the area in view. Since the intervention area is inaccessible to different programs and people are highly dependent on agriculture, livelihood of the people is a big concern as shared by the people. Though ODISA has worked hard on resilient practices, which can be sustained in disaster prone areas, but still it’s lacking in the visited villages. Water problem is a concern in many villages, during the discussion it was found that, people are facing difficulties for drinking water as well as for irrigation purpose. Due to this reason, farmers are able to do one-time crops only, mostly paddy and turmeric, which is used to meet the food requirements of the family. No doubts few families also shared that, they sell paddy & turmeric and generate some income for the family as well, but this kind of example is very few in the villages, which were visited. The marketing of the products also is a big concern of the people, which was found in most of the places. The farmers also do not get reasonable price of their products due to viable marketing facility. Recommendation: Thus, the future interventions of need to focus on addressing the following prevailing gaps: Lack of complete knowledge on Government schemes and financial institutions by the farmers club, which needs to be strengthened further, so that all the farmers group will be able to access the livelihood benefits of the Government through different schemes. There is lack of focused strategy towards marketing of the products of the Farmer’s club(FC). It was observed in most of the villages that SHGs have the capacity to produce more vegetable, but due to marketing issue, they do not produce in huge quantity. ODISA needs to focus more on the marketing of the products. Along with this, the farmers should also be linked with somewhere, so that they have their own place to keep the products available there. It can be construction on new set up or setting up a outlet in the market place or using Panchayat or community hall for that purpose. There is lack of concrete initiatives towards resilient agriculture practice which can help in sustaining the crops for a longer period, which is the main source of livelihood in the intervention area. People are using in some places but not widely used. Modern 13

agriculture method to be introduced which can be practiced following organic way of cultivation, here the primary focus should be sustaining crops little longer during natural calamities like flood and cyclone time. The farmers club members are to be registered under farmers producer company act. to control the market and access reasonable price of the products. Agriculture is the main source of income of the people, on which the organization can take some concrete steps towards sustainable agriculture development of the farmers. In many villages people aware of the importance of organic farming, but the practice is very less. Only in few villages, vegetable growing is done organically but many people are behinds chemical fertilizer for more production and profit. So ODISA should focus on organic farming in the target area. There are some need based trainings, exposure visit program are provided to the farmers and also supported horticulture plants, agriculture implements etc. but they are not sufficient for sustainable agriculture development. So, more need-based trainings and supports are required as shared by the farmers. After the training also it’s followed up and linkages with different institutions to be thought off to ensure that they properly utilize the knowledge of the trainings provided. OBJECTIVE-2. Disadvantaged tribal and dalit women, have improved access to govt. welfare schemes and financial services as well as alternative livelihood options through skill and cooperative/federation development, market linkages and technical guidance: Observation: The project has been effective in building awareness on the core issues addressed by the project. Mobilization of the poor and needy women has led to positive outcomes i.e., heightened understanding on different government schemes and livelihood options. Awareness and women sensitization on important schemes has been carried out very effectively. Other than, money deposing and providing loans, women have initiated many alternative livelihoods and linkages with government officials, which has contributed some income to their family and has strengthen the women. Community mobilization on the project issues has been valuable. Reaching to the existing committees and groups like women Self Help Groups (SHGs), Farmer’s club has led to 14

increased involvement of these groups on matters of livelihood and building network with different government financial institutions. In few villages it was realized that, as compared to men, women are active on addressing the issues of the community. The project has been able to provide different trainings on alternative livelihood to every SHGs, which were interacted in the field. Every SHGs, which we met have received some kind of IGP support and some trainings on organic and improved agriculture practices. People are utilizing the knowledge on different livelihood work, which they received from different trainings. In few villages SHGs have received financial support from the Government through different schemes /programmes like OLM, Mission Shakti and other welfare agencies. It has been a big support to them to initiate some alternative livelihoods. Capacity building of the SHG women through project staff and facilitating for networking helped a lot here. Which shows the networking and linkages of SHG women with the Government department. Financial improvement has come to certain extent in the family of SHG members, as shared during the Focused group discussion with them. Women are able to contribute something in different expenditure of their families, for which they feel good for that. It has increased their self -esteem also to do more. It was found during field visit that, SHG women after getting different trainings from ODISA, they have worked on preparing many things like leaf plat making, bricks making, vegetable cultivation, turmeric, poultry farming, goat rearing and some other things and also have received financial support from different government welfare departments by some SHGs and individuals, but those products were lying with them for not being able to sell. Areas of Concerns: Baseline data is available, but it could have been collected more systematically against every outcome and output indicators, so that comparison would have been done easily to come to a conclusion. No doubt the project has produced good results in the field but comparison against every indicator is not so clear. it is suggested to have clear indicator against all results and data should be available for that. 15

For objective level results, clear outputs have not been developed, the result statement could have been SMART process, so as to easily measure. It is suggested to have SMART outcomes, outputs in the next phase which is logically being framed and put in the logical framework matrix. Trainings have been given to the SHGs on different capacity building, but the follow up action has not been properly done, which was a concern for many SHG members. Due to lack of proper monitoring and follow up of the activities the improvement among the women is not been seen as per the expectation. SHGs Federation is formed to strengthen the SHGs and do the lobby and advocacy on women rights and dignity at different level but the federation is not yet actively functioning. Few SHG members are not aware of the aim and objectives of the SHGs Federation. The SHGs are mainly focusing on economic development. Recommendation: The women SHGs are formed and linked with different government financial institutions, but due to lack of adequate knowledge and information on different government schemes and entitlements the women unable to tap the resources for development. Therefore, the SHGs members are required more capacity building on it. The leadership quality of the women has to be developed more to work independently and address their issues in different level. The women SHGs Federation has been formed but due to insufficient inputs provided to the women leaders, the Federation is not functioning actively. So, it requires more need-based capacity building trainings for the women leaders to strengthen and manage the Federation systematically and that will develop a good network among different stakeholders to address women rights and entitlements. The women have more scopes and ability to do productive work and need to develop marketing viability. OBJECTIVE-3. 300 nos. of women CBO leaders enhanced their leadership ability through organized SHGs:

16

Observation: The project has been planned effective in building capacity of women through SHGs and creating leadership to build network with different government and non-government institutions and address women issues at different level. Women SHGs Federation has led to positive outcomes i.e., heightened understanding on different government policies, women rights and opportunities. Awareness and women sensitization on important schemes has been carried out very effectively. It is observed that the project staff give more attention on economic empowerment of the women but also should give more attention on political, social empowerment. The participation of women in decision making, planning, monitoring and implementing process requires more work. However, the women are elected in local self-governance unit (PRI) which is also a great achievement of the project, but the role dalit and tribal women play is consistently subordinated to their male counterparts. It was realized in the focus discussion that the women are not allowed to sit in the meetings and share their views. All decisions are being taken by the male members and imposed to the women. But after ODISA’s intervention few women are attending meetings in the community and panchayat level. In the majority of instances, the marginalized women have no ability to exercise their voices in the Panchayat because their husbands represent them and make the decisions while the women are forced to stay at home until the husbands can take over the Panchayat seat for themselves. Areas of Concerns: The project has been able to provide different trainings for women like; lobby & advocacy, leadership development, PRI and self-governance, women rights & opportunities, domestic violence, legal aids & women atrocities and conducted interface meetings with line departments to every SHGs, which were interacted in the field. However, the different trainings have been provided to women leaders but the lack of follow up action has not been taken. As a result of which the women leadership quality and women participation in decision making, planning process is found very low. It was found that SHG documents and other registers are maintained by the project staff in many cases, SHG women to be capacitated to do the documentation work by themselves, since the project focus on the empowerment of the women also. 17

However, the women are elected as people’s representatives in the self-governance unit, but due to lack of knowledge, leadership skill and due to the intervention of their male counterpart, they become nominal head Recommendation: The organisation ODISA should give more focus on women leadership development and capacity building of the CBOs. The Systematic plan to be done for proper networking and linkages with the Government departments, which will help for need based advocacy. Need based networking and linkages of the SHGs with different programmes of the Government, also strengthening their capacity towards independency along with some input support wherever required. Their capacity to be enhanced with motivation and encouragement build the capacity of lead women, who will pro-actively act as resource person for their own community. Women participation in planning, monitoring and decision making process has to be given more priority in the next plan. Some women have good leadership quality and well motivated and they need to be given proper motivation and guidance. Thus, they will be the example for other women. The organisation should develop capacity of the women on group record maintenance. Though the maximum women are illiterate and few are literate but they should be aware of documentation process and its importance. ODISA has to work more intensively on women rights and entitlements, electoral process, role and responsibilities of an elected members etc. OBJECTIVE-4. The project staffs are well aware of conceptual clarity on proposed project, capacitated on management, implementation, planning & documentation of the project to achieve its goal & objectives: Observation: Overall, the Director and Project Coordinator of the project are quite capable to handle the project in terms of monitoring, capacity building of staff and achievement of results. The Project Coordinator has better understanding about the project, he has also established good rapport in the field.

18

From the review of the Financial Statements provided by the partner organizations shows that the resources were utilized well. Looking at the budget, it was felt that salary of the project coordinator has to be increased, and little more capable person who is good in technical and professional part can be engaged in the project. Thematic understanding on the project staff is ok, but technical understanding of the project with regards to results, indicators, strategy, logical thinking while implementing the activities has to be developed amongst the staff. With regards to the execution of the activities in the field has been done well and it has brought visibility also. Community feels the presence of ODISA and the changes brought due to their efficient intervention. The same was acknowledged by the community to a greater extent. Area of Concerns: And finally, to increase the effectiveness of the project, it will be extremely important to build the capacity of the project staff on areas like advocacy and lobbying, working with the government (at block, district and state level), and technical issues on marketing strategy, modern method of cultivation, networking and linkages with different government agencies to tap the resources etc. The organization is good in terms of reaching to the unreached grassroots communities, and mobilizing the excluded communities and building awareness, and they have done it with all dedication and commitment during this project period. Focused capacity building of the team members also required on project management, reporting and documentation and other thematic areas as per the requirement of the project. Recommendation: Technical understanding of the staff with regards to indicators need to be improved, which is required for proper monitoring. Understanding needs to be improved of the staff on the objectives of the project and the target to be achieved, so that they do not confine to only activities. Field staff need to be little bit proactive in terms of their communication and action. Proper MIS system has to be developed in the office level.

19

OVERALL MAJOR RECOMMENDATIONS: 1. Strengthening of Farmers’ club and register under farmers’ producer company act. to control over the marketing system and access reasonable price through sustainable agriculture produces. 2. Strengthening of women SHGs Federation, which will play a vital role of the women to access equal rights and entitlements. The SHGs Federation needs to be linked with different stakeholders to address women issues. 3. Capacity building and strengthening of women leaders has to be developed so as to increase women participation in decision, planning, monitoring and implementing process. 4. Need based networking and linkages of the SHGs with different programmes of the Government, also strengthening their capacity towards independency along with some input support wherever required 5. Linkages of the Farmer’s Club with the Government welfare programmes, promotion lead farmers who can sustain the process of strengthening FC. 6. Need to develop and work on proper strategy both for SHGs and FC towards the market linkage of their products 7. Capacity Building of Federation leaders to ensure more pro-active engagement in the monitoring and management of the Federation. 8. Sensitizing the community towards more towards strengthening the traditional way of cultivation with improved methods and organic way of cultivation. 9. MIS system of the organisation has to be developed for systematic documentation and monitoring of the program. 10. The project needs to develop a pragmatic framework of ‘results’ and ‘targets. Targets should follow the SMART (Specific, Measurable, Achievable, Realistic and Timely) principles of result indicators. 11. Internal capacity building of project staff (in areas like monitoring system, resilient agriculture method, marketing strategy, advocacy and lobbying with PRI and upper-level government functionaries) has to be carried out intensively and at regular intervals throughout the project.

20

OVERVIEW OF THE EVALUATION The Organisation for Development Integration and Social Action (ODISA) decided to conduct an evaluation of the “Tribal and Dalit and small farmer’s skill development and livelihood program in 40 villages of Kotagarh & Daringabadi Block” in Kondhamal district of Odisha and engaged the consultant for the same. The Evaluator carried out the evaluation and the field visit to the target areas. Process adopted to conduct the evaluation: The evaluation process was conducted in a participatory manner with the involvement of all the key stakeholders in the following way: •

The scope, design and process of the evaluation was finalized in consultation with ODISA.

•

The evaluator studied all the relevant documents for the project, so as to have a clear understanding about the project and the focus areas of the project.

•

On the first day of the evaluation, the evaluator had a briefing meeting with the team members of ODISA, Berhampur, so as to understand the program and their perspectives on the background, context, achievements, non-achievements, unexpected results, learnings and challenges faced.

•

The schedule for visiting the project locations were identified and planned in agreement with ODISA team.

•

Interviews and discussions took place with the identified stakeholders, and data collected from them, in a participatory manner, providing full opportunity to all stakeholders to share their experiences, views & challenges.

•

Observations and findings were shared on an ongoing basis with the community and team members of ODISA, so as to identify the root causes for the gaps and areas for further engagement and intervention

•

The evaluation was concluded by holding a debriefing session. The team members of ODISA along with the Director were de-briefed on the findings of the evaluation, identification of the major learnings and the recommendations that could be implemented going ahead in the project.

21

•

Data collected from the field during the evaluation phase was compiled and analysed for bringing out relevant conclusions and recommendations

•

A draft evaluation report was developed based on findings and analysis

•

The draft evaluation report was shared with ODISA for review and feedback

•

Based on the feedback, the final report was prepared and submitted to ODISA

KEY RESPONDENTS It was very interested meeting with the following stakeholders at organisational level and community level to access information of the project. a. Organizational Level: -

Executive Director of ODISA

-

Project Coordinator

-

Animators

b. Community Level: - Community & CBO Members: Women SHG members -

Farmer’s Club members

-

Women SHGs Federation members

-

Lead Farmers

CONCLUSIONS, LESSONS AND RECOMMENDATIONS Conclusion: In the last 2 years ODISA has worked hard to gain the thrust of villagers and facilitate the formation of more than 104 SHGs to date. The feedback from the field has been very positive with reports that women and farmers are being empowered and gradually in combination with accessing existing government schemes are able to improve their livelihood status. This is very commendable given the remoteness and the level of skills and income poverty in these villages and the long heritage of exclusion and discrimination. ODISA scores highly on 3 out of 5 outcomes: Women have formed a federation and need to be strengthened and formalise the cooperative; Women leaders are capacitated to participate actively in local self-government and their presence will continue to strengthen with time; and the capacity of staff in PCM, cooperative management and advocacy with government officials has to be strengthened. On the 22

question of sustainable development, a lot of progress has been made to introduce environmentally friendly agriculture, to mitigate environmental damage and negative health impact. This in itself however will not deliver sustainable development. And finally, it will take a little longer for ODISA to develop its financial independence which needs linkages for the formalisation of the cooperative and the ability of SHGs to boost their IGA. But ODISA is well aware of this issue and is considering the matter seriously. There is ample evidence that women are being empowered and that the project in on course to become sustainable but more time is needed to capitalise on progress and lessons so far.

Lessons: ODISA has drown a number of lessons so far. The approach of going step by step allowing women time to make their own decision and move from being interested in forming a group to take on initiatives and make specific demands is a slow but necessary process. The participatory approach is the only way to gain women’s confidence and trust. If ODISA wants to ensure sustainability it needs to start engaging with men more actively so that they can also take responsibility in improving livelihoods. The success of the work so far is due to two elements: that ODISA accompanies the SHGs in their development and acts as a bridge between SHGs and other actors and ODISA has made great efforts in linking and involving the stakeholders, especially Block, District and State actors. ODISA operates in an integrated manner. Recommendation to ODISA: For the next phase ODISAs needs to spend time articulating its Theory of Change, clarify its expected impact and prioritise objectives and activities; ODISA needs to think more strategically about how to ensure sustainability: to continue strengthen SHG and farmers club self-reliance is important but ODISA also needs to act on structural constraints. The approach promoted by ODISA shows it is working but since ODISA has limited resources it cannot work beyond 4 GPs. There is an opportunity to 23

reflect and share the lessons learnt by ODISA with other stakeholders to attempt to spread the approach elsewhere. ODISA should consider developing an M&E system more focussed on learning than external accountability by choosing indicators more directly relevant to SHGs & FCs and by involving SHG and FC members in the data collection for the monitoring. This will bring a greater focus on reflection and learning. It is necessary to teach and encourage communities to reflect on their experience, draw lesson and apply the learnt processes in different contexts or fields (for example when the goat rearing failed what did women learn from the experience that they should not repeat in goat rearing or in another activity?) ODISA should consider documenting its experience and progress more regularly in order to build a port-folio of evidence. This will help in the reflecting process, but also in increasing ODISA’s profile and strengthen its case for fund raising. If there is a shortage of man power ODISA cold consider hosting a post graduate intern for a while to produce some case studies and base line data which would help in the monitoring.

24