Loading...

Teachers‘ ICT Skills for Pedagogical Integration in a Developing Country: Discripancy between Policy and Practice

©2013 Academic Paper 116 Pages

Summary

Developing countries try their best to articulate good policies but, many times such policies are not well implemented for various reasons.
This book presents a typical example of discrepancy between policy and policy implementation in East Africa’s third largest economy that is based on empirical evidence. Moreover, the book clearly highlights the intensions of the country’s policy on ICT in education, examines the attempts to implement the policy, and evaluates the impact of such an implementation.

Excerpt

Table Of Contents


Table of Contents

Acknowledgement

Acronyms

Chapter 1
Research Overview, the Problem and Research Methodology
1.0 Introduction
1.1 Background of the Study
1.2 Problem Statement
1.3 Research Questions
1.3.1 Main Question
1.3.2 Specific Questions
1.4 Justification
1.5 Scope of the Study
1.6 Purpose of the Study
1.7 Specific Objectives
1.8 Methodology
1.8.1 Study Area
1.8.2 Research Design
1.8.3 Research Validity and Reliability
1.8.4 Ethical Considerations
1.8.5 Data Analysis Techniques
1.9 Definition of Terms

Chapter 2
Review of Related Literature
2.0 Introduction
2.1 Initiatives for Equipping Teachers with ICT for Pedagogical Integration in Uganda
2.2 ICT Policy Debate in Teacher Education
2.3 Knowledge Needed by Teachers for Successful Integration of ICTs in Education
2.4 The Interplay between Politics, Policy and ICT Policy Implementation in Uganda

Chapter 3
The Policy for ICT in Education and the Education Sector Strategic Plan 2007-2015
3.0 Introduction
3.1 The Education Sector ICT policy
3.1.1 Background and context
3.1.2 Intentions and focus of the policy
3.1.3 Initiatives for Implementation of the Policy and their Effectiveness
3.1.4 So what is the Policy Direction?
3.2 The Education Sector Strategic Plan (ESSP) 2007 – 2015
3.3 Conclusion

Chapter 4
Presentation and Interpretation of Results from the Questionnaire survey
4.0 Introduction
4.1 Demographic Information
4.1.1 Distribution of Respondents by Gender and Level Taught
4.1.2 Distribution of Respondents by Year of Completion of Teacher Training Course
4.2 The Status of Teachers’ICT Knowledge and Skills
4.2.1 Have teachers had any ICT Training?
4.2.2 Which ICT knowledge and skills do teachers possess?
4.3 Training teachers in ICT: Initiative, Strategy and Practices
4.3.1 By whose initiative did teachers attain ICT training?
4.3.2 Strategies used in ICT Training for Teachers
4.3.3 Methods of Instruction used in ICT Training for Teachers
4.3.4 Relevancy of ICT Training Received to Curriculum and Instruction

Chapter 5
Discussion of results, Conclusions and Recommendations
5.1 Discussion of Results
5.1.1 Demographic Information
5.1.2 Results Regarding Status of ICT Training
5.1.3 Findings Regarding Initiative, Strategy and Practices
5.2 Conclusions
5.2.1 Conclusions Regarding Status of ICT Training of Teachers
5.2.2 Conclusions Regarding Teachers’ ICT Knowledge and Skills
5.2.3 Conclusions Regarding Initiative, Strategy and Practices
5. 3 Recommendations

6.0 Limitations of the Research

References

Appendices
Appendix A: Questionnaire to teachers.
Appendix B: Chi-square test for status of ICT training and level taught
Appendix C: Chi-square test for status of ICT training and gender
Appendix D: Chi-square test for status of ICT training and gender at different levels taught
Appendix E: Chi-square test for status of ICT training and year of completion
Appendix F: Targets and time Scales for implementing the ICT policy in Education
Appendix H: Map of Uganda showing the location of Jinja
Appendix I: List of Schools in Jinja Municipality

ABSTRACT

The promise of ICT in enhancing socio-economic development has been a major driver of initiatives that target its integration in the education systems of several countries. The Republic of Uganda has not been immune to this ICT syndrome. Uganda’s initiative to integrate ICT in mainstream education is guided by a policy that emphasizes equipping teachers with ICT skills as a cornerstone for implementing ICT in the country’s schools.

This book therefore reports on empirical findings on the strategies being used to equip Uganda’s teachers with ICT skills for pedagogical integration. An evaluation of whether the implementation of the policy by the time of this research had made any impact on teachers’ ICT skills especially for pedagogical integration is also made.

A mixed methods design was used to gather data in which two data sources were used, i.e. government documents and teachers’ responses to a questionnaire. A total of 140 teacher respondents (representing 21% of teacher population in the study area) from 20 schools (representing 47.6% of the population of schools in the study area) were selected to participate in the study. The response rate to the questionnaire was 99.3%.

Data were analyzed both qualitatively and quantitatively. Descriptive statistics such as frequencies and percentages were used to describe the responses from the questionnaires. The Chi-square test of independence was also carried out to compare some findings.

Generally the study revealed a discrepancy between the policy statement and actual practices; for instance, in spite of the policy’s emphasis on integrating ICT in pre-service teacher training, it was evident that teacher training institutions had not institutionalized the integration of ICT in teacher education. However, integrating ICT in pre-service training, school-based training, short-term courses and workshops were some of the strategies being used.

It was recommended that school-based training should be emphasized to make the training more relevant to teachers’ contexts and that teacher training institutions should institutionalize ICT in teacher education to ensure that all newly qualifying teachers are equipped with ICT skills. It was also recommended that the ministry of education takes the initiative to bargain for cheaper customized ICT training for teachers with institutions that offer ICT training.

Acknowledgement

First and foremost, I thank the almighty God for the gift of life. I also extend my heartfelt gratitude to Professor Ren Youqun, vice president of East China Normal University and Dr. Li Yan of the International Center of Teacher Education of East China Normal University for their invaluable input in the course of writing this book.

To my best friend and wife Sarah and children Ali and Asher, I am very grateful for the love and support extended to me at all times. In the same vain I thank my father, Haj Juma Luwangula, Mother Jamawa Kauma and the entire Luwangula family for the invaluable support and guidance

I also specially thank Ms. Mpabulungi Leah Proscovia, the Headmistress of Wanyange Girls’ School for her motherly support without which this work would not have been accomplished. To my friends Oron Sulayi, Ravai Masendeke and Kayombo Joel Jonathan, I am grateful for the support in the course of writing this book.

Finally, I thank Uganda’s ministry of education, Jinja municipal council and all schools and teachers that participated in this study for the kind assistance.

Acronyms

illustration not visible in this excerpt

Chapter 1 Research Overview, the Problem and Research Methodology

1.0 Introduction

This chapter presents a background to the current study, the research problem, questions and objectives of the study. The methodology employed to conduct the research is also presented in this chapter. Finally, the chapter clarifies on terminologies used.

1.1 Background of the Study

In the recent past, there has been growing interest in the integration of information and communication technology (ICT) in the education systems of countries across the globe. Such interest has often been premised on the assumption that ICTs have a great potential for improving the quality of education. Moreover, education is presumed to cause socio-economic development. Indeed empirical studies confirm that education can make an important economic contribution (Kozman, 2005). Thus by improving the quality of education, ICT is thought to contribute to social and economic development.

The potential impact of ICT on social, economic and educational transformation has been alluded to by researchers, policy makers, politicians, bilateral and multilateral organizations. For example, the United Nations and the World Bank both advocate the use of ICT to support the development of the world’s poorest countries (Kozman, 2008, p.1083). In this regard, a World Bank report notes that ICT can increase access to education through distance learning, enable a knowledge network for students, train teachers and broaden the availability of quality education materials (p.1084). Furthermore, the G8 Heads of State emphasized the need to develop human resources capable of responding to the demands of the information age and to nurture ICT literacy and skills through education, training, and lifelong learning (Kozman, 2008, p.1083). The United Nations Educational, Scientific and Cultural organization [UNESCO] (2009) argues that ICT can help to enhance the quality of education with advanced teaching methods, improve learning outcomes and enable reform or better management of education systems (p.9). In addition, ICT support to education is perceived to be critical for reaching Education for All (EFA) goals by boosting the current rate of progress in developing countries especially through accelerated distance teacher-training (UNESCO, 2009, p.13).

Tilya (2008) attests that the world has entered the knowledge and information society, driven by information and intellectual products as raw materials. In this context, he argues that the ability to transmit data over an information and communication infrastructure is a crucial resource for any nation to participate effectively in the global information society and to address development challenges (p.1146). UNESCO (2009, p.16) points out that although the benefits of ICT use in education cannot be clearly measured, many countries continue to introduce it based on the assumption that citizens should be able to function adequately in a rapidly evolving information society.

Kozman (2008) notes the importance of national policies and programs as tools for the realization of ICT’s promise in education. Indeed Moonen (2008) reports that most countries in the world are actively pursuing policies in support of the use of ICT in education, and the Republic of Uganda has not been an exception. Kozma (2008) identified a number of key operational components essential for an ICT policy and these among others include teacher training. This is because the successful integration of ICT in education undoubtedly depends on teachers’ ability to use it. Clearly, Uganda’s policy for ICT in Education takes in cognisance the importance of teachers in the implementation of ICT in education and as such lays a strong emphasis on equipping them with ICT skills as a strategy for the successful implementation of the overall education sector ICT policy.

Using a framework provided by Moonen (2008) and information about the status of ICT in African countries as described by the United Nations Economic Commission for Africa (UNECA)-2006, Tilya (2008) situated the ICT-in-education policies of Sub-Saharan African countries on a continuum of steps in the development of ICT i.e., no policy yet, emerging policy, applying policy, infusing policy and transforming education by policy. By his framework, Uganda is at the stage of applying the policy (p.1153). But how is this policy being implemented in order to prepare teachers to use it for education purposes? It is this and related concerns that this research sought to answer.

1.2 Problem Statement

The government of Uganda (GOU) sought to embrace ICT with the hope that it would enable the country improve and sustain development and poverty reduction (Uganda Ministry of works, 2003). In partial pursuit of these aims, the national policy for ICT advocates among other things integrating ICT in mainstream education (p.33). Accordingly, the Ministry of Education and Sports (MoES) developed a policy for ICT in education to help guide the integration of ICT into education. Uganda’s policy for ICT in education recognizes the crucial role of teachers in implementing any education reform initiative and as such points out that “in ensuring that the best use is made of ICT, the key focus must be on the teachers/trainers/lecturers and the curriculum that they are expected to follow” (Uganda MoES, 2005, p.15). Consequently, the policy states that computer awareness should be introduced into the training of primary school teachers on a phased basis (p.16) and that on a phased basis all NTCs will begin to provide ICT courses to their student teachers to allow them to use ICT in their own studies, in lesson preparation and in making teaching materials (p.17).

However, although such a promising policy is in place, it has been observed that policy implementation is one of the major problems confronting developing nations (Makinde, 2005). Often times, good policies are articulated but lack of stakeholder commitment and political will as well as resource constraints hinder implementation. Therefore, since teacher preparation remains central to the implementation of Uganda’s overall education sector ICT policy, assessing the implementation of the policy in regard to equipping teachers with ICT skills was a timely obligation.

1.3 Research Questions

This study was guided by a main research question from which specific questions to be answered by the research were derived.

1.3.1 Main Question

What strategies are being used to implement the education sector ICT policy in regard to teacher education and has the implementation of the ICT policy in education had any impact on teachers’ ICT knowledge and skills?

1.3.2 Specific Questions

(i) What is the policy direction and administrative strategy envisaged for equipping teachers with ICT skills?
(ii) Have teachers engaged in any ICT training?
(iii) What ICT skills do teachers possess?
(iv) Was/is the ICT training received by teachers (if any) relevant to their practice as teachers?
(v) What approaches are being used to deliver ICT training to teachers?

1.4 Justification

It was hoped that this study could:

(i) Provide a situation analysis of the ICT knowledge and skills of Uganda’s teachers hence informing further action in the implementation of the country’s policy for ICT in education.
(ii) Generate baseline data for comparison with other case studies in this field to inform policy action.
(iii) Provide an opportunity to teachers to express their views on how best they think ICT should be integrated in the country’s teacher education system to enable teachers use it in their practice.

1.5 Scope of the Study

The study was carried out in Jinja municipality in Uganda among primary and secondary school teachers. It focused on inquiring into the activities in pre-service teacher training and continuous teacher professional development related to the integration of ICT in education. Only teachers already practicing teaching at school level were included in the study. Data was collected between February and March 2011.

1.6 Purpose of the Study

The study sought to assess the strategies that were being used to implement ICT in teacher education and whether such strategies were effectively equipping teachers with the knowledge and skills advocated in the education sector ICT policy?

1.7 Specific Objectives

Specifically, the study aimed at:

(i) Evaluating teachers’ ICT knowledge and skill levels
(ii) Assessing the relevancy of teachers’ ICT skills to their practice as teachers.
(iii) Evaluating the approaches being used to equip teachers with ICT skills.

1.8 Methodology

In this section, the study area, research design and data analysis techniques used and ethical considerations are described.

1.8.1 Study Area

The study was carried out in Jinja municipality. Jinja municipality is a part of Jinja district in southeastern Uganda, approximately 54 miles (87 km) by road, east of Kampala, the capital. The town is located on the shores of Lake Victoria, near the source of the Nile River. Jinja municipality is the largest metropolitan area in Jinja District and is considered the capital of the Kingdom of Busoga. Jinja has a large population of inhabitants (Wikipedia, Jinja-Uganda).

1.8.2 Research Design

The study used a mixed methods approach in which both quantitative and qualitative data were collected. Two major data sources were used (Osei, 2008; p.6) to answer the research questions. The study was divided into two parts. The first part involved document review (government documents) and through this the first research question was answered (see chapter 3). Part two was a questionnaire survey involving teachers following which the remaining four research questions were answered (see chapter 4 & 5).

1.8.2.1 Documentary Review

The docments reviewed were MoES documents namely the Education Sector Strategic Plan (ESSP)[1], 2007-2015 and the Draft policy for ICT in Education-2005. A review of these documents was deemed necessary to provide insight into political intensions, policy direction and administrative strategies of relevancy to the present study. The draft policy for ICT in education was particularly reviewed because it details the expectations and guidelines for ICT in the education sector while the ESSP 2007-2015 is the current government document detailing the current programmes and investment priorities in the education sector. Thus by understanding these two documents, it would be possible to relate government plans and expectations with what is happening on ground using data from the questionnaire survey.

1.8.2.2 The Questionnaire Survey

Because this study sought to assess the strategies that were being used to equip teachers with ICT skills and the ICT skills status of teachers, it was deemed sensible to have teachers themselves confess to these. A tracer study[2] (UNESCO, 2009, p.86) was used. In this case, sampled teachers were asked to tell when they completed training as teachers[3]. The purpose was to determine whether teachers trained after the inauguration of the policy for ICT in education (pre-service training) had better self-perceived+ proficiency in ICT for pedagogical integration compared to their counterparts who trained before and to determine if such proficiency could be attributed to the implementation of the policy.

Population of the Questionnaire Survey

The population of the questionnaire survey can be viewed in two dimensions; the population of schools and that of teachers. In identifying the population of the study, a list of all primary and secondary schools in Jinja municipality was obtained from the Jinja Municipal Education office (See Appendix I). While attempts to get information about the population of teachers in these schools were made, such information was not readily available. Therefore, to be able to come up with a representative sample of the population of teachers, secondary data from a study conducted by the ministry of education and sports to estimate the number of teachers in the schools was used (Details in Section 4.0).

Selection of Subjects

A stratified random sampling approach was used to select 20 schools by equal allocation to each of the strata; primary and secondary schools. Within each stratum, schools were selected by simple random sampling in which the names of all the schools in the population of a given stratum were entered in a computer and ten randomly selected using Microsoft (MS) Excel. Seven teachers were then selected randomly from each of the 20 sample schools to participate in the study, giving a total of 140 respondents.

The Questionnaire

A questionnaire was presumed suitable for this study for two reasons: (i) the study population was literate and could therefore fill the questionnaires easily and (ii) questionnaires are effective at drawing a lot of information from respondents within a short period of time and cheaply. The questionnaire was of paper and pencil type[4]. To probe responses from the respondents, the questionnaire consisted of closed and open-ended questions. All questions in the questionnaire were developed by the researcher based on his own pre-conception of issues relevant to the research. The following questions were contained in the questionnaire:

(i) Have you ever engaged in any ICT training as a teacher?
(ii) Who initiated your ICT training(s)?
(iii) Please tick all that applies in the list below to describe the strategy used in your training.
(iv) Please tick all that applies to indicate the method of instruction used in your ICT training.
(v) If you have ever received ICT training of some sort, was the training content linked to the curriculum and how you can integrate ICT in real classroom instruction?
(vi) For the ICT training you have received as part of continuous professional development, who planned the content you were taught?
(vii) Given the ICT knowledge and skills that you have, which of the following are you able to comfortably do with ICT?
(viii) What ICT knowledge and skills do you want to learn but have not been referred to in the trainings?
(ix) What training strategies and or methods of content delivery do you prefer to be used in equipping you with the ICT knowledge and skills that you need as a teacher?
(x) Please express your opinion regarding the education sector ICT policy and ICT in teacher education.
These questions were particularly chosen to probe whether teachers were receiving training in ICT as required by the policy, whether there were any deliberate initiatives by those in positions of authority to train teachers in ICT as proposed and claimed by the policy[5] and whether the training received, if any, was relevant to the professional needs of teachers. The questionnaire was structured as follows:

(i) First, it contained an introductory paragraph with background information explaining the context of the study;
(ii) Part I of the questionnaire consisted of questions related to the demographic information of respondents;
(iii) Part II consisted of questions exploring the status of ICT training, ICT knowledge and skills of teachers in Jinja and initiatives to train teachers in ICT.
(iv) Part III sought to tap teachers’ opinions on approaches deemed suitable for equipping them with ICT skills as well as any other opinion they felt like expressing in relation to the ICT policy and teacher education.

The questionnaire administered during the study is attached as Appendix A.

Procedure of Data Collection

For purposes of administering the questionnaire, one research assistant was recruited. The following reasons justified the recruitment of an assistant:

(i) Due to financial and time constraints, the researcher could not travel to Uganda from China where he was based at the time of the study to collect data by himself.
(ii) The research assistant recruited was a teacher within Jinja municipality who had warm relations with several teachers from the targeted population. It was therefore easy for her to exploit those warm relations to have the questionnaires filled in time.
(iii) The research assistant was enthusiastic about being involved in the study as she viewed it as a form of personal growth on her part.
Before setting out into the field, the researcher and the research assistant had a video conference using skype[6] in which they discussed the questionnaire to enable the assistant understand it in case it became necessary for her to help respondents fill in the questionnaire. In addition, the assistant was briefed on other aspects pertaining to the research such as introducing herself, explaining the purpose of the research and selecting respondents randomly.

The research assistant delivered the questionnaires in person at the sampled schools where she waited until they were completed. Where necessary, she had to leave questionnaires with respondents or the school administrators to enable respondents complete them (questionnaires) at their own pace if they (respondents) were not ready to complete the questionnaire in the presence of the research assistant. This required her to return to the schools later and collect the completed questionnaires.

1.8.3 Research Validity and Reliability

The questionnaire was pilot tested for reliability assessment of individual items. In this regard, ten questionnaires were administered to ten teachers at random in Shanghai - China for the pilot test and necessary adjustments were made. To ensure the overall research validity, conclusions were based on a variety of sources of information (triangulation).

1.8.4 Ethical Considerations

A high level of ethical conduct was maintained in carrying out this study in line with the research code of conduct. This was done through seeking permission from Jinja municipal government authorities to be allowed to collect data, acknowledging sources used throughout this study, stating facts as they are, avoiding plagiarism and keeping the identity of respondents confidential.

1.8.5 Data Analysis Techniques

Data were analyzed using both quantitative and qualitative methods. Data from document review and some open-ended questions in the questionnaire were analysed using qualitative methods. Qualitative data analysis makes it possible to contextualize findings thereby giving more meaning to the findings. Quantitative data collected through the questionnaires were analysed quantitatively using computerised software; spss 16 and Microsoft excel. Descriptive statistics such as frequencies and percentages were used to describe the responses from the questionnaires. The Chi-square test of independence was also carried out to compare some results.

1.9 Definition of Terms

Some technical terms can have a variety of meanings. This section gives the meaning of key terms as conceptualized for purposes of this study.

(i) Teacher education – For purposes of this study, teacher education is conceptualized as all pre-service and in-service training received by secondary and primary school teachers in preparation for the teaching job. The term is interchangeably used with TPD throughout this book.
(ii) Implementation – to give practical effect to and ensure actual fulfillment by concrete measures.
(iii) ICT – Information and Communication Technology . ICT covers any product that can store, retrieve, manipulate, transmit or receive information electronically f or example personal computers, television, email, robots, fax, telephone, internet, tape cassettes, radio, CD-ROM etc. For purposes of this study, ICT was limited to the “traditional” computer and its associated offerings in education.
(iv) Policy – an officially agreed and chosen way of executing official business .

Chapter 2 Review of Related Literature

2.0 Introduction

This chapter presents available literature pertaining to ICT in teacher education in the world generally and in Uganda in particular. The literature is reviewed under four sub-topics. A review of the initiatives for ICT in teacher education presents an opportunity for the researcher and reader to understand whether or not there have been any attempts to equip teachers with ICT skills in the country, when and by whom such initiatives were carried out as well as their relevance, success and failure. The second section, ICT policy debate and teacher education introduces international and local policy debates as well as practices in the field of ICT in teacher education in order to construct a wealth of knowledge, which together with the results of the study could provide an informed basis for policy recommendations. In the third section, different paradigms about the ICT knowledge and competencies expected of teachers are explored. Through this review the literature provides a firm basis for judging the suitability of the ICT knowledge and skills that the target population possesses for ICT integration in education in order to make sound recommendations. Finally many researchers have argued that political will is crucial to policy implementation. Therefore, the fourth section of this chapter examines political priorities in Uganda and how they influence policy and policy implementation in order to construct a deeper understanding of the state of ICT in teacher education basing on government priorities.

2.1 Initiatives for Equipping Teachers with ICT for Pedagogical Integration in Uganda

According to Wamakote (2010) , the Ugandan government’s most significant ICT investment in the educational sector is the Education Management Information System (EMIS) which aims at providing quality education statistics in a timely, cost-effective and sustainable manner (p.19). However, he notes that the MoES has also supported other ICT initiatives in partnership with other agencies (p.19). According to an annex in the draft policy for ICT in education on the status of ICT in education in Uganda, several of these initiatives aim, among other things at equipping teachers with relevant ICTs for integration in the teaching-learning process (Uganda MoES, 2005). They included:

(i) The Connectivity for Educator Development (Connect-ED) project initiated in May 2000. The Connect-ED project is supported by the United States Agency for International Development (USAID) in close cooperation with Uganda's MoES and within the framework of the U.S. Education for Development and Democracy Initiative (EDDI) (p.29). Connect-ED is using technology to enable and enhance learning and teaching for primary school educators through the creation of multifaceted approaches to integrating media and computers in the Primary Teacher Colleges (PTC’s) classrooms (p.29). Connect-ED is accomplishing this by setting up education technology centres thereby increasing access, availability, and provision of relevant and quality learning materials and support for teacher professional development (p.29).
(ii) IICD-MoES. There are four projects going on between the Institute for Information and Communication Development (IICD) in conjunction with the MoES (p.29). These projects are, among others: (a) ICT Based Educational Content. (b) ICT Training.
(iii) British Council has a program in some private secondary schools that aims at introducing ICT to be used in teaching and learning (p.29).
(iv) The National Curriculum Development Centre (NCDC) worked with the International Development Research Centre (IDRC) to come up with the CurriculumNet project to develop, test and implement a mechanism for curriculum integration and delivery for primary and secondary schools in Uganda via communication networks using computer related tools. In relation to the mandate of NCDC and its functions, the CurriculumNet project was conceived to influence both the practice and policy of Education (p.30). CurriculumNet was intended to enable students, educators and educational administrators to develop appropriate competencies to effectively use ICTs in the teaching and learning process (p.30).
(v) Creating learning networks for Africa is also a project in progress. It is meant to assist teachers in secondary schools to appreciate ICT in their works and is supported by UNESCO (p.30).
(vi) The e-Schools initiative under the auspices of New Partnership for Africa in Development (NEPAD) seeks to ensure that the majority of the people on the continent have the skills required to function in the information society and knowledge-based economy. Among other objectives it aims to provide teachers with ICT skills to enable them use ICTs as tools to enhance teaching and learning (p.31).
(vii) SchoolNet Uganda supports educators and learners by providing pedagogical and technical expertise and advice, infrastructure and human resources, coordination, training and capacity-building and developing local and international partnerships (Farrell, 2007, p.11).
Therefore from the above literature it is evident that there are initiatives that have been undertaken to equip teachers with ICT skills. However, Harrison (2010) notes that while there have been many schemes over the last decade to introduce ICT into schools in Africa, many have failed to live up to their aspirations because they have been top-down and supply led with insufficient attention being paid to the involvement and training of teachers. Could this also be true for Uganda in particular? He however notes that among the most successful ICT projects in Africa was Connect-ED in Uganda (p.80). Unfortunately he does not provide evidence in support of the supposed success. In contrast, Wamakote (2010) contends that information on the actual impact of ICT initiatives in the country is scanty. A research commissioned by SchoolNet Africa (2004) highlighted the fact that although there was evidence of a number of teacher training initiatives in Africa at both pre-service and in-service levels, these were mainly small scale, regional and fragmented with little sharing of experience among nations. So if this is true for Uganda, do such projects reach all teachers?

According to Schroeder (2001), the reality of public sector program implementation today is that any implementation that is attempted in the name of “enhancing the public good” will necessarily involve stakeholders from the community, the private sector, and other quasi-public entities (p.1). Thus, while the afore mentioned initiatives are perhaps not direct reactions to ensure the implementation of Uganda’s policy for ICT in education (indeed some of these started long before the inauguration of the policy e.g. Connect-ED) and while they may not purely be government initiatives, it is important to appreciate that they can be instrumental in achieving the aims of the policy in regard to teacher education. It is also encouraging to note that there is seemingly a lot being done to equip teachers with knowledge and skills for the pedagogical integration of ICT. However, as already noted, there is hardly any well documented evidence to reveal whether the implementation of such projects has had any impact on the teachers’ ICT knowledge and skills.

2.2 ICT Policy Debate in Teacher Education

The process of teachers learning to use ICT effectively to support learning and teaching is linked to the adaptation of education to the context of the twenty-first century (Davis, 2008, p.507). According to Holland (cited in Law, 2008), teacher learning should prepare teachers not only for any kind of ICT integration, but should equip teachers for “best practices” in ICT integration that contribute to improving existing teaching practice to achieve the goals of school reform (p.427). This stand point is supported by Harrison (2010) who argues that trainee teachers need to acquire very specific ICT competencies to enhance the quality of the teaching and learning that takes place in schools (p.84). From a pedagogical view point, a constructivist approach to instruction in which learner-centered approaches are preferred is increasingly being agitated in modern classroom practice. In addition, there is growing emphasis on life-long learning. The teacher him/herself should be able to learn, unlearn and relearn. Therefore I argue that ICT in teacher education should aim to equip teachers with knowledge and skills that will enable them improve their instructional practices in a constructivist sense as well as to be able to use it as a tool for life-long learning.

In introducing new ICTs to support teacher training, it is important that both pre-service and in-service environments are adequately supported (Harrison, 2010, p.81). However, Moon (cited in Harrison, 2010) notes that new communication technologies clearly also have the potential to supply continuing professional development of teachers but currently it is pre-service teacher education that dominates policies and resources and so in-service professional development is suffering from a lack of focus and investment (p.88). Does Uganda’s policy for ICT in education adequately support both the pre-service and in-service platforms?

The Society for Information Technology and Teacher Education (SITE) gives three key principles relevant to initial teacher education (Harrison, 2010). These are:

(i) Technology should be infused into the entire teacher education programme, not restricted to a single course.
(ii) Technology should be introduced in context, not taught as separate topics but rather as and when the need arises in all courses of the teacher education programme.
(iii) Students should experience innovative technology-supported learning environments in their teacher education programme. In addition, students should see their lecturers engaging in technology to present their subjects and have the opportunity to use such applications (p.79).

The Pan African Research Agenda on the pedagogical integration of ICT (hereafter to be abbreviated as PARA) reported the following about the description of ICT in pre-service teacher training at the school of education of Kyambogo University (KYU) in Uganda:

ICT has been integrated in pre-service training curriculum. It is one of the course units which are taught and it is compulsory for all the students. Due to the fact that there are many students, shifts are created and after introducing the basics of ICTs to the students, they are advised to continue studying it on a private basis. There are many other ICT training courses around the university but it is ICT, it is not yet fully a course that has been developed to enable teachers to study it as their teaching subject. At the moment teachers who teach ICT in secondary schools are from ICT department that is those who have studied computer science, ICT, but in education it has not yet been developed to that level. As a result, plans are under way to introduce ICT as a teaching subject to students of education as their area of specialty (PARA, 2009).

Clearly, the approach to ICT in teacher education at KYU was far different from the principles suggested by SITE and by UNESCO (Harrison, 2010, p.79). While the researcher does not seek to take the principles of SITE and UNESCO as rules of thumb, he remains skeptical about the likely impact of KYU’s approach to ICT in teacher education. In addition even the future plan i.e., “As a result, plans are under way to introduce ICT as a teaching subject to students of education as their area of specialty” (PARA, 2009) indicates a lack of alignment with research. This is because many influential reports have indicated that integrating ICT in teaching is more transformational than teaching it as a subject (UNESCO, 2008). Indeed this is what the SITE principles already mentioned above seem to suggest. Moreover, the practices at Kyambogo University, one of the country’s prestigious institutions of higher learning cast doubts on what could be happening in other teacher training institutions in regard to the integration of ICT in teacher education.

Continuous Professional Development (CPD) of teacher s is central to any successful technology and education programme (Harrison, 2010, p.83). The kind of professional development required depends on the nature of the adoption targeted for ICT in the curriculum (Law, 2008, p.425). Law and Plomp categorized the role of ICT in the curriculum (Law, 2008) into learning about ICT (as a subject), learning with ICT (as a medium to support or enhance existing instructional practice), and learning through ICT (which involves a full integration of ICT to bring about learning experiences that would otherwise not be possible) (p.425). Teachers who receive appropriate professional development, however, learn how to more effectively manage their classroom and use the technology to create a more stimulating learning environment while realizing that their pedagogic knowledge rather than technical knowledge is what makes them teachers (Harrison, 2010, p.83). While professional development is a very important part of teacher education, Harrison observed that how to deliver it effectively has become the central challenge (p.89). According to UNESCO (2008), teacher professional development has an impact only if it is focused on specific changes in teacher classroom behaviour and particularly if it is on-going and aligned with other changes in the educational system (p.9).

A study on the pedagogical integration of ICT in Ugandan Education institutions done by Ndidde, Lubega, Babikwa and Baguma (2009) revealed that majority of educators at secondary school level had participated in less than 50 hours of professional development which included ICT integration. However, this study did not provide any information on TPD involving ICT integration for primary school teachers. Ndidde et al (2009) further contended that the current teacher training had not mainstreamed ICT in the curriculum and that CPD programs for educators did not include ICT integration. Moreover, all the institutions sampled by Ndidde et al were from the central region and specifically the capital, Kampala or towns/villages just around Kampala. Schools in and around Kampala are more advantaged in regard to accessing and using ICT. In addition, there are hardly any documented case studies of teachers’ ICT knowledge and skills in regions outside Central Uganda. These facts make a further case for the necessity of this study.

SchoolNet Africa commissioned a study entitled “ Towards a strategy on developing African teacher capabilities in the use of information and communication technology” This study described among other things initiatives that were being implemented in teacher education integrating ICT in African countries and the approaches that were being used (SchoolNet Africa, 2004). Among them was Connect-ED in Uganda (p.47). As part of its effort, Connect-ED was preparing a multimedia online teacher training curriculum. This curriculum, based on the Ugandan core curriculum, uses a student-centered learning approach. Connect-ED’s Professional Development Learning Environment (PDLE) was targeted at trainee primary school educators in Uganda at eight primary teacher colleges (PTCs) and it is presented in a series of online workshops or as a self-paced tutorial and resource guide (p.47). The study asserts that this is a good basic, online, self-paced ICT course for Ugandan pre-service primary educators, and it is freely available to whoever wishes to access it. However its impact on the teacher trainees needs to be assessed.

2.3 Knowledge Needed by Teachers for Successful Integration of ICTs in Education

Research supplies comprehensive mapping of the knowledge and skills comprising new disciplines and inter-disciplines, requiring the resolution of specific curricular issues, e.g., definition of multi-layer content, from the conceptual to the practical, thematic re-organization or novel ways to integrate between ICT content and other disciplines. (Nachmias, Mioduser & Forkosh-Baruch, 2008, p.164). Which competencies each teacher needs to acquire very much depend on the specific circumstances of their particular school (Harrison, 2010, p.71). While it is important to take cognizance of the different circumstances of teachers while deciding which ICT competencies to equip them with as argued by Harrison, some underlying principles exist to guide such decisions. For example, the UNESCO ICT competency standards for teachers describe three approaches: technological literacy, knowledge deepening and knowledge creation (UNESCO, 2008, p.8). These approaches to educational change, aim to address different policy goals and visions. Of the three approaches, the technology literacy approach involves the most basic policy changes. Professional development programs that are coordinated with these policies have the goal of developing teachers’ technological literacy so as to integrate the use of basic ICT tools into the standard school curriculum, pedagogy, and classroom structures. Through such programs, UNESCO argues, teachers would know how, where, and when (as well as when not) to use technology for classroom activities and presentations, for management tasks, and to acquire additional subject matter and pedagogical knowledge in support of their own professional development (p.10).

Mishra and Koehler argue that the lack of theoretical grounding for educational technology is the prime reason for the lack of significant changes in the way teaching and learning is carried out in schools, even when digital technology is used (Law, 2008, p.425). They propose technological pedagogical content knowledge (TPCK) as a framework for conceptualizing the complex systems of knowledge underpinning expertise in teaching with digital technology (p.425). The TPCK framework introduces three new kinds of knowledge for teacher competence in integrating ICT in instructional practices: technological content knowledge (TCK), technological pedagogical knowledge (TPK), and TPCK. The framework emphasizes the situatedness and interactive nature of the development of TCK, TPK, and TPCK (p.426).

Information on the ICT competencies of Ugandan teachers is not well documented. An ICT observatory by the PARA, reporting on the competencies required for ICT use by educators in Uganda[7] however reveals that teachers are not comfortable with even the very basic applications of computers. Teachers still yearn to learn packages like Microsoft (MS) Word, Excel, Powerpoint and internet surfing. From this observatory, it can be anticipated that the Ugandan teachers don’t have any idea of how even the basic ICT skills they seek to learn can be used to enhance the teaching-learning process. It is as if they seek to learn basic computer skills for the sake of it. Moreover, such opportunities seem to be out of their reach. While the observatory is institutional based, it is worthy noting, again, that the institutions involved in this particular survey are elite institutions (Lating, 2006), located in and just around the capital Kampala where traditionally, teachers have better chances of accessing opportunities for professional development .

2.4 The Interplay between Politics, Policy and ICT Policy Implementation in Uganda

Many researchers have emphasized the necessity of ICT policies if ICT is to successfully be integrated in education. African countries have developed national ICT policies (including Uganda), and several more are in the process of finalising their ICT policies; however, teacher training in ICT at national levels remains fragmented, under-funded and inadequate (SchoolNet Africa, 2004, p.52). SchoolNet Africa (2004) further notes that:

Even where governments have developed policies related to ICT in education, implementation remains a challenge. Many African education ministries are desperately short of funds to allocate to existing education requirements. Therefore, although most view ICT as an important new field for education development, ICT programmes for teachers are low in terms of spending priorities. This is well illustrated by the Connect-ED example in Uganda. The Uganda Ministry of Education is struggling to support primary schools with average class sizes of up to 70 students. It therefore argues that it needs to feel sure that allocating a budget towards pre-service teacher training in ICT is a better investment than supplying textbooks to schools (p.52).

Purcell (2010) notes that the main driving forces behind education sector policy in Uganda continue to be the President‘s manifesto commitments for primary and secondary education, the pressure to achieve the goals of the Poverty Eradication Action Plan (PEAP) and the aims of achieving EFA and the Millennium Development Goals (MDGs) by 2015 (p.13). He further observes that current education policy focuses on expanding the functional capacity of educational structures and on reducing the inequalities of access to education between sexes, geographical areas, and social classes (p.13). Thus while the Ugandan government recognizes the necessity for integrating ICT in its education system, with the meager resources at hand, policy makers and implementers find themselves at crossroads. Purcell for example, commenting on the quality of the country’s education system states that the ministry‘s dilemma is to find a balance between providing a quality service on the one hand, and satisfying political demands for increasing access at all levels on the other (p.14). These situations illustrate that until there is political commitment to ICT in education, it might be hard to anticipate total success.

In addition, the politics surrounding the allocation of the available donor projects for ICT is itself a paradox. Lating (2006) for example notes that the SchoolNet Uganda Very Small Aperture Terminal (VSAT) project aimed at connecting schools to the internet targeted the well-established, elite secondary schools with good science infrastructures (laboratories, libraries and qualified and committed teachers) yet the project was meant to be implemented in rural schools (p.27). Such inequity puts the rural teachers and their students at an even bigger disadvantage in as far as accessing information is concerned. What Lating however doesn’t make clear is whether the decision to allocate ICT donor projects is taken by government or the donors themselves.

Chapter 3 The Policy for ICT in Education and the Education Sector Strategic Plan 2007-2015

3.0 Introduction

As already mentioned, the Republic of Uganda introduced a policy for ICT in education to help guide developments in the integration of ICT in education. However, all government policies in the education sector are periodically translated into programmes for implementation. These programmes are contained in the ESSP. Simply put, the ESSP shows priority areas for government investment in the education sector over a given period of time.

Therefore this chapter reviews the ICT in education policy to bring about an understanding of its expectations in regard to teacher training. The chapter then analyses the ESSP 2007-2015 to examine whether ICT training for teachers was treated as a priority investment area. This way, we can be able to understand the relationship between policy and practice in this context. The background and context in which the policy was introduced, the intentions and focus of the policy as regards training of teachers in ICT use as well as a summary of initiatives to implement the policy in regard to teacher training and their effectiveness are presented. Finally the chapter draws conclusions about policy direction and administrative strategy for equipping teachers with ICT skills in order to answer the first question of the study (see section 1.3.2).

3.1 The Education Sector ICT policy

3.1.1 Background and context

In the early 1990’s, the government of Uganda decentralized the management of public affairs. The decentralisation policy was intended to ensure that opportunities exist at all levels of the Ugandan society for the discussion and formulation of local opinion (Uganda Ministry of works, 2003, p.6). However, community participation in all aspects of national importance requires a robust mechanism by which they are fed with and share information amongst themselves and with the authorities at the center. To this end, the government recognised the fundamental importance of ICT in any policy for development and creating the conditions for the fullest participation by all sections of the population (p.6).

The enactment of the Press and Journalist Statute, 1995[8] ; the Electronic Media Statute, 1996[9] ; Communications Act, 1997[10] and the Rural Communications Development Policy, 2001[11] significantly brought about liberalisation in the communications sector. Particularly, the liberalisation of the acquisition, use and application of ICT led to a rapid expansion of the ICT industry in Uganda in the 1990s. However, a 1998 study of the status of ICT in the country revealed low coverage and skewed distribution of ICT infrastructure (Uganda Ministry of works, 2003, p.7). Therefore in order to enhance and streamline the developments in the ICT sector, government through the Uganda National Council of Science and Technology (UNCST) created a task force that formulated a national ICT policy in 2002 (passed by parliament in 2003). There are three areas of focus in the national ICT policy: information as a resource for development, mechanisms for accessing information and ICT as an industry, including e-business, software development and manufacturing.

The first objective of the National ICT policy is to sensitize and create awareness among the general public and all stakeholders about the role of information and ICT in Uganda’s development process while the second objective is to increase the level of ICT functional literacy in all sectors and build human resource capacity (Uganda Ministry of works, p.37). One of the strategies for implementation of the National ICT policy is to integrate ICT in mainstream education curricular and provide for equitable access by pupils and/ or students at all levels (Uganda MoES, 2005, p.11).

In July 2000, an ICT roundtable process on education was initiated as one of the efforts towards developing an education sector ICT policy that would accordingly guide the integration of ICT in education (Uganda, MoES, 2005, p.11). In May 2001, a multi-country workshop funded by the International Institute of Communication and Development (IICD) was conducted for 5 days under the theme “Designing ICT policy in Education” the purpose of which was to enable participants design ICT policies for further elaboration within national sector management (p.11). Following this, Uganda set out to develop its Education Sector ICT policy which is the subject of this study.

3.1.2 Intentions and focus of the policy

Uganda’s policy for ICT in education aims to work towards the achievement of Uganda’s Vision 2025 and the broad aims of education as stated in the Government White Paper on Education-1992 (Uganda MoES, 2005, p.11). The strategic objectives of this policy and the strategies to operationalise activities are meant to work towards the fulfillment of the national ICT vision, ministry of education vision/objectives and the mission statement of the ICT policy (p.14). The vision for the ICT policy in education is mainstreaming of ICT in the education sector and the mission is to provide equitable access to quality education and timely accurate information using ICT (p.14).

The policy aims to develop a framework of curriculum and teacher training that will facilitate and guide the development of ICT in education with a view to gaining the best advantage for the country as a whole (Uganda, MoES, 2005, p.15). However, the policy does not envisage large-scale purchase of equipment for schools in the short term, and while it acknowledges the desirability to have computers in every school, it notes that it is impractical for reasons of financial constraints and because of the limited capacity of the teachers to make effective use of the technology (p.15). The policy notes that strategies driven by equipment provision may easily result in underused technology and hence states “In ensuring that the best use is made of ICT, the key focus must be on the teachers/trainers/lecturers and on the curriculum that they are expected to follow” (p.15).

The policy proposes to tackle equity issues by among other measures (i) ensuring that all teachers begin to receive ICT training as part of the teacher training and to develop a foundation for ICT skills and experience throughout the country, (ii) considering gender in the selection of teachers for training as computer specialists in order to ensure gender equity (Uganda, MoES, 2005, p.16). It further proposes that a number of existing staff should be provided with additional training as needed to prepare them to teach ICT to their students (p.18).

While acknowledging that majority of primary schools in Uganda do not have computers and many lack other necessary infrastructure (electricity, security and connectivity), the policy points out that it is appropriate that primary pupils should be required to use computers and that a curriculum for ICT at primary school level should be developed (Uganda, MoES, 2005, p.16). It proposes that the ministry should encourage primary schools that can acquire ICT infrastructure to use the technology to support teaching, either by producing teaching materials or by use of the technology with students (p.16). In addition, it proposes that computer awareness should be introduced into the training of primary teachers on a phased basis, so that newly qualified teachers are equipped to make use of ICT as it becomes available (p.16).

At secondary school level, the aim of the policy is that teachers should be equipped to make use of ICT in their lesson preparation, to use ICT in their teaching where the equipment is available and a specific subject based on ICT applications to be provided for schools that have sufficient equipment (Uganda, MoES, 2005, p.17). Accordingly, it proposes that as many teachers as possible should be provided with computer awareness, basic skills, and enough experience to make use of ICT in lesson preparation and in making teaching materials (p.17). Further still, it proposes that on a phased basis, all National Teachers’ Colleges (NTCs) should begin to provide ICT courses for their student teachers (p.17). These courses, it suggests should not be aimed to prepare them to teach the subject, but should allow them to use ICT in their own studies, in lesson preparation and in making teaching materials (p.17).

Finally, the policy observes that while the ministry ICT strategy is aimed primarily at curriculum and teacher training, it is recognised that if no specific action is taken, the gradual development of computers in schools will encourage the growth of a digital divide (Uganda, MoES Draft ICT Policy in education, 2005, p.18). To this effect, it proposes the provision of a limited amount of equipment targeted at a small number of rural-poor schools (p.18) and that the ministry would seek to reduce the cost of ICT to schools in the following ways (p.20-21):

(i) Negotiate with the Uganda Communications Commission (UCC) to seek to develop a low cost rate of access to the Internet for schools.
(ii) The ministry would authorise schools to allow members of the community to use their computer facilities after school hours. This would provide a service to the wider community and allow the schools to make some income that can be used to reduce the cost of internet connectivity.
(iii) Where schools are located in rural areas and are prepared to make their facilities available to the community, the ministry would seek to direct funds from the Rural Connectivity Development Fund (RCDF) of the UCC to provide connectivity at reduced cost.
(iv) The ministry will engage in negotiations with the manufacturers of software with a view to arranging an educational rate for the main applications to be used in schools.
(v) The ministry will encourage sponsors and donors of equipment to schools to direct their donations to schools that are unlikely to be able to raise funds for equipment of their own, in particular rural schools and girls’ schools will be targeted.
(vi) The ministry will provide limited funding to provide ICT equipment in a small number of rural-poor schools each year.
(vii) The training in ICT provided to teachers will include a module on first line maintenance, enabling teachers to solve routine problems themselves as and when they occur.
(viii) The capitation grant to schools will be modified to provide a modest increase in grant to secondary schools that have been targeted for the provision of computers because of their rural-poor status. This will provide some funding for maintenance and upkeep of the equipment.
However although a time line was set for when NTCs were supposed to begin preparing teachers to teach the subject “computer studies”, no such time line was set for when institutions would begin equipping teachers with ICT skills to enhance their pedagogical practices (See appendix G).

3.1.3 Initiatives for Implementation of the Policy and their Effectiveness

The initiative being undertaken to train teachers in ICT were comprehensively discussed in Section 2.1. Therefore in this section only a brief summary of those initiatives is presented. From the literature review it was evident that there are many initiatives underway to equip teachers with ICT skills. However, some of these were already underway long before the inauguration of the policy for ICT in education thus they may not represent deliberate efforts to implement the policy. Nevertheless, they remain important projects for the country. It can also be seen that most of the initiatives to equip teachers with ICT skills are donor projects, mainly manned by NGOs with support from the ministry of education and sports. Some teacher training institutions were also reported to be equipping their students with ICT skills.

However, despite having many initiatives for equipping teachers with ICT skills, it is important to point out that these are small scale, regional and fragmented (SchoolNet Africa, 2004). The problem with these small scale projects is that they do not reach most of the teachers. Relying on NGO projects to introduce ICT in schools is in itself dangerous for many reasons for example:

[...]


[1] The ESSP is a medium-term Uganda MoES framework for policy analysis and budgeting in the education sector.

[2] The international labour organisation (ILO) (2008, p.656) thesaurus defines a tracer study as an impact assessment tool where the “impact on target groups is traced back to specific elements of a project or programme so that effective and ineffective project components may be identified.”

[3] The policy for ICT in education was written in 2005 and although no clear time scale was provided for when teachers would begin receiving ICT training to enhance their pedagogical practice, it seems like this was supposed to begin in 2006 (See Appendix G). Therefore 2006 was taken as a reference point in this research and teachers categorised as having finished their teacher training courses before or after 2006.

[4] Questionnaire being of paper and pencil type means it was printed on paper and respondents had to use pens/pencil to fill the questionnaire as opposed to electronic questionnaires were respondents just type their responses.

[5] The policy for ICT in education proposes that teachers should be trained in ICT during pre-service training courses and claims that so far many initiatives are already underway to equip teachers with ICT skills.

[6] Skype is a software application that allows users to make voice and video calls over the internet.

[7] http://www.observatoiretic.org/search/list?country_id=50&indicator_id=95

[8] It created the Media Council, the National Institute of Journalists of Uganda and a Disciplinary Committee within the Media Council. The Council is responsible for regulating eligibility for media ownership and requires journalists to register with the National Institute of Journalists of Uganda.

[9] The Statute created a licensing system under the Broadcasting Council for radio and television stations, cinemas, and videotape rental businesses. It also subjected the purchase, use, and sale of television sets to licensing by the Council.

[10] The main objective of the policy was to increase the penetration and level of telecommunication services in the country through private sector investment rather than government intervention.

[11] The main objective of the policy was to provide access to basic communication services within reasonable distance to all people in Uganda.

Details

Pages
Type of Edition
Originalausgabe
Year
2013
ISBN (PDF)
9783954895625
ISBN (Softcover)
9783954890620
File size
3.8 MB
Language
English
Publication date
2013 (June)
Keywords
Teacher Education ICT skills Policy Implementation Pedagogical Integration

Author

Luwangula Ismail obtained his first degree in education from Makerere University in Uganda in 2005. He taught for exactly five years in several schools around the country. As he was dissatisfied with the practices of education managers around the country, he was agitated to understand education management theory at an advanced level in order to positively influence education management practices. In 2010, the author enrolled for a masters program in education management with an orientation towards education leadership and policy at the East China Normal University. He graduated in 2011. Now, the author is actively involved in education entrepreneurship and management, and further, he successfully manages Malongo ARK – PEAS High school.
Previous

Title: Teachers‘ ICT Skills for Pedagogical Integration in a Developing Country: Discripancy between Policy and Practice
book preview page numper 1
book preview page numper 2
book preview page numper 3
book preview page numper 4
book preview page numper 5
book preview page numper 6
book preview page numper 7
book preview page numper 8
book preview page numper 9
book preview page numper 10
book preview page numper 11
book preview page numper 12
book preview page numper 13
book preview page numper 14
book preview page numper 15
book preview page numper 16
book preview page numper 17
book preview page numper 18
book preview page numper 19
book preview page numper 20
book preview page numper 21
book preview page numper 22
book preview page numper 23
116 pages
Cookie-Einstellungen