The Development of Digital Forensics Workforce Competency on the Example of Estonian Defence League

03.07.2014 kehtestati Vabariigi Valitsuse määrus nr. 108, mis reguleerib Kaitseliidu kaasamise tingimusi ja korda küberjulgeoleku tagamisel. Seega võivad Kaitseliidu küberkaitse üksuse (KL KKÜ edaspidi KKÜ) kutsuda olukorda toetama erinevad asutused: näiteks Riigi Infosüsteemide amet (RIA), infosüsteemi järelevalveasutus või kaitseministeerium või selle valitsemisala ametiasutused oma ülesannete raames. KKÜ-d saab kaasata info- ja sidetehnoloogia infrastruktuuri järjepidevuse tagamisel, turvaintsidentide kontrollimisel ja lahendamisel, rakendades nii aktiivseid kui passiivseid meetmeid. KKÜ ülesannete kaardistamisel täheldati, et KKÜ partnerasutused / organisatsioonid ei ole kaardistanud oma spetsialistide olemasolevaid pädevusi ja sellele lisaks puudub ülevaade digitaalse ekspertiisi kogukonnas vajaolevatest pädevustest. Leitut arvesse võttes seati ülesandeks vajadustest ja piirangutest (võttes arvesse digitaalse ekspertiisi kogukonda kujundavaid standardeid) ülevaatliku pildi loomine, et töötada välja digitaalse ekspertiisi kompetentsipõhine raamistik, mis toetab KKÜ spetsialistide arendamist palkamisest pensionini. Selleks uurisime KKÜ ja nende olemasolevate koolitusprogrammide hetkeolukorda ning otsustasime milliseid omadusi peab edasise arengu tarbeks uurima ja kaaluma. Võrreldavate tulemuste saa-miseks ja eesmärgi täitmiseks pidi koostatav mudel olema suuteline lahendama 5-t järgnevat ülesannet: 1. Oskuste kaardistamine, 2. Eesmärkide seadmine ja ümberhindamine, 3. Koolituskava planeerimine, 4. Värbamisprotsessi kiirendamine ning 5. Spetsialistide kestva arengu soodustamine. Raamistiku väljatöötamiseks võeti aluseks National Initiative for Cybersecurity Education (NICE) Cybersecurity Workforce Framework (NICE Framework) pädevusraamistik mida parendati digitaalse ekspertiisi spetsialistide, ja käesoleval juhul ka KKÜ, vajadusi silmas pidades. Täiendusi lisati nii tasemete, spetsialiseerumise kui ka ülesannete kirjelduste kujul. Parenduste lisamisel võeti arvesse töös tutvustatud digitaalse ekspertiisi piiranguid ja standardeid, mille lõpptulemusena esitati KKÜ-le Digitaalse Ekspertiisi Pädevuse ontoloogia, KKÜ struktuuri muudatuse ettepanek, soovitatavad õpetamisstrateegiad digitaalse ekspertiisi kasutamiseks (muudetud Bloomi taksonoomia tasemetega), uus digitaalse ekspertiisi standardi alajaotus – Mehitamata Süsteemide ekspertiis ja Digitaalse Ekspertiisi Pädevuse Mudeli Raamistik. Ülesannete ja oskuste loetelu koostati rahvusvaheliselt tunnustatud sertifitseerimis-organisatsioonide ja erialast pädevust pakkuvate õppekavade abil. Kavandatava mudeli hindamiseks kasutati mini-Delphi ehk Estimate-Talk-Estimate (ETE) tehnikat. Esialgne prognoos vajaduste ja prioriteetidega anti KKÜ partnerasutustele saamaks tehtud töö kohta ekspertarvamusi. Kogu tagasisidet silmas pidades tehti mudelisse korrektuurid ja KKÜ-le sai vormistatud ettepanek ühes edasise tööplaaniga. Üldiselt kirjeldab väljapakutud pädevusraamistik KKÜ spetsialistilt ooda-tavat pädevuse ulatust KKÜ-s, et suurendada nende rolli kiirreageerimisrühmana. Raamistik aitab määratleda digitaalse ekspertiisi eeldatavaid pädevusi ja võimekusi praktikas ning juhendab eksperte spetsialiseerumise valikul. Kavandatud mudeli juures on arvestatud pikaajalise mõjuga (palkamisest pensionini). Tulenevalt mudeli komplekssusest, on raamistikul pikk rakendusfaas – organisatsiooni arengule maksimaalse mõju saavutamiseks on prognoositud ajakava maksimaalselt 5 aastat. Antud ettepanekud on käesolevaks hetkeks KKÜ poolt heaks kiidetud ning planeeritud kava rakendati esmakordselt 2019 aasta aprillikuus.In 03.07.2014 Regulation No. 108 was introduced which regulates the conditions and pro-cedure of the involvement of the Estonian Defence League (EDL) Cyber Defence Unit (CDU) in ensuring cyber security. This means that EDL can be brought in by the Information System Authority, Ministry of Defence or the authorities of its area of government within the scope of either of their tasks e.g. ensuring the continuity of information and communication technology infrastructure and in handling and solving cyber security incidents while applying both active and passive measures. In January 2018 EDL CDU’s Digi-tal Evidence Handling Group had to be re-organized and, thus, presented a proposal for internal curriculum in order to further instruct Digital Evidence specialists. While describing the CDU's tasks, it was noted that the CDU's partner institutions / organizations have not mapped out their specialists’ current competencies. With this in mind, we set out to create a comprehensive list of needs and constraints (taking into account the community standards of DF) to develop a DF-based competence framework that supports the devel-opment of CDU professionals. Hence, we studied the current situation of CDU, their existing training program, and contemplated which features we need to consider and ex-plore for further development. In order to assemble comparable results and to achieve the goal the model had to be able to solve the 5 following tasks: 1. Competency mapping, 2. Goal setting and reassessment, 3. Scheduling the training plan, 4. Accelerating the recruitment process, and 5. Promoting the continuous development of professionals. The frame-work was developed on the basis of the National Initiative for Cybersecurity Education (NICE) Cybersecurity Workforce Framework (NICE Framework), which was revised to meet the needs of DF specialists, including EDL CDU. Additions were supplemented in terms of levels, specialization, and job descriptions. The proposals included the DF limitations and standards introduced in the work, which ultimately resulted in a proposal for a Digital Forensics Competency ontology, EDL CDU structure change, Suggested Instruc-tional Strategies for Digital Forensics Use With Each Level of revised Bloom's Taxonomy, a new DF standard subdivision – Unmanned Systems Forensics, and Digital Forensic Competency Model Framework. The list of tasks and skills were compiled from international certification distribution organizations and curricula, and their focus on DF Special-ist Competencies. Mini-Delphi or Estimate-Talk-Estimate (ETE) techniques were applied to evaluate the proposed model. An initial estimation of competencies and priorities were given to the EDL CDU partner institutions for expert advice and evaluation. Considering the feedback, improvements were made to the model and a proposal was put forward to the CDU with a future work plan. In general, the proposed competence framework describes the expected scope of competence of an DF specialist in the EDL CDU to enhance their role as a rapid response team. The framework helps in defining the expected compe-tencies and capabilities of digital forensics in practice and offers guidance to the experts in the choice of specialization. The proposed model takes into account the long-term effect (hire-to-retire). Due to the complexity of the model, the framework has a long implementation phase — the maximum time frame for achieving the full effect for the organization is expected to be 5 years. These proposals were approved by EDL CDU and the proposed plan was first launched in April 2019

ECO D2.6 Web 2.0 requirements analysis

ECO sMOOCs are social and seamless and the pedagogical design puts the learner central, taking an active role and learning through interactions and connections with others. The platforms have to provide the features not only support social interaction but promote and enhance these. This deliverable puts forward what features can scaffold interactions, taking into account lessons learned from popular social media.Part of the work carried out has been funded with support from the European Commission, under the ICT Policy Support Programme, as part of the Competitiveness and Innovation Framework Programme (CIP) in the ECO project under grant agreement n° 21127

Efficient Use of Teaching Technologies with Programming Education

Learning and teaching programming are challenging tasks that can be facilitated by using different teaching technologies. Visualization systems are software systems that can be used to help students in forming proper mental models of executed program code. They provide different visual and textual cues that help student in abstracting the meaning of a program code or an algorithm. Students also need to constantly practice the skill of programming by implementing programming assignments. These can be automatically assessed by other computer programs but parts of the evaluation need to be assessed manually by teachers or teaching assistants.There are a lot of existing tools that provide partial solutions to the practical problems of programming courses: visualizing program code, assessing student programming submissions automatically or rubrics that help keeping manual assessment consistent. Taking these tools into use is not straightforward. To succeed, the teacher needs to find the suitable tools and properly integrate them into the course infrastructure supporting the whole learning process. As many programming courses are mass courses, it is a constant struggle between providing sufficient personal guidance and feedback while retaining a reasonable workload for the teacher.This work answers to the question "How can the teaching of programming be effectively assisted using teaching technologies?" As a solution, different learning taxonomies are presented from Computer Science perspective and applied to visualization examples so the examples could be used to better support deeper knowledge and the whole learning process within a programming course. Then, different parts of the assessment process of programming assignments are studied to find the best practices in supporting the process, especially when multiple graders are being used, to maintain objectivity, consistency and reasonable workload in the grading.The results of the work show that teaching technologies can be a valuable aid for the teacher to support the learning process of the students and to help in the practical organization of the course without hindering the learning results or personalized feedback the students receive from their assignments. This thesis presents new visualization categories that allow deeper cognitive development and examples on how to integrate them efficiently into the course infrastructure. This thesis also presents a survey of computer-assisted assessment tools and assessable features for teachers to use in their programming assignments. Finally, the concept of rubric-based assessment tools is introduced to facilitate the manual assessment part of programming assignments

The Influence of Mathematics Teachers' Knowledge in Technology, Pedagogy and Content (TPACK) on their Teaching Effectiveness in Saudi Public Schools

Many researchers including (Hill et al., 2008; McCray & Chen, 2012) have found that teachers' understanding of the mathematics content knowledge and their expertise in teaching methods "pedagogy" are largely responsible for how effective they are as teachers. More recent research (Lyublinskaya & Tournaki, 2012; Polly, 2011) suggests that teachers' ability to integrate technology into their teaching is also critical to their mathematics teaching effectiveness. This study investigated the validity of these assumptions for 7-12 grade mathematics teachers in Saudi Arabia and how their expertise in Technological Pedagogical And Content Knowledge (TPACK) influences their teaching effectiveness. The central question for grade 7-12 Saudi Arabian mathematics teachers is: Does expertise in technology integration, pedagogy and content relate to teaching effectiveness? The TPACK expertise of 347 secondary male mathematics teachers in Riyadh public schools was measured by self-evaluation questionnaires. Principals from 109 schools rated their teachers by using a 14 item "Teacher Effectiveness" survey. Descriptive statistics, bivariate correlations, ANOVA, Paired-Samples t-test and MANOVA were used to evaluate the relationship between the teachers' TPACK knowledge and teaching effectiveness. Results showed that teachers evaluated their TPACK at a high level. On the TPACK 1-5 Likert scale survey (5 = highly competent), the teachers rated their general mathematics content knowledge (CK) at M=3.7 (SD=.67), their general pedagogy knowledge (PK) at M=4.1 (SD =.55), their general technology knowledge (TK) at M=3.6 (SD=.70), their pedagogical knowledge within mathematics content (PCK) at M=4 (SD =.60), their technological knowledge within mathematics content (TCK) at M=3.7 (SD=.69), their technological knowledge within pedagogical knowledge (TPK) at M=3.6 (SD=.74), their technological pedagogical and content knowledge at M=3.7 (SD=.71), and their cumulative knowledge of technology, pedagogy and content at M=3.8 (SD=.52). The teachers also rated their professional preparation to integrate technology. They reported that their university courses prepared them to integrate digital technologies (M=3.51, SD=.88) better than professional development workshop and training (M=3.07, SD=1.7); t(346)= 8.17, p<.01. Principals rated the overall effectiveness of their teachers at M=3.11 (SD=.59) on the 14 item scale and their usage of technology at M=2.84 (SD=1.06). Correlations between mathematics teachers' 7 TPACK self-efficacy and the principals' rating of teacher effectiveness were not significantly different. Negative correlations were found between principals' ratings of teaching effectiveness and the teachers' evaluation of their professional preparedness in university courses (r=-.125, p<.05) and professional development training programs (r=-.129, p<.05). This discrepancy may point to differences between the way these principals and the higher education institutions value teacher preparation curriculum. Further studies may consider comparing teachers' TPACK self-efficacy to student achievement

"Do we need an entire course about it?": Evaluating two years of teaching HCI in computer science

Educators increasingly agree on the importance of teaching Human-Computer Interaction (HCI) to Computer Science (CS) students, but there is debate on how to best integrate HCI into CS curricula. Unfortunately, standard course evaluations typically do not provide sufficient insights for improving HCI classes. In the present article, we used a human-centered design approach to evaluate our HCI classes, building on a qualitative study with CS students from four introductory HCI classes over two years. We report on a qualitative assessment through interviews, photo elicitation and sentence completion. Specifically, we addressed four research questions: which contents were the most relevant, how students experienced the courses, how they view the role of HCI in CS, and which outcomes they perceived from the HCI courses. We gathered rich qualitative insights beyond the standard course evaluations and derived concrete enhancements for future course iterations. We discuss implications for other HCI educators and contribute recommendations for the living HCI curriculum. Furthermore, we reflect on the usefulness of our methodological approach to collect in-depth constructive feedback from students

The Application of Micro-Credentialing Mapping to University Degrees: a Skills Framework

With more students attending university in an increasingly globalised world which focuses upon qualifications and accreditations, higher education is going through a sustained period of extreme pressure and increasing expectations. With many differing qualifications becoming more commonplace, it is now becoming difficult for students and employers to adequately assess the skill gained through a course of study. Subsequently, the trust placed in these courses for developing the right skills has started to diminish. This thesis demonstrates the potential of a micro-credentialing approach to display the skills gained throughout a course of study. It can help all stakeholders develop a more in-depth understanding of the course. Using a well-informed methodology, together with other existing frameworks, an accurate mapping solution from learning outcomes given in a module specification has been produced. The mapping solution generates reasonably accurate skill profiles which provide further insight into particular courses of study. This approach opens up many further avenues of potential research both in terms of refining this methodology and developing an adequate cross-disciplinary micro-credentialing standard

ERP implementation methodologies and frameworks: a literature review

Enterprise Resource Planning (ERP) implementation is a complex and vibrant process, one that involves a combination of technological and organizational interactions. Often an ERP implementation project is the single largest IT project that an organization has ever launched and requires a mutual fit of system and organization. Also the concept of an ERP implementation supporting business processes across many different departments is not a generic, rigid and uniform concept and depends on variety of factors. As a result, the issues addressing the ERP implementation process have been one of the major concerns in industry. Therefore ERP implementation receives attention from practitioners and scholars and both, business as well as academic literature is abundant and not always very conclusive or coherent. However, research on ERP systems so far has been mainly focused on diffusion, use and impact issues. Less attention has been given to the methods used during the configuration and the implementation of ERP systems, even though they are commonly used in practice, they still remain largely unexplored and undocumented in Information Systems research. So, the academic relevance of this research is the contribution to the existing body of scientific knowledge. An annotated brief literature review is done in order to evaluate the current state of the existing academic literature. The purpose is to present a systematic overview of relevant ERP implementation methodologies and frameworks as a desire for achieving a better taxonomy of ERP implementation methodologies. This paper is useful to researchers who are interested in ERP implementation methodologies and frameworks. Results will serve as an input for a classification of the existing ERP implementation methodologies and frameworks. Also, this paper aims also at the professional ERP community involved in the process of ERP implementation by promoting a better understanding of ERP implementation methodologies and frameworks, its variety and history