Validation Guidelines for IS Positivist Research

The issue of whether IS positivist researchers were sufficiently validating their instruments was initially raised fifteen years ago and rigor in IS research is still one of the most critical scientific issues facing the field. Without solid validation of the instruments that are used to gather data on which findings and interpretations are based, the very scientific basis of the profession is threatened. This study builds on four prior retrospectives of IS research that conclude that IS positivist researchers continue to face major barriers in instrument, statistical, and other forms of validation. It goes beyond these studies by offering analyses of the state-of-the-art of research validities and deriving specific heuristics for research practice in the validities. Some of these heuristics will, no doubt, be controversial. But we believe that it is time for the IS academic profession to bring such issues into the open for community debate. This article is a first step in that direction. Based on our interpretation of the importance of a long list of validities, this paper suggests heuristics for reinvigorating the quest for validation in IS research via content/construct validity, reliability, manipulation validity, and statistical conclusion validity. New guidelines for validation and new research directions are offered

Determinants of User Acceptance of a Local eGovernment Electronic Document Management System (EDMS)

On numerous occasions the significant value of the investments involved in the development of eGovernment and the expectations of governmental information systems use do not correspond to the rate of effective use. This scenario makes it difficult to justify the development of electronic government by governments and local authorities among its citizens. It is therefore important to understand the factors that influence the employees' intention of using governmental information systems. With the aim of understanding the determining factors of using an Electronic Document Management System (EDMS) in the context of Portuguese municipalities, this study develops an empirical analysis using the Unified Theory of Acceptance and Use of Technology (UTAUT) model, (Venkatesh et al., 2003). This model's application for information systems research in the governmental context has a weak expression and is unique in EDMS research. This empirical research follows a realist and positivist approach. Data was collected from a survey answered by 2,175 employees of Portuguese municipalities (EDMS users). Partial Least Squares (PLS) was used to test the model proposed. The results showed that Intention to Use is positively affected by Performance Expectancy, Effort Expectancy, Social Influence and Facilitating Conditions. With respect to the EDMS Use, the results showed that it is positively influenced by Intention to Use and Facilitating Conditions. The main result indicates that EDMS users believe that the use of this information system will help them to obtain performance benefits in their work. However, the increasing use of EDMS is not very influenced by the system's perceived ease of use. In short, this study provides a contribution to the Information Systems Acceptance and Adoption literature in local eGovernmental contexts. In addition, our contribution empirically tests the model for implementation in governmental organizations and provides a better understanding of the adoption and use of an EDM

The CIO role expectations instrument: validation and model testing

The validation of IS instruments has not been given the attention that it deserves. This study uses component-based structural equation modelling (PLS/SEM) to investigate the psychometric properties and possible modelling of the CIO role expectations instrument based on data obtained from 174 Australian CIOs. Results show that the CIO role expectation instrument has exhibited solid validity and reliability indices despite some minor weaknesses. The results also demonstrate the possibility to model the constructs of this instrument in different null and hierarchical models, and the validity of this instrument to measure the CIO role in different types of industries not just the healthcare sector in which it was developed. The results provide support for CIO role theory on two central issues: (1) CIOs are fulfilling a configuration of roles not just one specific role (2) the CIO roles can be grouped into two major categories: supply side roles and demand side roles

Investigating Broadband Diffusion in the Household: Towards Content Validity and Pre-Test of the Survey Instrument

Studies on broadband diffusion are just beginning to emerge and exploratory in nature. Progress has been made to develop conceptual models to understand diffusion and adoption of broadband from the consumer perspective. However in order to test the conceptual model of broadband diffusion, a reliable survey instrument is yet to be developed and validated. Therefore, the aim of this research in progress paper is to perform content validity and pre-test a survey instrument. The objectives of this paper are: first, to ‘ identify’ constructs and their respective items that adequately cover relevant dimensions of factors that affects consumers in the domain of broadband diffusion; second, to ‘determine’ whether the identified constructs and respective items sufficiently cover relevant dimensions of the factors affecting consumers in the domain of broadband diffusion; and third, to conduct a ‘ pre-test’ on resulting survey instruments in order to obtain feedback for improvements before finalising the questionnaire. Initial items for each construct were identified from both technology adoption literature and exploratory studies on broadband adoption. Validation of the identified items was then performed employing variations of a quantitative approach to content validity. The findings obtained from content validation are then presented and discussed thereafter. Finally, the paper is concluded by emphasising the limitations of content validation and setting the future research direction towards investigating broadband diffusion in the household context

EDMS Use in Local E-Government: Extent of Use and Overall Performance Mediated by Routinization and Infusion

This study analyzes the effects of several post-adoption behaviors (extent of use, routinization and infusion) on overall performance in using an Electronic Document Management System (EDMS). Furthermore, we test whether the routinization and infusion variables mediate the influence of the extent of use on overall performance. This research collects data from a survey answered by 2,175 employees (EDMS users) of Portuguese municipalities. The Partial Least Squares technique is applied to test the model. The results showed that routinization is directly predicted by the extent of use, whereas infusion is directly affected by the extent of use and also by routinization. Consequently, such post-adoptive behaviors are interrelated not only in a sequential process, but also in parallel. In addition, overall performance is directly influenced by routinization and infusion. Finally, an indirect effects analysis shows that routinization and infusion mediate the relationship between extent of use and overall performance

The Influence of Sponsor-Event Congruence in Sponsorship of Music Festivals

This paper focuses the research on the Influence of Sponsor-Event Congruence toward Brand Image, Attitudes toward the Brand and Purchase Intention. Having reviewed the literatures and arranged the hypotheses, the data has been gathered by distributing the questionnaire to 155 audiences at the Java Jazz Music Festival, firstly with convenience sampling and then snowballing sampling approach. The analysis of data was executed with Structural Equation Modeling (SEM). The result shows the sponsor-event congruence variable has a positive impact toward brand image and attitudes toward the brand sponsor. Brand Image also has a positive impact toward purchase intention; in contrary attitudes toward the brand do not have a positive purchase intention. With those results, to increase the sponsorship effectiveness, the role of congruency is very significant in the sponsorship event. Congruency is a key influencer to trigger the sponsorship effectiveness. Congruency between the event and the sponsor is able to boost up the brand image and bring out favorable attitudes towards the brand for the success of marketing communication programs, particularly sponsorship. In addition to it, image transfer gets higher due to the congruency existence (fit) between sponsor and event and directs the intention creation to buy sponsor brand product/service (purchase intention). In conclusion, sponsor-event congruence has effect on consumer responds toward sponsorship, either on the cognitive level, affective and also behavior

An IS Scholar and Scholarship Ranking Based on Contributions to Doctoral Education

This research introduces a new information systems (IS) scholar and scholarly work ranking based on contributions to IS doctoral education. We examine syllabi of introductory PhD seminars offered across North America to identify and rank scholars and scholarly works most often called on in shaping future scholar’s minds and careers. These rankings can also be used, along with available IS scholar ranking, to better recognize active and influential scholars in the IS field

IT DYNAMIC CAPABILITY DEVELOPMENT IN THE CONTEXT OF DATA GENESIS CAPABILITY

Dynamic Capabilities are often considered as the factor justifying the different degrees of success of organizations in turbulent environment. However Dynamic Capability development remains a difficult issue to research, with a paucity of work directly addressing this question, despite its importance. The explanation of the development of Dynamic Capabilities would give organizations the instruments to rationally improve their chance of success and to more likely sustain their competitive advantage. We contribute to the emerging literature on Information Technology (IT) Dynamic Capability development by proposing a research framework grounded in the three sources of Dynamic Capabilities: organizational processes, firm history and firm's assets. Our model takes into consideration also the moderating role played by environmental turbulence on Dynamic Capability development and on process performance. In this contribution we lay the theoretical and methodological groundwork and we foresee the test of the model using Data Genesis (DG) capability as the context. DG is the Dynamic Capability of (1) choosing IT to generate and capture data in digital form, (2) integrating the technology in the appropriate business processes, and (3) managing the digital data so produced.IT capability; Dynamic Capability; capability development; Data Genesis

A Practical Guide To Factorial Validity Using PLS-Graph: Tutorial And Annotated Example

This tutorial explains in detail what factorial validity is and how to run its various aspects in PLS. The tutorial is written as a teaching aid for doctoral seminars that may cover PLS and for researchers interested in learning PLS. An annotated example with data is provided as an additional tool to assist the reader in reconstructing the detailed example