Methods and resources to monitor internet censorship

PURPOSE : The purpose of this paper is to raise awareness of the importance for library and information services (LIS) to take the responsibility to find a manageable way to regularly monitor internet censorship in their countries, and to suggest a framework for such monitoring and to encourage manageable on-going small scale research projects. DESIGN/METHODOLOGY/APPROACH : The paper follows on contract research for the IFLA Committee on Freedom of Access to Information and Freedom of Expression on country specific trends in internet censorship. Based on an extensive literature survey (not fully reflected here) and data mining, a framework is suggested for regular monitoring of country specific negative and positive trends in internet censorship. The framework addresses search strategies and information resources; setting up alerting services; noting resources for data mining; a detailed break-down and systematic monitoring of negative and positive trends; the need for reflection on implications, assessment of need(s) for concern (or not) and generation of suggestions for actions; sharing findings with the LIS community and wider society; and raising sensitivity for internet censorship as well as advocacy and lobbying against internet censorship. Apart from monitoring internet censorship, the framework is intended to encourage manageable on-going small scale research. FINDINGS : A framework of internet censorship monitoring can support the regular, systematic and comprehensive monitoring of known as well as emerging negative and positive trends in a country, and can promote timely expressions of concerns and appropriate actions by LIS. It can support sensitivity to the dangers of internet censorship and raise LIS’ levels of self-efficacy in dealing with internet censorship and doing manageable, small scale research in this regard. ORIGINALITY/VALUE : Although a number of publications have appeared on internet censorship these do not offer a framework for monitoring internet censorship and encouraging manageable on-going small scale research in this regard.http://www.emeraldinsight.com/0737-8831.htmhttp://www.emeraldinsight.com/loi/lhthj201

FilteredWeb: A Framework for the Automated Search-Based Discovery of Blocked URLs

Various methods have been proposed for creating and maintaining lists of potentially filtered URLs to allow for measurement of ongoing internet censorship around the world. Whilst testing a known resource for evidence of filtering can be relatively simple, given appropriate vantage points, discovering previously unknown filtered web resources remains an open challenge. We present a new framework for automating the process of discovering filtered resources through the use of adaptive queries to well-known search engines. Our system applies information retrieval algorithms to isolate characteristic linguistic patterns in known filtered web pages; these are then used as the basis for web search queries. The results of these queries are then checked for evidence of filtering, and newly discovered filtered resources are fed back into the system to detect further filtered content. Our implementation of this framework, applied to China as a case study, shows that this approach is demonstrably effective at detecting significant numbers of previously unknown filtered web pages, making a significant contribution to the ongoing detection of internet filtering as it develops. Our tool is currently deployed and has been used to discover 1355 domains that are poisoned within China as of Feb 2017 - 30 times more than are contained in the most widely-used public filter list. Of these, 759 are outside of the Alexa Top 1000 domains list, demonstrating the capability of this framework to find more obscure filtered content. Further, our initial analysis of filtered URLs, and the search terms that were used to discover them, gives further insight into the nature of the content currently being blocked in China.Comment: To appear in "Network Traffic Measurement and Analysis Conference 2017" (TMA2017

Automated Discovery of Internet Censorship by Web Crawling

Censorship of the Internet is widespread around the world. As access to the web becomes increasingly ubiquitous, filtering of this resource becomes more pervasive. Transparency about specific content that citizens are denied access to is atypical. To counter this, numerous techniques for maintaining URL filter lists have been proposed by various individuals and organisations that aim to empirical data on censorship for benefit of the public and wider censorship research community. We present a new approach for discovering filtered domains in different countries. This method is fully automated and requires no human interaction. The system uses web crawling techniques to traverse between filtered sites and implements a robust method for determining if a domain is filtered. We demonstrate the effectiveness of the approach by running experiments to search for filtered content in four different censorship regimes. Our results show that we perform better than the current state of the art and have built domain filter lists an order of magnitude larger than the most widely available public lists as of Jan 2018. Further, we build a dataset mapping the interlinking nature of blocked content between domains and exhibit the tightly networked nature of censored web resources

Promoting global Internet freedom: policy and technology

This report provides information about US government and private sector efforts to promote and support global Internet freedom and a description of Internet freedom legislation and hearings from the 112th Congress. Modern communication tools such as the Internet provide a relatively inexpensive, accessible, easy-entry means of sharing ideas, information, and pictures around the world. In a political and human rights context, in closed societies when the more established, formal news media is denied access to or does not report on specified news events, the Internet has become an alternative source of media, and sometimes a means to organize politically. The openness and the freedom of expression allowed through social networking sites, as well as the blogs, video sharing sites, and other tools of today’s communications technology, have proven to be an unprecedented and often disruptive force in some closed societies. Governments that seek to maintain their authority and control the ideas and information their citizens receive are often caught in a dilemma: they feel that they need access to the Internet to participate in commerce in the global market and for economic growth and technological development, but fear that allowing open access to the Internet potentially weakens their control over their citizens. Internet freedom can be promoted in two ways, through legislation that mandates or prohibits certain activities, or through industry self regulation. Current legislation under consideration by Congress, the Global Online Freedom Act of 2011 (H.R. 3605), would prohibit or require reporting of the sale of Internet technologies and provision of Internet services to “Internetrestricting countries” (as determined by the State Department). Some believe, however, that technology can offer a complementary and, in some cases, better and more easily implemented solution to ensuring Internet freedom. They argue that hardware and Internet services, in and of themselves, are neutral elements of the Internet; it is how they are implemented by various countries that is repressive. Also, Internet services are often tailored for deployment to specific countries; however, such tailoring is done to bring the company in line with the laws of that country, not with the intention of allowing the country to repress and censor its citizenry. In many cases, that tailoring would not raise many questions about free speech and political repression. This report provides information about federal and private sector efforts to promote and support global Internet freedom and a description of Internet freedom legislation and hearings from the 112th Congress. Three appendixes suggest further reading on this topic and describe censorship and circumvention technologies

Measuring internet activity: a (selective) review of methods and metrics

Two Decades after the birth of the World Wide Web, more than two billion people around the world are Internet users. The digital landscape is littered with hints that the affordances of digital communications are being leveraged to transform life in profound and important ways. The reach and influence of digitally mediated activity grow by the day and touch upon all aspects of life, from health, education, and commerce to religion and governance. This trend demands that we seek answers to the biggest questions about how digitally mediated communication changes society and the role of different policies in helping or hindering the beneficial aspects of these changes. Yet despite the profusion of data the digital age has brought upon us—we now have access to a flood of information about the movements, relationships, purchasing decisions, interests, and intimate thoughts of people around the world—the distance between the great questions of the digital age and our understanding of the impact of digital communications on society remains large. A number of ongoing policy questions have emerged that beg for better empirical data and analyses upon which to base wider and more insightful perspectives on the mechanics of social, economic, and political life online. This paper seeks to describe the conceptual and practical impediments to measuring and understanding digital activity and highlights a sample of the many efforts to fill the gap between our incomplete understanding of digital life and the formidable policy questions related to developing a vibrant and healthy Internet that serves the public interest and contributes to human wellbeing. Our primary focus is on efforts to measure Internet activity, as we believe obtaining robust, accurate data is a necessary and valuable first step that will lead us closer to answering the vitally important questions of the digital realm. Even this step is challenging: the Internet is difficult to measure and monitor, and there is no simple aggregate measure of Internet activity—no GDP, no HDI. In the following section we present a framework for assessing efforts to document digital activity. The next three sections offer a summary and description of many of the ongoing projects that document digital activity, with two final sections devoted to discussion and conclusions

Planning for the Future of Cyber Attack Attribution : Hearing Before the H. Subcomm. on Technology and Innovation of the H. Comm. on Science and Technology, 111th Cong., July 15, 2010 (Statement by Adjunct Professor Marc Rotenberg, Geo. U. L. Center)

Steve Bellovin, another security expert, noted recently that one of risks of the new White House plan for cyber security is that it places too much emphasis on attribution. As Dr. Bellovin explains: The fundamental premise of the proposed strategy is that our serious Internet security problems are due to lack of sufficient authentication. That is demonstrably false. The biggest problem was and is buggy code. All the authentication in the world won\u27t stop a bad guy who goes around the authentication system, either by finding bugs exploitable before authentication is performed, finding bugs in the authentication system itself, or by hijacking your system and abusing the authenticated connection set up by the legitimate user. While I believe the White House, the Cyber Security Advisor, and the various participants in the drafting process have made an important effort to address privacy and security interests, I share Professor Bellovin’s concern that too much emphasis has been placed on promoting identification. I also believe that online identification, promoted by government, will be used for purposes unrelated to cyber security and could ultimately chill political speech and limit the growth of the Internet. Greater public participation in the development of this policy as well as a formal rulemaking on the White House proposal could help address these concerns

Net Neutrality as Global Principle for Internet Governance

This paper discusses the concept of network neutrality (NN) and explores its relevance to global Internet governance. The paper identifies three distinct ways in which the concept of network neutrality might attain a status as a globally applicable principle for Internet governance. The paper concludes that the concept of a "neutral" Internet has global applicability in a variety of contexts relevant to Internet governance

Asian Government Usage of Web 2.0 Social Media

The rise of Web 2.0 social sites, such as Facebook, Twitter and YouTube has brought significant changes and opportunities for both online consumers and governments. These tools have changed the ways Internet users communicate with each other and their governments, and allow for greater social participation. The number of worldwide users is growing significantly and their expectations for more services are rising. However, this has not translated into Asian governments totally encompassing the implementation functions and services using these tools. This research investigates the level of government participation of 50 Asian governments of three social media sites. The results show that a minority of Asian governments (approximately 30 percent) are using Web 2.0 tools for communication and information dissemination. The study found that if social sites were utilised, most governments used them for a) information dissemination on official government channels, b) education and c) tourism. The implications are that governments are missing opportunities to better server their citizens and reach the growing number of Internet users. Instead of avoiding these new technologies, governments should develop an overall strategic plan for all agency levels to participate in social networks, and develop a coordinated effort to develop and implement the tools

Unshackle the Internet: Independent Voices and the Role of Foreign Internet Companies Operating in China

Advances in information technology have the potential to empower individuals globally and to serve as a force for democratization. The number of Internet users in mainland China continues to increase at a phenomenal rate. From 1998 to 2005, China's online population grew from 1.17 million to 103 million, with the most recent official count in January 2006 at approximately 110 million.In China, the Internet has become an increasingly important tool for empowering Chinese activists, journalists, rights defenders, intellectuals and grassroots groups by providing increased access to information as well as a virtual commons for the exchange of ideas between groups and individuals.However, technology and control of the Internet have also been utilized by the Chinese government to implement censorship, surveillance and social and political control.In the last several months, as foreign IT companies have come under media and U.S. government scrutiny, HRIC has been actively monitoring the human rights impact of their activities and developing suggestions for implementing the human rights responsibilities of foreign-based IT companies operating in China