WITBragDay Tweet Ids

This dataset contains the tweet ids of 52,457 tweets related to the #WITBragDay hashtag. They were collected between August 12 and August 18, 2017 from the Twitter APIs using Social Feed Manager. These tweets were collected using the POST statuses/filter method of the Twitter Stream API and the GET statuses/search Twitter REST API. There is a README.txt file containing additional documentation on how it was collected. For all collecting, the query was on the term WITBragDay (without the hashtag symbol). The GET statuses/lookup method supports retrieving the complete tweet for a tweet id (known as hydrating). Tools such as Twarc or Hydrator can be used to hydrate tweets. When hydrating be aware that: Twitter limits hydration to 900 requests of 100 tweet ids per 15 minute window per set of user credentials. The Twitter API will not return tweets that have been deleted or belong to accounts that have been suspended, deleted, or made private. You should expect a large number of these tweets to be unavailable. For tweets collected from the Twitter filter stream, this is not a complete set of tweets that match the filter. Gaps may exist because: Twitter limits the number of tweets returned by the filter at any point in time. Social Feed Manager stops and starts the Twitter filter stream every 30 minutes. In Social Feed Manager, collecting is turned off while a user is making changes to the collection criteria. There were some operational issues, e.g., network interruptions, during the collection period. Per Twitter’s Developer Policy, tweet ids may be publicly shared; tweets may not. Questions about this dataset can be sent to [email protected]. George Washington University researchers should contact us for access to the tweets

Hurricane Florence

This dataset contains the tweet ids of approximately 7,766,964 tweets related to Hurricane Florence. They were collected between September 10, 2018 and October 4, 2018 from the POST statuses/filter method of the Twitter Stream API using Social Feed Manager. There is a README.txt file containing additional documentation on how it was collected, including the keywords used and when. Keywords used at various points in this collection include florence and hurricaneflorence. The GET statuses/lookup method supports retrieving the complete tweet for a tweet id (known as hydrating). Tools such as Twarc or Hydrator can be used to hydrate tweets. Per Twitter’s Developer Policy, tweet ids may be publicly shared for academic purposes; tweets may not. Questions about this dataset can be sent to [email protected]. George Washington University researchers should contact us for access to the tweets.</p

Climate Change Tweets Ids

This dataset contains the tweet ids of 39,622,026 tweets related to climate change. They were collected between September 21, 2017 and May 17, 2019 from the Twitter API using Social Feed Manager. There is a gap in data collection between January 7, 2019 and April 17, 2019. Tweets were collected using the POST statuses/filter method of the Twitter Stream API, using the track parameter with the following keywords: #climatechange, #climatechangeisreal, #actonclimate, #globalwarming, #climatechangehoax, #climatedeniers, #climatechangeisfalse, #globalwarminghoax, #climatechangenotreal, climate change, global warming, climate hoax Because of the size of the collection, the list of identifiers is split into files of 10 million lines each, with a tweet identifier on each line. There is a README.txt file containing additional documentation on how the tweets were collected. The GET statuses/lookup method supports retrieving the complete tweet for a tweet id (known as hydrating). Tools such as Twarc or Hydrator can be used to hydrate tweets. Per Twitter’s Developer Policy, tweet ids may be publicly shared for academic purposes; tweets may not. Questions about this dataset can be sent to [email protected]. George Washington University researchers should contact us for access to the tweets.</p

Experiences from the Field: Choosing a Discovery Tool for YOUR Unique Library

Our users want an easier way to search library resources; currently, there are many discovery tools available, which can seem daunting. How do you know which one will work for your unique library? Librarians from different types of libraries—an online library, a land-grant school, a law library, a private university, and a consortium—describe how they evaluated the available products and made decisions on which tools to implement. A variety of platforms are discussed, including: Ebsco’s Discovery Service, III’s Encore Synergy Discovery, Serials Solutions’ Summon, and even a homegrown solution. Discover what libraries are looking for in these tools, strategies for determining which one best fits your needs, and lessons learned throughout the process from the investigation phase to implementation

2016 United States Presidential Election Tweet Ids

This dataset contains the tweet ids of approximately 280 million tweets related to the 2016 United States presidential election. They were collected between July 13, 2016 and November 10, 2016 from the Twitter API using Social Feed Manager. These tweet ids are broken up into 12 collections. Each collection was collected either from the GET statuses/user_timeline method of the Twitter REST API or the POST statuses/filter method of the Twitter Stream API. The collections are: Candidates and key election hashtags (Twitter filter): election-filter[1-6].txt Democratic candidates (Twitter user timeline): democratic-candidate-timelines.txt Democratic Convention (Twitter filter): democratic-convention-filter.txt Democratic Party (Twitter user timeline): democratic-party-timelines.txt Election Day (Twitter filter): election-day.txt First presidential debate (Twitter filter): first-debate.txt GOP Convention (Twitter filter): republican-convention-filter.txt Republican candidates (Twitter user timeline): republican-candidate-timelines.txt Republican Party (Twitter user timeline): republican-party-timelines.txt Second presidential debate (Twitter filter): second-debate.txt Third presidential debate (Twitter filter): third-debate.txt Vice Presidential debate (Twitter filter): vp-debate.txt There is also a README.txt file for each collection containing additional documentation on how it was collected. The GET statuses/lookup method supports retrieving the complete tweet for a tweet id (known as hydrating). Tools such as Twarc or Hydrator can be used to hydrate tweets. When hydrating be aware that: Twitter limits hydration to 900 requests of 100 tweet ids per 15 minute window per set of user credentials. This works out to 8,640,000 tweets per day, so hydrating this entire dataset will take 32 days. The Twitter API will not return tweets that have been deleted or belong to accounts that have been suspended, deleted, or made private. You should expect a large number of these tweets to be unavailable. There may be duplicate tweets across collections. Also, according to the Twitter documentation, duplicate tweets are possible for tweets collected from the Twitter filter stream. For tweets collected from the Twitter filter stream, this is not a complete set of tweets that match the filter. Gaps may exist because: Twitter limits the number of tweets returned by the filter at any point in time. Social Feed Manager stops and starts the Twitter filter stream every 30 minutes. In Social Feed Manager, collecting is turned off while a user is making changes to the collection criteria. There were some operational issues, e.g., network interruptions, during the collection period. Since some of the terms used to collect from the Twitter filter stream were broad (e.g., “election”), it may contain tweets from elections other than the U.S. presidential election, including state elections, local elections, or elections in other countries. Per Twitter’s Developer Policy, tweet ids may be publicly shared; tweets may not. Questions about this dataset can be sent to [email protected]. George Washington University researchers should contact us for access to the tweets. This work is supported by grant #NARDI-14-50017-14 from the National Historical Publications and Records Commission.</p

U.S. Government Tweet Ids

This dataset contains the tweet ids of 9,673,959 tweets for approximately 3400 U.S. government accounts. These are accounts that are associated with federal government agencies, not individuals. They were collected between January 20, 2017 and July 20, 2018 from the GET statuses/user_timeline method of the Twitter API using Social Feed Manager. There is a README.txt file containing additional documentation on how this dataset was collected. There is also an accounts.csv file listing the Twitter accounts that were collected. Note that accounts have been added and deleted during the collection period. This may contain tweets from accounts that were erroneously collected (e.g., accounts of government officials or accounts that were previously government accounts but since taken over by non-government users). The GET statuses/lookup method supports retrieving the complete tweet for a tweet id (known as hydrating). Tools such as Twarc or Hydrator can be used to hydrate tweets. Per Twitter’s Developer Policy, tweet ids may be publicly shared for academic purposes; tweets may not. We intend to update this dataset periodically. Questions about this dataset can be sent to [email protected]. George Washington University researchers should contact us for access to the tweets.</p

gwu-libraries/sfm-elk: Version 1.9.0

Significant changes in this release: Upgraded to latest version of ELK. Switched to use official Elasticsearch containers