PDF of a powerpoint presentation from an Old Dominion University Electrical & Computer Engineering (ECE) Department Colloquium, November 13, 2015. Also available on Slideshare.https://digitalcommons.odu.edu/computerscience_presentations/1007/thumbnail.jp

AlNoamany, Yasmin

Nelson, Michael L.

Weigle, Michele C.

English

Old Dominion University

Old Dominion UniversityODU Digital CommonsComputer Science Presentations Computer Science11-13-2015Combining Storytelling and Web ArchivesYasmin AlNoamanyOld Dominion UniversityMichele C. WeigleOld Dominion University, mweigle@odu.eduMichael L. NelsonOld Dominion University, mnelson@odu.eduFollow this and additional works at: https://digitalcommons.odu.edu/computerscience_presentationsPart of the Archival Science CommonsThis Book is brought to you for free and open access by the Computer Science at ODU Digital Commons. It has been accepted for inclusion inComputer Science Presentations by an authorized administrator of ODU Digital Commons. For more information, please contactdigitalcommons@odu.edu.Recommended CitationAlNoamany, Yasmin; Weigle, Michele C.; and Nelson, Michael L., "Combining Storytelling and Web Archives" (2015). ComputerScience Presentations. 5.https://digitalcommons.odu.edu/computerscience_presentations/5Combining Storytelling and Web ArchivesYasmin AlNoamanyMichele C. WeigleMichael L. NelsonOld Dominion UniversityWeb Science and Digital Libraries Group ws-dl.cs.odu.edu@WebSciDLThis work is supported in part by IMLS LG-71-15-0077Old Dominion University ECE Department Colloquium2015-11-13IMLS-Funded Research1. Use small “stories” to summarize much larger collections of archived web pages– big  small2. Generate web archive collections by mining user-generated stories for seed URIs • small  bighttp://ws-dl.blogspot.com/2015/10/2015-10-07-imls-and-nsf-fund-web.htmlThe Web is important for our cultural heritage.How to preserve the Web??!!!3What are web archives?20022005200920114Memento: an archived snapshot as it appeared in the past20022005200920115What are some web archives?• The entire web• On-demand free services• National libraries• Theme-based collections6For more information: https://en.wikipedia.org/wiki/Web_archivinghttp://mementoweb.org/Archive-It, a subscription-based service, hosts curated web collections7> 3,000 collections~340 institutions> 10B archived pages8Collection titleCollection categorization based on the curatorSeed URIMetadata about the collectionText search boxThe group that the resource belongs toList of the seed URIsTimespan of the resourceand the number of times it has been captured What is the problem with the archived collections?9There is more than one collection about “Egyptian Revolution”10• “2010-2011 Arab Spring” https://archive-it.org/collections/3101• “North Africa & the Middle East 2011-2013” https://archive-it.org/collections/2349• “Egypt Revolution and Politics”  https://archive-it.org/collections/2358Collection understanding and collection summarization are not supported currentlyNot easy to answer “what’s in that collection?”11Our Early Attempts at Collection Understanding Tried To Include Everything…15http://ws-dl.blogspot.com/2012/08/2012-08-10-ms-thesis-visualizing.htmlTimelinesTreemapsTreemaps(1000s of Seeds X 1000s of Mementos) + Dimension of Time == Conventional Viz Methods Not Applicable19Idea: Storytelling20Stories in LiteratureStory elements:  setting, characters, sequence, exposition, conflict, climax, resolution21Once upon a timehttp://www.learner.org/interactives/story/Stories in social media22“It's hard to define a story, but I know it when I see it” (Alexander, 2008)A loose context of the conventional definition in Literature “storytelling” is becoming a popular technique in social media 23There is interest in choosing k items from Nwhere k << N24I have 1000s of posts, images, friends’ posts, etc. in Facebook25Facebook reduces this to 1 minute video (Facebook Look Back)• https://www.youtube.com/watch?v=AWoBAjovHT426Interest from Twitter in storytelling271 Second Everyday28What are the limitations of storytelling services?2930The Egyptian Revolution on Storify31Bookmarking, not preserving! Social media can go off-topic or disappear32A year after publication, about 11% of content shared on social media will be gone (SalahEldeen, 2012)** SalahEldeen, H.M., Nelson, M.L.: Losing my revolution: How many resources shared on social media have been lost? TPDL’12.Despite these limitations, how do we combine storytelling & archives?33We sample k mementos from N pages of the collection to create a summary storyS1S2S3S4S2S1S3Collection YS3S2S1Collection ZCollection XUse interface people already know how to use to summarize collections35Archived collectionsStorytelling servicesArchived enriched storiesResearch QuestionCan we (semi-)automatically identify, evaluate, and select candidate archived web pages from archived collections for generating stories that summarize the collection?36The archived collection has two dimensions37TimeURIThe Two Dimensions Applied to StoriesFixed Page – Fixed Time: differences in GeoIP, mobile, etc. (Kelly, 2013)Fixed Page – Sliding Time: evolution of a single page (or domain) through timeSliding Page – Fixed Time: different perspectives on a point in timeSliding Page – Sliding Time: broadest possible coverageof a collection38sameTimedifferentURIsamedifferentFixed Pages, Fixed TimeR1R1R1R1t1 t3t2 t5t4 t639Fixed Page, Fixed Time40A desktop Chrome user-agenthttp://www.cnn.com/2014/02/24/world/africa/egypt-politics/index.html?hpt=wo_c2Andriod Chrome user-agenthttp://www.cnn.com/2014/02/24/world/africa/egypt-politics/index.html?hpt=wo_c2Richard Schneider and Frank McCown, “First Steps in Archiving the Mobile Web: Automated Discovery of Mobile Websites”, JCDL 2013. Fixed Page, Sliding TimeR R R R R Rt1 t3t2 t5t4 t641Feb 1 Feb 1 Feb 2Feb 4 Feb 5 Feb 7Feb 9 Feb 11Feb 11Sliding Page, Fixed TimeR1R2R3R4t1 t3t2 t5t4 t643Feb. 11, 2011Mubarak resigns44Sliding Page, Sliding TimeR1R2R1R3R4R2t1 t3t2 t5t4 t645Jan 27 Jan 31Feb 7Feb 4Feb 11 Feb 11Feb 2Jan 25Feb 10Handcrafted Stories in Storify47Sliding Page, Sliding TimeSliding Page, Fixed Timehttp://storify.com/yasmina_anwar/the-egyptian-revolution-on-archive-it-collection http://storify.com/yasmina_anwar/the-egyptian-revolution-story-from-archive-it-heteOther Interfaces Possible…48Replaying Story of Egyptian Revolutionhttp://www.dipity.com/YasminAlnoamany/Jan-25-Egyptian-Revolution/Yasmin’s Research Status1. Establishing a baselinea. For archived collections (Visualizing Digital Collections at Archive-It, JCDL 2012)b. For human stories (Characteristics of Social Media Stories, TPDL 2015)2. Calculate the aboutness of the collections3. Find off-topic URIs (Detecting Off-Topic Pages in Web Archives, TPDL 2015)4. Identify the best k mementos that summarize the collection for desired story type5. Evaluate & visualize the generated stories49What about using stories to seed web archive collections?50Creating collections is hard.  Requires combination of awareness, domain knowledge, crowdsourcing, etc.51Ukrainian Themed Collections, Prior to February 2014Ukrainian Conflict Collection Started February 2014Crowdsourcing Collection of Seed URIsWhat about social media, especially curated social media?55https://storify.com/TheInkBee/riots-persist-in-kyiv(late January, 2014)https://storify.com/jesseoriordan/ukraine-fight-for-their-rights(late January, 2014)https://storify.com/jesseoriordan/ukraine-fight-for-their-rights(late January, 2014)Compelling narratives are created by knowledgeable (and biased) users arranging news stories, images, social media, commentary, etc.Intuitively, this is a “good story”. How do we quantify this?Characteristics of Social Media StoriesYasmin AlNoamany, Michele C. Weigle, and Michael L. NelsonOld Dominion UniversityWeb Science and Digital Libraries Group http://ws-dl.cs.odu.edu/, @WebSciDL59TPDL 201516.09.2015, Poznań, Polandhttp://www.cs.odu.edu/~mln/pubs/tpdl-2015/tpdl-2015-stories.pdf“Storytelling” is becoming a popular technique in social media 60Story creation interface on Storify61Research Question62We’d like to automatically generate stories, but we don’t yet know what constitutes a “good” story.Q: What are the structural characteristics of popular (i.e., receiving the most views) human-generated stories?What is the length of a story(the number of resources per story)?• This story has 31 resources63132What are the types of resources that compose a story?• This story has     – 19 quotes– 8 images– 4 videos64Quotes VideoWhat are the most frequently used domains? • 90% twitter.com• 7% instagram.com • 3% facebook.com65Twitter.comTwitter.comTwitter.comThe popularity of the most used domains in the stories66mr_sedivy.tripod.com is ranked 3,084,064 by Alexa global rank Twitter.com is ranked 9 by Alexa global rank What is the timespan (editing time) of the stories? • This story covers ~4 hours (from 3:12 PM – 7:27 PM)• Is there a relation between the timespan and the features of the story? 67http://storify.com/yahoonews/boston-marathon-bombingWhat is the “HTTP 404” rate of the resources?6868Can we find these missing resources in the archives?69http://www.nzherald.co.nz/world/news/article.cfm?c_id=2&objectid=10705523What differentiates apopular story? 7019,795 views 64 viewsData set construction1. Queried Storify Search API with the top 1000 English keywords as seen by Yahoo2. Downloaded 145,682 stories in JSON on Feb. 20153. Considered stories authored in 2014 or earlier, resulting in 37,486 stories4. Eliminated stories with only zero or one elements or zero views, resulting in:a. 14,568 unique storiesb. 10,199 unique usersc. 1,251,160 web and text elements71Characteristics of human-generated storiesFeatures Views Web elements Text elements Subscribers Timespan in hours25th percentile 14 10 0 0 0.1850th percentile 51 23 1 4 375th percentile 268 69 9 21 12090th percentile 1949 210 19 85 1747Maximum 11,284,896 2,216 559 1,726,143 36,11172Characteristics of human-generated storiesFeatures Views Web elements Text elements Subscribers Timespan in hours25th percentile 14 10 0 0 0.1850th percentile 51 23 1 4 375th percentile 268 69 9 21 12090th percentile 1949 210 19 85 1747Maximum 11,284,896 2,216 559 1,726,143 36,1117344 % of the stories have no text elements at allWhat is the Average Timespan for Stories? 74What is the Average Timespan for Stories? Intervals Percentage Median web elementsMedian text elementsMedian views(normalized by time)0-60 seconds 14.0% 15 0 231-60 minutes 26.7% 19 0 531-24 hours 23.4% 25 5 1101-7 days 13.5% 26 7 781-4 weeks 8.4% 26 9 801-12 months 10.9% 38 2 1291-4 years 3.1% 56 15 15675There is nearly linear relation between the time length of the story and the number of elementsWhat is the Average Timespan for Stories? 76The story with the longest timespan in our data set covers more than 4 years and with more than 13,000 views. It had only 33 web elements and 51 total elements. Intervals Percentage Median web elementsMedian text elementsMedian views(normalized by time)0-60 seconds 14.0% 15 0 231-60 minutes 26.7% 19 0 531-24 hours 23.4% 25 5 1101-7 days 13.5% 26 7 781-4 weeks 8.4% 26 9 801-12 months 10.9% 38 2 1291-4 years 3.1% 56 15 156The distribution of the elements (1,251,160) Resource Proportionlinks 70.8%images 18.4%text 8.1%video 2.0%quotes 0.7%77Text elements are relatively rare, meaning that few users choose to annotate the web elements in their story. What are the most frequently used domains? 78The most frequent domains in the stories• Domain Canonicalization– www.cnn.com  cnn.com• Dereference all the shortened URIs– For example: t.co, bit.ly• 25,947 unique domains 79The most frequent domains in the stories represent ~92% Host Frequency Percentage Alexa Global Rank as of 2015-03Categorytwitter.com 943,859 82.05% 8 Social mediainstagram.com 45,188 3.93% 25 Photosyoutube.com 22,076 1.92% 3 Videosfacebook.com 13,930 1.21% 2 Social mediaflickr.com 7,317 0.64% 126 Photospatch.com 5,783 0.50% 2,096 Newsplus.google.com 3,413 0.30% 1 Social mediatumblr.com 3,066 0.27% 31 Blogsblogspot.com 1,857 0.16% 18 Blogsimgur.com 1,756 0.15% 36 Photoscoolpile.com 1,706 0.15% 149,281 Entertainmentwordpress.com 1,615 0.14% 33 Blogsgiphy.com 1,055 0.09% 1,604 Photosbbc.com 966 0.08% 156 Newslastampa.it 927 0.08% 2,440 Newspinterest.com 892 0.08% 32 Photossoftandapps.info 861 0.07% 160,980 Newsphotobucket.com 768 0.07% 341 Photosnytimes.com 744 0.06% 97 Newssoundcloud.com 736 0.06% 167 Audio80The most frequent domains in the stories represent ~92% Host Frequency Percentage Alexa Global Rank as of 2015-03Categorytwitter.com 943,859 82.05% 8 Social mediainstagram.com 45,188 3.93% 25 Photosyoutube.com 22,076 1.92% 3 Videosfacebook.com 13,930 1.21% 2 Social mediaflickr.com 7,317 0.64% 126 Photospatch.com 5,783 0.50% 2,096 Newsplus.google.com 3,413 0.30% 1 Social mediatumblr.com 3,066 0.27% 31 Blogsblogspot.com 1,857 0.16% 18 Blogsimgur.com 1,756 0.15% 36 Photoscoolpile.com 1,706 0.15% 149,281 Entertainmentwordpress.com 1,615 0.14% 33 Blogsgiphy.com 1,055 0.09% 1,604 Photosbbc.com 966 0.08% 156 Newslastampa.it 927 0.08% 2,440 Newspinterest.com 892 0.08% 32 Photossoftandapps.info 861 0.07% 160,980 Newsphotobucket.com 768 0.07% 341 Photosnytimes.com 744 0.06% 97 Newssoundcloud.com 736 0.06% 167 Audio81The most frequent domains in the stories represent ~92% Host Frequency Percentage Alexa Global Rank as of 2015-03Categorytwitter.com 943,859 82.05% 8 Social mediainstagram.com 45,188 3.93% 25 Photosyoutube.com 22,076 1.92% 3 Videosfacebook.com 13,930 1.21% 2 Social mediaflickr.com 7,317 0.64% 126 Photospatch.com 5,783 0.50% 2,096 Newsplus.google.com 3,413 0.30% 1 Social mediatumblr.com 3,066 0.27% 31 Blogsblogspot.com 1,857 0.16% 18 Blogsimgur.com 1,756 0.15% 36 Photoscoolpile.com 1,706 0.15% 149,281 Entertainmentwordpress.com 1,615 0.14% 33 Blogsgiphy.com 1,055 0.09% 1,604 Photosbbc.com 966 0.08% 156 Newslastampa.it 927 0.08% 2,440 Newspinterest.com 892 0.08% 32 Photossoftandapps.info 861 0.07% 160,980 Newsphotobucket.com 768 0.07% 341 Photosnytimes.com 744 0.06% 97 Newssoundcloud.com 736 0.06% 167 Audio82The most frequent domains in the stories represent ~92% Host Frequency Percentage Alexa Global Rank as of 2015-03Categorytwitter.com 943,859 82.05% 8 Social mediainstagram.com 45,188 3.93% 25 Photosyoutube.com 22,076 1.92% 3 Videosfacebook.com 13,930 1.21% 2 Social mediaflickr.com 7,317 0.64% 126 Photospatch.com 5,783 0.50% 2,096 Newsplus.google.com 3,413 0.30% 1 Social mediatumblr.com 3,066 0.27% 31 Blogsblogspot.com 1,857 0.16% 18 Blogsimgur.com 1,756 0.15% 36 Photoscoolpile.com 1,706 0.15% 149,281 Entertainmentwordpress.com 1,615 0.14% 33 Blogsgiphy.com 1,055 0.09% 1,604 Photosbbc.com 966 0.08% 156 Newslastampa.it 927 0.08% 2,440 Newspinterest.com 892 0.08% 32 Photossoftandapps.info 861 0.07% 160,980 Newsphotobucket.com 768 0.07% 341 Photosnytimes.com 744 0.06% 97 Newssoundcloud.com 736 0.06% 167 Audio83The embedded resources of the tweets84https://pbs.twimg.com/media/BfnnY-0CcAA56oy.pngThe embedded resources of the tweets85Domain Percentage Categorytwimg.com 46.17% Imagesinstagram.com 4.28% Imagesyoutube.com 2.82% Videoslinkis.com 2.04% Media sharingfacebook.com 1.40% Social Mediawordpress.com 0.61% Blogsvine.co 0.53% Videosblogspot.com 0.52% Blogsstorify.com 0.49% Social Networkbbc.com 0.44% News• We sampled 5% of 47,512 tweets: 15,217 • The unique URIs: 14,616The embedded resources of the tweetsDomain Percentage Categorytwimg.com 46.17% Imagesinstagram.com 4.28% Imagesyoutube.com 2.82% Videoslinkis.com 2.04% Media sharingfacebook.com 1.40% Social Mediawordpress.com 0.61% Blogsvine.co 0.53% Videosblogspot.com 0.52% Blogsstorify.com 0.49% Social Networkbbc.com 0.44% News86• We sampled 5% of 47,512 tweets: 15,217 • The unique URIs: 14,616• 46% are photos from twitter.comThe embedded resources of the tweetsDomain Percentage Categorytwimg.com 46.17% Imagesinstagram.com 4.28% Imagesyoutube.com 2.82% Videoslinkis.com 2.04% Media sharingfacebook.com 1.40% Social Mediawordpress.com 0.61% Blogsvine.co 0.53% Videosblogspot.com 0.52% Blogsstorify.com 0.49% Social Networkbbc.com 0.44% News87• We sampled 5% of 47,512 tweets: 15,217 • The unique URIs: 14,616• 0.49% of the stories point to other stories in StorifyIs there a correlation between Alexa global rank and rank within Storify?88Most of the time, the highly ranked resources correlate the most used resources in human-generated storiesn 10 15 25 50 100Kendal 0.1555 0.4476 0.3372 0.3194 0.248589Most of the time, the highly ranked resources correlate the most used resources in human-generated storiesn 10 15 25 50 100Kendal 0.1555 0.4476 0.3372 0.3194 0.248590This is in contrast to the usage of resources in Pinterest [1][1] Zhong, C., Shah, S., Sundaravadivelan, K., Sastry, N.: Sharing the Loves: Understanding the How and Why of Online Content Curation. ICWSM 2013Image source: http://workmonk.in/testblog/wp-content/uploads/2014/01/pinterest.jpgHow many of the resources in these stories disappear every year?Can we find these missing resources in the archives?91The existence of the resources• We checked the live web and public web archives for 265,181 URIs– 202,452 URIs from story web elements – 47,512 randomly sampled tweet URIs – 15,217 URIs of embedded resources in those tweets• The unique URIs are 253,978• We examined the results of the five most frequent domains in the stories – twitter.com, instagram.com, youtube.com, facebook.com, flickr.com92The decay rate of the resources in the stories 9340.8% of the stories contain missing resources with an average value of 10.3% per story The decay rate of the resources in the stories 94There is a nearly linear decay rate of resources through time. This matches the finding by SalahEldeen [2]. [2] SalahEldeen, H.M., Nelson, M.L.: Losing my revolution: How many resources shared on social media have been lost? TPDL’12.Existence on the live web and in the archives95Of all the unique URIs, 11.8% are missing on the live web. Existence on the live web and in the archives96• The social media is not well-archived like the regular web• Facebook uses robots.txt to block web archiving by the Internet Archive What differentiates a popular story?97Specifying the popular and the unpopular stories• The stories are divided based on the number of their views, then normalized by the amount of time they were available on the web. • Popular stories– the top 25% of stories that have the most views – 3,642 stories98The distributions for the features of the stories99• Based on Kruskal-Wallis test, at the p ≤ 0.05 significance level, the popular and the unpopular stories are different in terms of most of the features• Popular stories tend to have:• more web elements (medians of 28 vs. 21) • longer timespan (5 hours vs. 2 hours) than the unpopular storiesDo Popular Stories have a Lower Decay Rate? 100The 75th percentile of decay rate per popular story is 10% of the resources, while it is 15% in the unpopular storiesThe distributions for the elements of the stories101Conclusions• We analyzed 14,568 stories from Storify comprising 1,251,160 elements.• Popular stories have a min/median/max value of 2/28/1950 elements, with the unpopular stories having 2/21/2216• Popular stories have a median of 12 multimedia resources (the unpopular stories have a median of 7)• Of the popular stories, 38% receive continuing edits (as opposed to 35%)• In popular stories, only 11% of web elements are missing on the live web (as opposed to 13%)• The percentage of the missing resources is proportional with the age of the stories. 102

Combining Storytelling and Web Archives

https://digitalcommons.odu.edu/cgi/viewcontent.cgi?article=1007&amp;context=computerscience_presentations

Combining Storytelling and Web Archives

Abstract

Similar works

Full text

Available Versions

Old Dominion University