Tools such as google news and flipboard exist to convey daily news, but what about the news of the past? In this paper, we describe how to combine several existing tools and web archive holdings to convey the “biggest story” for a given date in the past. StoryGraph clusters news articles together to identify a common news story. Hypercane leverages ArchiveNow to store URLs produced by Story-Graph in web archives. Hypercane analyzes these URLs to identify the most common terms, entities, and highest quality images for social media storytelling. Raintale then takes the output of these tools to produce a visualization of the news story for a given day. We name this process SHARI (StoryGraph Hypercane ArchiveNow Raintale Integration). With SHARI, a user can visualize the articles belonging to a past date’s news story

Jones, Shawn M.

Klein, Martin

Nelson, Michael L.

Nwala, Alexander C.

Weigle, Michele C.

English

Old Dominion University

Old Dominion University ODU Digital Commons Computer Science Faculty Publications Computer Science 2020 SHARI- An Integration of Tools to Visualize the Story of the Day Shawn M. Jones Alexander C. Nwala Old Dominion University Martin Klein Michele C. Weigle Old Dominion University Michael L. Nelson Old Dominion University Follow this and additional works at: https://digitalcommons.odu.edu/computerscience_fac_pubs  Part of the Computer Sciences Commons Original Publication Citation Jones, S. M., Nwala, A. C., Klein, M., Weigle, M. C., & Nelson, M. L. (2020). SHARI- An integration of tools to visualize the story of the day. Web Archiving & Digital Libraries Workshop 2020, Virtual, August 5, 2020. This Conference Paper is brought to you for free and open access by the Computer Science at ODU Digital Commons. It has been accepted for inclusion in Computer Science Faculty Publications by an authorized administrator of ODU Digital Commons. For more information, please contact digitalcommons@odu.edu. SHARI – An Integration of Tools to Visualize the Story of the DayShawn M. Jonessmjones@lanl.govLos Alamos National LaboratoryLos Alamos, New MexicoAlexander C. Nwalaanwala@cs.odu.eduOld Dominion UniversityNorfolk, VirginiaMartin Kleinmklein@lanl.govLos Alamos National LaboratoryLos Alamos, New MexicoMichele C. Weiglemweigle@cs.odu.eduOld Dominion UniversityNorfolk, VirginiaMichael L. Nelsonmln@cs.odu.eduOld Dominion UniversityNorfolk, VirginiaABSTRACTTools such as Google News and Flipboard exist to convey daily news,but what about the news of the past? In this paper, we describehow to combine several existing tools and web archive holdings toconvey the “biggest story” for a given date in the past. StoryGraphclusters news articles together to identify a common news story.Hypercane leverages ArchiveNow to store URLs produced by Story-Graph in web archives. Hypercane analyzes these URLs to identifythe most common terms, entities, and highest quality images forsocial media storytelling. Raintale then takes the output of thesetools to produce a visualization of the news story for a given day.We name this process SHARI (StoryGraph Hypercane ArchiveNowRaintale Integration). With SHARI, a user can visualize the articlesbelonging to a past date’s news story.KEYWORDSnews, web archives, memento, storytelling, visualization, summa-rization1 INTRODUCTIONAlNoamany et al. [1] introduced how to use social media story-telling to summarize web archive collections. Collections on speci￿ctopics exist at various web archives [6]. Klein et al. [7] have builtcollections from web archives by conducting focused crawls. Jonesdeveloped Hypercane [4] to intelligently sample mementos fromlarger collections. Jones also developed Raintale [3] for generatingsocial media stories to summarize groups of mementos, providingvisualizations that employ familiar techniques, like cards, that re-quire no training for most users to understand. What if we want totell stories from web archives with semi-current news articles?Nwala et al. [9, 10] have focused on ￿nding seeds within searchengine result pages (SERPs), social media stories, and news feeds. Aspart of this research, Nwala et al. also developed StoryGraph [11], atool that analyzes multiple news sources every ten minutes and au-tomatically determines the news story or stories that dominate themedia landscape at that time. Aturban et al. developed ArchiveNow[2], a tool that accepts live web URI-Rs and submits them to webarchives to produce memento URI-Ms. We have tied StoryGraphtogether with tools from the Dark and Stormy Archives Toolkit1 toproduce visualizations summarizing the biggest StoryGraph storyof a given day.1https://oduwsdl.github.io/dsa/software.htmlFigure 1: The “biggest news story” of for the March 23, 2020story produced by SHARI2. Annotations detail which com-ponents provide each part of the visualization.2 THE SHARI PROCESSThe StoryGraphHypercaneArchiveNowRaintale Integration (SHARI)[5] process automatically creates stories summarizing news for aday. Figure 1 details what each tool contributes to the story. Figure2 shows the steps of the SHARI process. In step 1, with the Sto-ryGraph Toolkit, we query the StoryGraph service for the URI-Rsbelonging to the biggest story of the day. In step 2, Hypercane con-verts these URI-Rs to URI-Ms by ￿rst querying the LANL MementoAggregator via the Memento Protocol [12]. For each URI-M thatdoes not have a memento, Hypercane creates a memento by callingArchiveNow [2]. In step 3, Hypercane runs the mementos throughspaCy3 to generate a list of named entities, sorted by frequency.In step 4, Hypercane runs the mementos through sumgram [8]and generates a list of sumgrams, sorted by frequency. In step 5,Hypercane scores all of the mementos’ embedded images. In step 6,Hypercane runs the mementos through newspaper3k4 to extracteach article’s publication date and orders the URI-Ms by that date.In step 7, Hypercane consolidates the entities, terms, image scores,and ordered URI-Ms into a JSON ￿le containing the structured datafor the summary. During this step, Hypercane uses the highestscoring image as the striking image for the summary. In Figure 1,2https://oduwsdl.github.io/dsa-puddles/stories/shari/2020/03/23/storygraph_biggest_story_2020-03-23/3https://spacy.io/4https://newspaper.readthedocs.io/en/latest/Formatting of page by Raintale URI-Rs produced by StoryGraph URI-Ms produced by Hypercane with ArchiveNow Information for cards from MementoEmbed Image selected from highest ranked image in Hypercane image report Entities produced by Hypercane entity report Mementos ordered by publication date by Hypercane order command WADL 2020, August 04–05, 2020, Beijing, China Jones, Nwala, Klein, Weigle, Nelsonthe highest-ranking image is the UK Prime Minister addressing hiscountry about the COVID-19 pandemic. In step 8, Raintale rendersthe output as Jekyll HTML based on the contents of this JSON ￿le,a template ￿le, and information on each memento provided by Me-mentoEmbed. In step 9, the SHARI script publishes the summarystory to GitHub Pages for distribution. Figure 3 shows the outputof our dsa_tweeter bot which announces the story after publication.3 SUMMARY AND FUTUREWORKSHARI produces a familiar yet novel method of viewing news for aday in the past. SHARI can create stories for today, yesterday, andback to StoryGraph’s creation on August 8, 2017. It is di￿erent fromother storytelling services like Wakelet5 because SHARI is entirelyautomated. The stories produced by SHARI are di￿erent from ser-vices like Google News6 or Flipboard7 because those tools focuson current events and personalized topics. Because StoryGraphsamples content from multiple sides of the political spectrum, theSHARI process can provide a visualization of articles not tied toone interest area or even a single side’s terminology. This processworks because each component is loosely coupled, has high co-hesion, has explicit interfaces, and engages in information hiding.Each command passes data in the expected format to the next.We are exploring how to produce and render other news storiesfor a given day and any given period of time. We are researching5https://wakelet.com/6https://news.google.com/7https://￿ipboard.com/Figure 2: SHARI process for creating a visualization of thebiggest news story for a given dayFigure 3: The dsa_tweeter bot announces the availability ofnew SHARI stories each day.how to best visualize signi￿cant events that span substantial periodsof time, like the entire COVID-19 news story. Though StoryGraphis an existing service that gathers current news, we also want toapply its algorithm directly to mementos and tell the news storiesof past events like the Hurricane Katrina disaster. One day, throughSHARI, historians, journalists, and other researchers may glance atthe news for any date.REFERENCES[1] Yasmin AlNoamany, Michele C. Weigle, and Michael L. Nelson. 2017. GeneratingStories From Archived Collections. InWebSci 2017. Troy, New York, USA, 309–318.https://doi.org/10.1145/3091478.3091508[2] Mohamed Aturban, Mat Kelly, Sawood Alam, John A. Berlin, Michael L. Nelson,and Michele C. Weigle. 2018. ArchiveNow: Simpli￿ed, Extensible, Multi-ArchivePreservation. In JCDL 2018. Fort Worth, Texas, USA, 321–322. https://doi.org/10.1145/3197026.3203880[3] Shawn M. Jones. 2019. Raintale – A Storytelling Tool For Web Archives. https://ws-dl.blogspot.com/2019/07/2019-07-11-raintale-storytelling-tool.html[4] Shawn M. Jones. 2020. Hypercane Part 1: Intelligent Sampling ofWeb Archive Collections. https://ws-dl.blogspot.com/2020/06/2020-06-03-hypercane-part-1-intelligent.html[5] Shawn M. Jones. 2020. SHARI: StoryGraph Hypercane ArchiveNow RaintaleIntegration – Combining WS-DL Tools For Current Events Storytelling. https://ws-dl.blogspot.com/2020/04/2020-04-01-shari-storygraph-hypercane.html[6] Shawn M Jones, Alexander Nwala, Michele CWeigle, and Michael L Nelson. 2018.The Many Shapes of Archive-It. In iPres 2018. Boston, Massachusetts, USA, 1–10.https://doi.org/10.17605/OSF.IO/EV42P[7] Martin Klein, Lyudmila Balakireva, and Herbert Van de Sompel. 2018. FocusedCrawl of Web Archives to Build Event Collections. InWebSci 2018. Amsterdam,Netherlands, 333–342. https://doi.org/10.1145/3201064.3201085[8] Alexander C. Nwala. 2019. Introducing sumgram, a tool for generatingthe most frequent conjoined ngrams. https://ws-dl.blogspot.com/2019/09/2019-09-09-introducing-sumgram-tool-for.html[9] Alexander C. Nwala, Michele C. Weigle, and Michael L. Nelson. 2018. Bootstrap-ping Web Archive Collections from Social Media. In Hypertext 2018. Baltimore,Maryland, USA, 64–72. https://doi.org/10.1145/3209542.3209560[10] Alexander C. Nwala, Michele C. Weigle, and Michael L. Nelson. 2018. ScrapingSERPs for Archival Seeds: It Matters When You Start. In JCDL 2018. Fort Worth,Texas, USA, 263–272. https://doi.org/10.1145/3197026.3197056[11] Alexander C. Nwala, Michele C. Weigle, and Michael L. Nelson. 2020. 365 Dots in2019: Quantifying Attention of News Sources. Technical Report arXiv:2003.09989.https://arxiv.org/abs/2003.09989 arXiv: 2003.09989.[12] Herbert Van de Sompel, Michael Nelson, and Robert Sanderson. 2013. RFC7089 - HTTP Framework for Time-Based Access to Resource States – Memento.https://tools.ietf.org/html/rfc70891-------1 : Hypercane I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I 1-- - - - - - - - - - -I : Raintale I I I I I I I I ca ••• r-----------StoryGraph Service StoryGraph Hypercane ArchiveNow Raintale Integration (SHARI) MementoEmbed GitHub Pages -0 Dark and Stormy Archives @StormyArchives From the SHARI process : @storygraphbot 's biggest news story for yesterday, Sunday, May 31, 2020 -- of george floyd (24), tim walz (16), 46 year old black man killed by police during an (15), national guard (14), police officers (13) ... StoryGraph Biggest Story 2020-05-31 of george floyd (24), tim walz (16), 46 year old black man killed by police during an (15). national guard (14), police ... & oduwsdl.github.io 9:00 AM • Jun 1, 2020 • dsa_tweeter 1h View Tweet activity 0 n 

SHARI- An Integration of Tools to Visualize the Story of the Day

https://digitalcommons.odu.edu/cgi/viewcontent.cgi?article=1174&context=computerscience_fac_pubs

SHARI- An Integration of Tools to Visualize the Story of the Day

Abstract

Similar works

Full text

Available Versions

Old Dominion University