An open-source framework for large-scale, flexible evaluation of biomedical text mining systems-1

Mbined gene tagger performance. GN system performance based on each of the three methods for combining gene tagger output (Overlapping, Consensus, Consensus followed by Overlapping). GN System performance highlighting the combination of the overlapping filter with and without use of the dictionary-based GM system. Data points generated using the other filters are shown in gray. Same as C, with the presence/absence of another representative tagger shown. and : GN system performance as it relates to combined gene tagger precision and recall, respectively.<p><b>Copyright information:</b></p><p>Taken from "An open-source framework for large-scale, flexible evaluation of biomedical text mining systems"</p><p>http://www.j-biomed-discovery.com/content/3/1/1</p><p>Journal of Biomedical Discovery and Collaboration 2008;3():1-1.</p><p>Published online 29 Jan 2008</p><p>PMCID:PMC2276192.</p><p></p

An open-source framework for large-scale, flexible evaluation of biomedical text mining systems-2

Ncology, left; Bio1, right). There are 45 data points in each graph. Five evaluation metrics – , Strict: spans must match exactly; , Sloppy: spans must overlap; , LeftMatch: span starts must match; , RightMatch: span ends must match; , EitherMatch: span start or end must match – were used to evaluate each tagger. Different colors are used to distinguish between the taggers. F-measure contour lines are displayed in gray, with the corresponding value listed on the right, also in gray.<p><b>Copyright information:</b></p><p>Taken from "An open-source framework for large-scale, flexible evaluation of biomedical text mining systems"</p><p>http://www.j-biomed-discovery.com/content/3/1/1</p><p>Journal of Biomedical Discovery and Collaboration 2008;3():1-1.</p><p>Published online 29 Jan 2008</p><p>PMCID:PMC2276192.</p><p></p

Figure 2A shows the effect of term length for the cross validation data

<p><b>Copyright information:</b></p><p>Taken from "BioCreAtIvE Task1A: entity identification with a stochastic tagger"</p><p></p><p>BMC Bioinformatics 2005;6(Suppl 1):S4-S4.</p><p>Published online 24 May 2005</p><p>PMCID:PMC1869018.</p><p></p> Figure 2B shows the effect of term length for the official test data