• Evaluation of Algorithm Performance on Identifying OA

      Antelman, Kristin; Bakkalbasi, Nisa; Goodman, David; Hajjem, Chawki; Harnad, Stevan (2005-12)
      This is a second signal-detection analysis of the accuracy of a robot in detecting open access (OA) articles (by checking by hand how many of the articles the robot tagged OA were really OA, and vice versa). We found that the robot significantly overcodes for OA. In our Biology sample, 40% of identified OA was in fact OA. In our Sociology sample, only 18% of identified OA was in fact OA. Missed OA was lower: 12% in Biology and 14% in Sociology. The sources of the error are impossible to determine from the present data, since the algorithm did not capture URL's for documents identified as OA. In conclusion, the robot is not yet performing at a desirable level, and future work may be needed to determine the causes, and improve the algorithm.
    • Identifying Open Access Articles: Valid and Invalid Methods

      Goodman, David; Antelman, Kristin; Bakkalbasi, Nisa (2005)
      Many versions of an article are now visible on the web, including not only open access (OA), but also paid access, preliminary versions, abstracts, and mere references or citations. The purpose of OA requires not only that the article can be read without the barrier of payment, but also that the reader can find the article to be read without the barrier of extensive searching. We will demonstrate the dubious validity of one prominent system for identifying OA and measuring the amount of OA and the OA Advantage. We will then briefly discuss the remaining alternatives.
    • Library 1.1

      Antelman, Kristin; Pennell, Charley (2007-08)
      Libraries operate within a culture that posits collaborating towards a common good, through resource sharing, cooperative development of standards, and the building of common work tools. The semantic Web, and the recent rapprochement between RDA and DCMI, have the potential to advance our contribution to the common good in ways that have never been possible before, yet there are still economic, legal, technical and cultural hurdles that are likely to conspire to keep libraries working within institutional silos. This talk will look at how the NCSU Libraries' is trying to work toward a more open catalog platform by creating a web services layer to support features such as RSS and by integrating structured data from outside of the ILS, starting with classification and geographical hierarchies, and potentially extending to chronological hierarchies, FRBR "work-level" records, and academic discipline-related vocabularies. These efforts point to the need for access to additional data that is outside the local machine environment. We look at some of these data sources and assess the obstacles that will have to be overcome before library catalogs, and librarians, will be able to fully join the broader Web 2.0 discovery environment.
    • Meta-analysis of OA and OAA Manual Determinations

      Goodman, David; Antelman, Kristin; Bakkalbasi, Nisa (2006-01)
      Stevan Harnad's group and our's have reported several manual measurements in order to evaluate the accuracy of Chawki Hajjem's robot program, which has been extensively used by Harnad's group. Our group has now prepared an overall metaanalysis of the manual results.