7
edits
Presentations & Reports: Difference between revisions
Jump to navigation
Jump to search
→Talks & Reports from Hackathon 1
| Line 14: | Line 14: | ||
:::The Lichens, Bryophytes and Climate Change (LBCC) project endeavors to digitize the label information from millions of North American lichen and bryophyte herbarium specimens. These labels are occasionally hand written although usually at least partially typed or printed. When typed or printed a myriad of fonts have been used. Thus far, we have been constrained to use open-source Optical Character Recognition (OCR) software. By most accounts the best of these is Tesseract. While it does not recognize handwriting it is considered to be the best at recognizing typewritten text images. Our workflow involves attaching a barcode to labels, imaging them, assigning the barcode to be the image filename and submitting the images to an FTP server to be entered into Symbiota, a MySQL database designed by Ed Gilbert, with the barcode as the catalog number. Once entered into Symbiota, the images are batch processed with Tesseract and the results entered into the database as well. The next step is to parse the Tesseract output to retrieve the label information in hopes of being able to populate relevant fields in the database. I have been developing code using PHP version 5.3 and its PCRE regular-expression library for this purpose. | :::The Lichens, Bryophytes and Climate Change (LBCC) project endeavors to digitize the label information from millions of North American lichen and bryophyte herbarium specimens. These labels are occasionally hand written although usually at least partially typed or printed. When typed or printed a myriad of fonts have been used. Thus far, we have been constrained to use open-source Optical Character Recognition (OCR) software. By most accounts the best of these is Tesseract. While it does not recognize handwriting it is considered to be the best at recognizing typewritten text images. Our workflow involves attaching a barcode to labels, imaging them, assigning the barcode to be the image filename and submitting the images to an FTP server to be entered into Symbiota, a MySQL database designed by Ed Gilbert, with the barcode as the catalog number. Once entered into Symbiota, the images are batch processed with Tesseract and the results entered into the database as well. The next step is to parse the Tesseract output to retrieve the label information in hopes of being able to populate relevant fields in the database. I have been developing code using PHP version 5.3 and its PCRE regular-expression library for this purpose. | ||
::; | ::;LABELX - Bryan Heidorn & Qianjin Zhang | ||
Label Annotation through Biodiversity Enhanced Learning (LABELX) (Heidorn & Wei, 2008; Heidorn & Zhang, 2013) is a Hidden Markov Model-based system HMM) (Frasconi et al., 2003) with a number of preprocessing and post-processing algorithms added. HMMs exploit the order of elements in a label and Bayesian conditional probability to predict the proper classification of elements of the label. Because there are millions of scientific names and any individual name is unlikely to be in a training set of 100-200 records used here, for plants the system uses International Plant Name Index (IPNI, 2012) of scientific names and authorities to substitute generic tokens for, genus, species and authority. Similar substitutions are made for integers and alphanumerics that are used in collector numbers and collection numbers. | |||
::;Parsing Dataset 2 - Dmitry Mozzherin | ::;Parsing Dataset 2 - Dmitry Mozzherin | ||