Hackathon Challenge: Difference between revisions

 
(32 intermediate revisions by 5 users not shown)
Line 54: Line 54:
::::/home/aocr/datasets/herbs/outputs/ocropus
::::/home/aocr/datasets/herbs/outputs/ocropus
::::/home/aocr/datasets/herbs/outputs/tesseract
::::/home/aocr/datasets/herbs/outputs/tesseract
:::;'''[https://www.idigbio.org/wiki/images/e/e4/01498198.jpg SAMPLE IMAGE]''' parsed in the SAMPLE CSV next.
:::;'''[[Media:01498198.jpg|SAMPLE IMAGE]]''' parsed in the SAMPLE CSV next.
:::;'''[https://www.idigbio.org/wiki/images/6/62/SampleCSV.jpg SAMPLE PARSED CSV FILE]''' to show '''column headers and values'''
:::;'''[[Media:SampleCSV.jpg|SAMPLE PARSED CSV FILE]]''' to show '''column headers and values'''


:::;Data set 3 Entomology Images: /home/aocr/datasets/ent/inputs/raw
:::;Data set 3 Entomology Images: /home/aocr/datasets/ent/inputs/raw
Line 62: Line 62:
:::;Data set 3 Entomology OCR output ABBYY text files for parsing: /home/aocr/datasets/ent/outputs/abbyy
:::;Data set 3 Entomology OCR output ABBYY text files for parsing: /home/aocr/datasets/ent/outputs/abbyy


=== [[Dataset Errata]] ===
=== [[Dataset Errata]] ===
 
*known / discovered errors in the .txt, .csv files as they are found.
*known / discovered errors in the .txt, .csv files as they are found.
Many of the Lichen Gold labels have verbatimLatitude and verbatimLongitude, but the Gold Parsed files do not have the calculated decimalLatitude and decimalLongitude.  This seems especially true for the New York labels. (Daryl)
This is open to debate, but I think Elevation should be a pure numeric field, assumed to be in meters.  Therefore, it should not be expressed as "750 m", but rather as "750".  verbatimElevation, of course, should retain the "m" if it was present on the label.  (Note that Darwin Core apparently does not have a field called "elevation", but rather MinimumElevationInMeters, and MaximumElevationInMeters, both numeric fields.)  Not sure if this is something to change on the labels, but worth being aware of.  I think parsing programs should generate the Darwin Core fields. (Daryl)
Inconsistency in the Gold Parsed labels for Country.  If a US State is listed as the state, the label doesn't always say the name of the country, though it is obviously the USA.  Some Gold parsed results leave it blank, some fill it in with "USA", or "United States", though neither of these are on the label.  I think it is valid to fill it in, but it should be consistent.
Many Gold Parse Tennessee lichen labels have country errors.  Examples:
-- Gold Parsed TENN-L-0000001_lg.csv lists country as  "USA", but on the .txt label, it is "U.S.A." (with periods).
-- Gold Parsed TENN-L-0000005_lg.csv leaves country blank, but the label shows it as "USA".


== Parameters ==
== Parameters ==
5,887

edits