Table 6 The performance of BioBERT large cased v1.1 on the test set
From: Precision information extraction for rare disease epidemiology at scale
Evaluation level | Entity | Precision | Recall | F1 |
|---|---|---|---|---|
Entity-level | Overall | 0.813 | 0.821 | 0.817 |
EPI | 0.938 | 0.958 | 0.948 | |
STAT | 0.522 | 0.444 | 0.48 | |
LOC | 0.746 | 0.770 | 0.758 | |
DATE | 1.0 | 1.0 | 1.0 | |
SEX | 0.923 | 1.0 | 0.960 | |
ETHN | 0.65 | 0.813 | 0.722 | |
Token-level | Overall | 0.932 | 0.831 | 0.878 |
EPI | 0.959 | 0.967 | 0.963 | |
STAT | 0.900 | 0.689 | 0.780 | |
LOC | 0.959 | 0.843 | 0.897 | |
DATE | 1.0 | 1.0 | 1.0 | |
SEX | 0.923 | 1.0 | 0.960 | |
ETHN | 0.696 | 0.941 | 0.800 |