Methodological Features of Validating Forensic Expert Techniques
The article reviews and summarizes the experience of validating forensic expert techniques in the Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian Federation. The authors point out the methodological features of practical implementation of the validation procedure...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | Russian |
| Published: |
Ministry of Justice of the Russian Federation, Russian Federal Centre of Forensic Science
2023-05-01
|
| Series: | Теория и практика судебной экспертизы |
| Subjects: | |
| Online Access: | https://www.tipse.ru/jour/article/view/771 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849252940733218816 |
|---|---|
| author | A. I. Usov G. G. Omel’yanyuk G. I. Bebeshko I. P. Lyubetskaya I. B. Afanas’ev |
| author_facet | A. I. Usov G. G. Omel’yanyuk G. I. Bebeshko I. P. Lyubetskaya I. B. Afanas’ev |
| author_sort | A. I. Usov |
| collection | DOAJ |
| description | The article reviews and summarizes the experience of validating forensic expert techniques in the Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian Federation. The authors point out the methodological features of practical implementation of the validation procedure. They demonstrate that the specificity, diversity, and complexity of the objects of expert study require the classification of the applied methods in terms of metrology, identification of the main validation parameters of quantitative and qualitative methods, organization of experiments, and evaluation of validation parameters using mathematical analysis methods. They also propose to divide methods into two types: forensic expert measurement methods (FMT) and forensic expert testing methods (FTT). Based on the generalization of information presented in several regulatory documents and scientific publications, the following parameters are identified for FMT: metrological characteristics or properties of the method (specificity, linearity, sensitivity, range of determined values, detection limit, quantitative determination limit) and quality indicators of the method (precision, correctness, accuracy of the analysis result, or uncertainty). When validating FTT, it is proposed to evaluate the reliability of the method and the competence of the expert.An experiment to assess validation parameters is performed using enough control samples with established characteristics of controlled indicators and with the participation of a sufficient number of experts. Requirements for control samples are provided.The authors also give examples of probabilistic evaluation of validation parameters for two qualitative testing methods: microscopic examination of textile fibers and detection of gunshot residue using scanning electron microscopy and X-ray microanalysis. The reliability of these methods is assessed by calculating the likelihood ratio, and the specificity of interpreting the results of FMT and FTT validation is noted.The decision on compliance with the requirements is made if the interval of the established extended uncertainty for the obtained result does not exceed the tolerance field. In the absence of tolerances, FMT is considered suitable for solving forensic expert tasks if the values of the extended uncertainty of the measurement results of the controlled indicator do not exceed the values established during validation. For FTT, a low probabilistic proportion of false positive and false negative results in determining the presence/absence of controlled indicators, as well as experimentally confirmed competence of the expert during validation, are indicators of the suitability of the method for its intended use |
| format | Article |
| id | doaj-art-5ded6a0a15eb4e44a2e5dcadfacabf51 |
| institution | Kabale University |
| issn | 1819-2785 2587-7275 |
| language | Russian |
| publishDate | 2023-05-01 |
| publisher | Ministry of Justice of the Russian Federation, Russian Federal Centre of Forensic Science |
| record_format | Article |
| series | Теория и практика судебной экспертизы |
| spelling | doaj-art-5ded6a0a15eb4e44a2e5dcadfacabf512025-08-20T03:56:29ZrusMinistry of Justice of the Russian Federation, Russian Federal Centre of Forensic ScienceТеория и практика судебной экспертизы1819-27852587-72752023-05-01181769610.30764/1819-2785-2023-1-76-96666Methodological Features of Validating Forensic Expert TechniquesA. I. Usov0G. G. Omel’yanyuk1G. I. Bebeshko2I. P. Lyubetskaya3I. B. Afanas’ev4The Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian Federation; The Russian Law Academy; Bauman Moscow State Technical University (BMSTU)The Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian Federation; Bauman Moscow State Technical University (BMSTU); Peoples’ Friendship University of Russia (RUDN University); Lomonosov Moscow State UniversityThe Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian FederationThe Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian FederationThe Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian FederationThe article reviews and summarizes the experience of validating forensic expert techniques in the Russian Federal Centre of Forensic Science of the Ministry of Justice of the Russian Federation. The authors point out the methodological features of practical implementation of the validation procedure. They demonstrate that the specificity, diversity, and complexity of the objects of expert study require the classification of the applied methods in terms of metrology, identification of the main validation parameters of quantitative and qualitative methods, organization of experiments, and evaluation of validation parameters using mathematical analysis methods. They also propose to divide methods into two types: forensic expert measurement methods (FMT) and forensic expert testing methods (FTT). Based on the generalization of information presented in several regulatory documents and scientific publications, the following parameters are identified for FMT: metrological characteristics or properties of the method (specificity, linearity, sensitivity, range of determined values, detection limit, quantitative determination limit) and quality indicators of the method (precision, correctness, accuracy of the analysis result, or uncertainty). When validating FTT, it is proposed to evaluate the reliability of the method and the competence of the expert.An experiment to assess validation parameters is performed using enough control samples with established characteristics of controlled indicators and with the participation of a sufficient number of experts. Requirements for control samples are provided.The authors also give examples of probabilistic evaluation of validation parameters for two qualitative testing methods: microscopic examination of textile fibers and detection of gunshot residue using scanning electron microscopy and X-ray microanalysis. The reliability of these methods is assessed by calculating the likelihood ratio, and the specificity of interpreting the results of FMT and FTT validation is noted.The decision on compliance with the requirements is made if the interval of the established extended uncertainty for the obtained result does not exceed the tolerance field. In the absence of tolerances, FMT is considered suitable for solving forensic expert tasks if the values of the extended uncertainty of the measurement results of the controlled indicator do not exceed the values established during validation. For FTT, a low probabilistic proportion of false positive and false negative results in determining the presence/absence of controlled indicators, as well as experimentally confirmed competence of the expert during validation, are indicators of the suitability of the method for its intended usehttps://www.tipse.ru/jour/article/view/771forensic expert measurement methods (fmt)forensic expert testing methods (ftt)validation parameters and experimentapplication of mathematical methodssuitability of the methodology for its intended use |
| spellingShingle | A. I. Usov G. G. Omel’yanyuk G. I. Bebeshko I. P. Lyubetskaya I. B. Afanas’ev Methodological Features of Validating Forensic Expert Techniques Теория и практика судебной экспертизы forensic expert measurement methods (fmt) forensic expert testing methods (ftt) validation parameters and experiment application of mathematical methods suitability of the methodology for its intended use |
| title | Methodological Features of Validating Forensic Expert Techniques |
| title_full | Methodological Features of Validating Forensic Expert Techniques |
| title_fullStr | Methodological Features of Validating Forensic Expert Techniques |
| title_full_unstemmed | Methodological Features of Validating Forensic Expert Techniques |
| title_short | Methodological Features of Validating Forensic Expert Techniques |
| title_sort | methodological features of validating forensic expert techniques |
| topic | forensic expert measurement methods (fmt) forensic expert testing methods (ftt) validation parameters and experiment application of mathematical methods suitability of the methodology for its intended use |
| url | https://www.tipse.ru/jour/article/view/771 |
| work_keys_str_mv | AT aiusov methodologicalfeaturesofvalidatingforensicexperttechniques AT ggomelyanyuk methodologicalfeaturesofvalidatingforensicexperttechniques AT gibebeshko methodologicalfeaturesofvalidatingforensicexperttechniques AT iplyubetskaya methodologicalfeaturesofvalidatingforensicexperttechniques AT ibafanasev methodologicalfeaturesofvalidatingforensicexperttechniques |