The boom of digital cameras, photography, and social media has drastically changed how humans live their day-to-day, but this normalization is accompanied by malicious agents finding new ways to forge and tamper with images for unlawful monetary (or other) gains. Disinformation in the photographic media realm is an urgent threat. The availability of a myriad of image editing tools renders it almost impossible to differentiate between photo-realistic and original images. The tools available for image forensics require a standard framework against which they can be evaluated. Such a standard framework can aid in evaluating the suitability of an image forensics tool for use in a criminal investigation, commercial operation, or academic research. This paper proposes an evaluation framework designed for image forensics tools based on the conformance methodology of testing that employs test assertions and test cases. It is then used to evaluate four image forensics tools namely FotoForensics, Ghiro, Imago Forensics, and Exif Reader. The comparative insight of test results produced by the framework provides a ground for ranking the tools from best to least comprehensive. The results also provide information necessary for users to make intelligent choices about tools and help vendors shortlist areas of improvement in their tools.


Allen, T. (2017). Computer Forensics Tool Testing Program (CFTT). Retrieved from www.nist.gov/itl/ssd/software-quality-group/computer-forensics-tool-testing-program-cftt

Anobah, M., Saleem, S., & Popov, O. (2014). Testing Framework for Mobile Device Forensics Tools. Journal of Digital Forensics, Security and Law, 9(18). doi: 10.15394/jdfsl.2014.1183

Gloe, T., & B¨ohme, R. (2010). The Dresden Image Database for Benchmarking Digital Image Forensics. Journal of Digital Forensic Practice, 3(2-4), 150-159. doi: 10.1080/15567281.2010.531500

Heyman, S. (2015). Photos, Photos Everywhere (Tech. Rep.). The New York Times. Retrieved from https://www.nytimes.com/2015/07/23/arts/international/photos-photos-everywhere.html

Holder, H., & Robinson, L. (2008). Special Report Test Results for Digital Data Acquisition Tool (Tech. Rep.). CFTT, NIST.

Hsu, Y., & Chang, S. (2006). Detecting Image Splicing using Geometry Invariants and Camera Characteristics Consistency. In 2006 ieee international conference on multimedia and expo (p. 549-552). doi: 10.1109/ICME.2006.262447

Kubi, A., Saleem, S., & Popov, O. (2011). Evaluation of some tools for extracting e-evidence from mobile devices. In 2011 5th international conference on application of information and communication technologies (aict) (p. 1-6). doi: 10.1109/ICAICT.2011.6110999

Piirainen, K., Gonzalez, R., & Kolfschoten, G. (2010). Quo Vadis, Design Science? – A Survey of Literature. In Global perspectives on design science research (p. 93-108).

Piva, A. (2013). An Overview on Image Forensics. ISRN Signal Processing, 1-22. doi: 10.1155/2013/496701

Qazi, T., Hayat, K., Khan, S., Madani, S., Khan, I., Kolodziej, J., ... Xu, C. (2013). Survey on blind image forgery detection. IET Image Processing, 7, 660-670. doi: 16 10.1049/IET-IPR.2012.0388

Qureshi, M., & Deriche, M. (2014). A review on copy move image forgery detection techniques. In 2014 ieee 11th international multi-conference on systems, signals and devices (ssd14) (p. 1-5). doi: 10.1109/SSD.2014.6808907

Redi, J.A., Taktak, W. & Dugelay, J. (2011). Digital image forensics: a booklet for beginners. Multimedia Tools and Applications, 51 , 133-162. doi: 10.1007/s11042-010-0620-1

Rehman, Z., Ahmad, A., & Saleem, S. (2017). A Brief Survey of Memory Analysis Tools. NUST Journal of Engineering Sciences, 10.

Saleem, S., Popov, O., Kubi, A., & Kwame, O. (2013).Evaluating and Comparing Tools for Mobile Device Forensics Using Quantitative Analysis. In Digital forensics and cyber crime (p. 264-282). Sevi, I. (2013).

EXIF Sample Images. Retrieved from https://github.com/ianare/exif-samples

Wikimedia Commons. (2021). Retrieved from https://commons.wikimedia.org



To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.