Publication Details
PersonGONE: Image Inpainting for Automated Checkout Solution
Špaňhel Jakub, Ing., Ph.D. (DCGM FIT BUT)
Herout Adam, prof. Ing., Ph.D. (DCGM FIT BUT)
automatic checkout, product counting, image inpainting, object detection, object tracking
In this paper, we present a solution for automatic checkout in a retail store as a part of AI City Challenge 2022. We propose a novel approach that uses the removal of unwanted objects in this case, body parts of operating staff, which are localized and further removed from video by an image inpainting method. Afterwards, a neural network detector can detect products with a decreased detection false positive rate. A part of our solution is also automatic detection of ROI (the place where products are shown to the system). We reached 0.4167 F1-Score with 0.3704 precision and 0.4762 recall which placed us at the 7th place of AI City Challenge 2022 in corresponding Track 4. The code is made public and available on GitHub.
@INPROCEEDINGS{FITPUB12737,
author = "Vojt\v{e}ch Bartl and Jakub \v{S}pa\v{n}hel and Adam Herout",
title = "PersonGONE: Image Inpainting for Automated Checkout Solution",
pages = "3114--3122",
booktitle = "2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)",
series = "IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops",
journal = "Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)",
volume = 2022,
number = 7,
year = 2022,
location = "New Orleans, LA, US",
publisher = "IEEE Computer Society",
ISSN = "2160-7516",
doi = "10.1109/CVPRW56347.2022.00351",
language = "english",
url = "https://www.fit.vut.cz/research/publication/12737"
}