1. Can the app differentiate one article of clothing from background / other articles 2. Can the app group together identical articles of clothing
To answer 1. The app has decent performance with test set pixel level mean accuracy of 0.80 and mIoU of 0.69, the test set is all real world fit pix from myself and friends. The 0.8 is a bit misleading though as the errors often occur at clothing boundaries so in poor lighting there can be some border gore.
As for 2. this remains to be seen. Currently clothing aggregation (Grouping together two segmentations of the same shirt) is manual. I'm doing some studies on tuning cosign-sim thresholds but I think long term there may need to be a more robust approach.