Human Generated Data

Title

Untitled (two women sitting on couch)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4986
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two women sitting on couch)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Chair 99.2
Furniture 99.2
Person 98.7
Apparel 98.4
Clothing 98.4
Hat 96.5
Cushion 93.6
Home Decor 87.3
Pillow 80.5
Face 80.2
Couch 75.8
Female 74.8
Accessory 67.1
Tie 67.1
Accessories 67.1
Bed 62.2
Photography 60.7
Photo 60.7
Living Room 59.5
Room 59.5
Indoors 59.5
Girl 58.9
Glasses 57.4
Sun Hat 57.3
People 57.1
Food 56.2
Meal 56.2
Woman 56.1

Imagga
created on 2022-01-22

nurse 76.4
patient 60
person 53.7
sick person 38.2
man 37.6
case 37.4
people 29.5
medical 26.5
male 26.2
doctor 19.7
health 19.4
work 19
adult 18.5
hospital 18.1
professional 17.7
medicine 17.6
care 17.3
science 16
worker 15.4
clinic 15.1
senior 15
surgeon 14.8
men 14.6
laboratory 14.4
room 13.7
lab 13.6
mask 13.4
illness 13.3
working 13.2
occupation 12.8
life 12.8
scientist 12.7
research 12.4
sitting 12
home 12
happy 11.9
surgery 11.7
test 11.5
equipment 11.5
indoors 11.4
human 11.2
women 11.1
student 10.9
art 10.4
biology 10.4
portrait 10.3
casual 10.2
hand 9.9
team 9.8
old 9.7
chemistry 9.7
chemical 9.6
exam 9.6
smiling 9.4
coat 9
technology 8.9
operation 8.9
sterile 8.8
scientific 8.7
uniform 8.7
elderly 8.6
modern 8.4
glasses 8.3
family 8
surgical 7.9
couple 7.8
smile 7.8
face 7.8
experiment 7.8
retired 7.7
emergency 7.7
married 7.7
instrument 7.7
lifestyle 7.2
love 7.1
happiness 7

Google
created on 2022-01-22

Hat 90.3
Style 83.9
Black-and-white 83.7
Fedora 83.1
Picture frame 81.1
Sun hat 80.8
Art 77.6
Snapshot 74.3
Window 73.9
Curtain 72.8
Monochrome photography 71.9
Monochrome 70.8
Cowboy hat 69.7
Font 68.7
Vintage clothing 67.9
Room 67.5
Stock photography 63.6
Sitting 62.3
Classic 60.1
History 58.6

Microsoft
created on 2022-01-22

text 99.8
black and white 83.6
sketch 80.2
human face 71.6
person 58
clothing 53.5
drawing 52.5

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Happy 98.5%
Surprised 0.8%
Sad 0.2%
Calm 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 91.7%
Sad 93.3%
Surprised 2.5%
Calm 1.7%
Confused 1.1%
Fear 0.5%
Angry 0.4%
Disgusted 0.3%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 99.2%
Hat 96.5%
Couch 75.8%
Tie 67.1%
Bed 62.2%

Captions

Microsoft

a person sitting on a bed 31.1%
people around each other 31%

Text analysis

Amazon

13555
sa
55581

Google

13555
13555 13555. SSSEI sa AQON-YT37A2- MAMTZA3
sa
AQON-YT37A2-
13555.
SSSEI
MAMTZA3