Human Generated Data

Title

Untitled (couple seated on couch)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8385
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated on couch)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Clothing 99.9
Apparel 99.9
Person 99.5
Human 99.5
Person 99.3
Furniture 98.3
Suit 98.1
Overcoat 98.1
Coat 98.1
Chair 93.2
Couch 91.1
Pillow 88.3
Cushion 88.3
Robe 88
Fashion 88
Gown 87.7
Female 82
Shirt 81.6
Meal 81
Food 81
Wedding 79.9
Tuxedo 79.8
Plant 77.8
Bridegroom 74.9
Bookcase 73.5
Wedding Gown 72.9
Shelf 71.5
Dish 71
Table 70.5
Face 70.5
Woman 68.6
Indoors 68.1
Dress 65.9
Man 65.8
Flower 63.3
Blossom 63.3
Photography 60.5
Photo 60.5
Living Room 60.2
Room 60.2
Bride 59.6
Flower Arrangement 58.1
Long Sleeve 58
Sleeve 58
Tie 56.5
Accessories 56.5
Accessory 56.5

Imagga
created on 2022-01-09

man 46.4
person 38.3
people 34
senior 33.8
male 32.7
coat 29
adult 27.6
professional 26.6
lab coat 24.8
bow tie 24.7
doctor 24.5
medical 23.9
patient 23.3
specialist 23.3
necktie 22.6
mature 21.4
indoors 21.1
elderly 21.1
hospital 20.2
portrait 20.1
happy 20.1
couple 19.2
nurse 19.2
smiling 18.8
old 18.1
garment 17.7
home 17.6
room 16.6
lifestyle 16.6
work 16.5
care 15.6
retired 15.5
men 15.5
health 15.3
clothing 15.2
looking 15.2
businessman 15
sitting 14.6
office 14.6
worker 14.5
husband 14.3
medicine 14.1
occupation 13.8
pensioner 13.8
computer 13.6
wife 13.3
face 12.8
business 12.8
lab 12.6
team 12.6
laboratory 12.5
retirement 12.5
family 12.5
illness 12.4
clinic 12.4
together 12.3
hand 12.2
table 12.1
student 12
women 11.9
aged 11.8
60s 11.7
older 11.7
working 11.5
bed 11.4
education 11.3
casual 11
holding 10.7
to 10.6
test 10.6
exam 10.5
teacher 10.5
color 10
modern 9.8
two people 9.7
talking 9.5
love 9.5
desk 9.5
togetherness 9.4
happiness 9.4
grandfather 9.1
hairdresser 9.1
science 8.9
group 8.9
job 8.9
scientist 8.8
sick 8.7
serious 8.6
bright 8.6
research 8.6
smile 8.6
biology 8.5
meeting 8.5
glasses 8.3
indoor 8.2
practitioner 8.2
laptop 8.2
confident 8.2
newspaper 8.2
technology 8.2
romantic 8
stethoscope 8
scholar 7.9
day 7.9
expertise 7.8
chemistry 7.7
notes 7.7
profession 7.7
uniform 7.6
horizontal 7.5
learning 7.5
human 7.5
study 7.5
help 7.5
teamwork 7.4
suit 7.2
salon 7.1
look 7

Google
created on 2022-01-09

Smile 95.6
Black 89.6
Shelf 86.2
Picture frame 86
Black-and-white 85.3
Style 83.8
Font 80.7
Art 79.9
Adaptation 79.4
Bookcase 78.1
Monochrome photography 73.4
Hat 73.3
Monochrome 72.3
Vintage clothing 71.4
Event 70.8
Room 70.1
Publication 66.9
Photo caption 66
Tie 65.2
Sitting 64.8

Microsoft
created on 2022-01-09

text 99.9
person 89.7
human face 87.8
black and white 86.2
drawing 83.7
clothing 81.2
book 80.3
cartoon 77.3
sketch 57.9
shelf 52

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 92.9%
Happy 97.3%
Surprised 1.4%
Sad 0.5%
Calm 0.4%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 27-37
Gender Female, 99.4%
Happy 90%
Surprised 3.3%
Calm 3.3%
Confused 1.3%
Fear 0.9%
Disgusted 0.7%
Sad 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 56.5%

Captions

Microsoft

a person holding a book 47.3%
a man and a woman in a library 47.2%
a man and a woman sitting in a library 37.7%

Text analysis

Amazon

12222
12222.
12222 SAN
CILBERT
Suremia
SAN

Google

2222.
2222.