Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)

Date

1937

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5287

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two couples having Campbell's soup at formal dinner party/soup being served by maid)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.5
Human 99.5
Person 99.4
Person 99.4
Person 99.3
Person 97.9
Chair 94.2
Furniture 94.2
Meal 92.3
Food 92.3
People 92.1
Person 82.8
Dish 79.2
Drawing 64.7
Art 64.7
Photography 64.7
Photo 64.7
Portrait 61.8
Face 61.8
Family 60.9
Restaurant 59.5
Table 59.3
Cafeteria 59.2
Crowd 55.9
Dining Table 55.3

Imagga
created on 2022-01-22

person 38.4
people 37.4
man 35.6
male 33.4
nurse 30
adult 27.5
patient 27.2
smiling 26.8
groom 25.4
hospital 25.2
indoors 23.7
businessman 23
businesswoman 22.7
room 22.7
happy 21.9
business 21.9
men 20.6
team 20.6
office 20.2
couple 20
home 19.9
women 19.8
sitting 19.8
colleagues 19.4
together 19.3
talking 19
businesspeople 19
professional 18.9
meeting 18.8
cheerful 18.7
worker 18.3
group 17.7
working 17.7
lifestyle 15.9
work 15.7
table 15.6
desk 15.1
portrait 14.9
teamwork 14.8
20s 14.7
barbershop 14.1
smile 13.5
coat 13.4
happiness 13.3
shop 13.2
holding 13.2
corporate 12.9
sick person 12.8
indoor 12.8
case 12.5
medical 12.4
computer 12
lab coat 11.8
executive 11.4
attractive 11.2
clinic 11.2
mature 11.2
casual 11
day 11
successful 11
family 10.7
interior 10.6
mercantile establishment 10.5
doctor 10.3
two 10.2
laptop 10
employee 9.9
associates 9.8
pretty 9.8
casual clothing 9.8
40s 9.7
health 9.7
new 9.7
30s 9.6
four 9.6
ethnic 9.5
love 9.5
color 9.5
camera 9.2
confident 9.1
suit 9
four people 8.9
job 8.8
coworkers 8.8
standing 8.7
mother 8.7
face 8.5
enjoying 8.5
senior 8.4
communication 8.4
life 8.4
manager 8.4
drink 8.4
care 8.2
to 8
specialist 7.9
collaboration 7.9
discussing 7.9
two people 7.8
mid adult 7.7
twenties 7.6
hand 7.6
togetherness 7.6
friends 7.5
friendship 7.5
clothing 7.3
looking 7.2
romantic 7.1
medicine 7
modern 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.1
person 96.3
clothing 87.2
drawing 85.4
window 81.6
table 81.3
sketch 73.6
old 66.8
man 63.3
furniture 59.2
people 56.3
woman 55.1
working 51.6

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 98.1%
Happy 96.6%
Sad 2.1%
Calm 0.7%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Female, 84.5%
Calm 97.9%
Surprised 0.8%
Sad 0.7%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 23-31
Gender Female, 87.3%
Calm 98.3%
Happy 0.7%
Sad 0.4%
Surprised 0.3%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 94.2%

Captions

Microsoft

a group of people in an old photo of a person 76.6%
a group of people sitting at a table 73.4%
an old photo of a group of people sitting at a table 73.3%

Text analysis

Amazon

5689
BUSEA
USSSWOLD BUSEA
USSSWOLD

Google

b895
b895