Human Generated Data

Title

Untitled (Tupperware party)
Date

1954, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.105
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Tupperware party)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1954, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.3
Person 98.5
Person 98.5
Room 98.3
Indoors 98.3
Person 98.2
Person 97.8
Audience 97.1
Crowd 97.1
Person 96.7
Person 95.6
Person 95.3
Person 95.2
Classroom 92.6
School 92.6
Person 91.7
Person 87
Person 84.5
Furniture 78.9
People 73.6
Clothing 66.3
Apparel 66.3
Painting 64.1
Art 64.1
Lecture 60.4
Speech 60.4
Sitting 60.3
Interior Design 59.7
Seminar 59.3
Living Room 58.1
Couch 57.9
Dressing Room 57.2
Reception Room 56.7
Reception 56.7
Waiting Room 56.7
Female 56.4
Evening Dress 55.2
Fashion 55.2
Gown 55.2
Robe 55.2

Imagga
created on 2022-01-08

person 35.2
people 32.3
patient 28.4
home 27.9
man 27.5
couple 24.4
room 23.1
male 22.8
adult 22.5
family 22.2
indoors 22
happiness 21.1
smiling 18.8
happy 18.8
salon 18.6
case 18.4
sick person 17.7
hospital 17.5
nurse 17.5
love 16.6
groom 16.5
women 15.8
together 15.8
sitting 15.5
men 15.5
lifestyle 15.2
mother 15.1
dress 13.5
two 13.5
couch 13.5
bride 13.4
interior 13.3
senior 13.1
mature 13
cheerful 13
husband 12.4
chair 11.7
kin 11.6
married 11.5
meeting 11.3
wedding 11
life 11
indoor 11
house 10.9
smile 10.7
bouquet 10.5
marriage 10.4
child 10.4
holiday 10
fashion 9.8
old 9.7
portrait 9.7
celebration 9.6
teacher 9.5
wife 9.5
classroom 9.4
business 9.1
lady 8.9
romantic 8.9
medical 8.8
table 8.7
talking 8.5
father 8.4
health 8.3
20s 8.2
new 8.1
suit 8.1
daughter 8.1
brown hair 7.8
professional 7.8
two people 7.8
elderly 7.7
adults 7.6
elegance 7.6
togetherness 7.5
care 7.4
inside 7.4
office 7.3
group 7.3
aged 7.2
team 7.2
shop 7.1
romance 7.1
work 7.1
face 7.1
day 7.1
modern 7

Google
created on 2022-01-08

Table 88.2
Style 83.8
Adaptation 79.3
Vintage clothing 72.8
Event 72.6
Room 70.7
Monochrome 70.7
Monochrome photography 70.1
Art 69.8
Sitting 66.9
Photo caption 65.6
History 65.6
Chair 64.6
Stock photography 64.4
Child 53.8
Picture frame 52.4
Retro style 50.5
Class 50.1

Microsoft
created on 2022-01-08

text 98.9
indoor 97.9
wedding dress 97.6
wall 96.8
person 96.4
bride 94.7
dress 94.3
clothing 93.5
woman 92
wedding 69.1
man 67.8
people 62.1
group 58.4
furniture 50.7
several 12.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 94.1%
Sad 4.3%
Calm 0.8%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 36-44
Gender Female, 100%
Calm 64.2%
Sad 24.8%
Fear 5.5%
Angry 1.4%
Confused 1.3%
Disgusted 1.1%
Happy 0.9%
Surprised 0.8%

AWS Rekognition

Age 33-41
Gender Female, 99.9%
Calm 87.7%
Angry 4.7%
Surprised 3.3%
Disgusted 2%
Confused 0.6%
Happy 0.6%
Sad 0.6%
Fear 0.5%

AWS Rekognition

Age 27-37
Gender Female, 99.1%
Happy 99.7%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Calm 0%
Fear 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 14-22
Gender Female, 94.2%
Confused 38.9%
Calm 16.6%
Sad 16.5%
Fear 10.5%
Surprised 8.3%
Disgusted 4.7%
Angry 4%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Female, 50.4%
Calm 63%
Surprised 13.4%
Sad 11.7%
Confused 4.8%
Fear 3.2%
Disgusted 2.2%
Happy 1.1%
Angry 0.5%

AWS Rekognition

Age 23-33
Gender Female, 77%
Happy 93.6%
Calm 4.6%
Surprised 0.7%
Confused 0.4%
Angry 0.2%
Fear 0.2%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 55%
Calm 18.5%
Sad 6.3%
Disgusted 6.1%
Surprised 5%
Angry 3.3%
Fear 3.2%
Confused 2.7%

AWS Rekognition

Age 38-46
Gender Female, 100%
Happy 30.4%
Confused 26.7%
Surprised 13.9%
Calm 9%
Angry 6.8%
Fear 6.1%
Disgusted 4%
Sad 3.1%

AWS Rekognition

Age 23-33
Gender Female, 96.9%
Calm 93.6%
Sad 3.3%
Happy 1.2%
Angry 0.5%
Confused 0.5%
Surprised 0.4%
Disgusted 0.4%
Fear 0.2%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 64.1%

Captions

Microsoft

a group of people sitting in a room 93.4%
a group of people in a room 93.3%
a group of people sitting at a table 83.9%

Text analysis

Amazon

Home
Pupperware Home Parlies
Parlies
Pupperware

Google

STERDOTEND Tapperwur Home fårlies
STERDOTEND
Tapperwur
Home
fårlies