Human Generated Data

Title

Untitled (woman and boy with bar mitzvah cake)
Date

c. 1950
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21583

Human Generated Data

Title

Untitled (woman and boy with bar mitzvah cake)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.7
Human 99.7
Person 98.9
Person 98.3
Person 94
Person 80.5
Clothing 76.1
Apparel 76.1
People 61.1
Interior Design 60.6
Indoors 60.6
Female 57

Imagga
created on 2022-03-05

teacher 72.1
educator 52.9
professional 40.7
adult 39.3
man 32.9
person 32.8
people 32.3
male 26.9
couple 25.2
sitting 21.5
indoors 20.2
senior 19.7
smiling 18.8
happy 18.8
happiness 17.2
businessman 16.8
men 16.3
two 16.1
marimba 15.8
cheerful 15.4
home 15.1
together 14.9
women 14.2
business 14
table 13.8
waiter 13.7
office 13.6
colleagues 13.6
bride 13.4
room 13.3
musical instrument 13.3
holding 13.2
lifestyle 13
percussion instrument 12.9
worker 12.8
portrait 12.3
bouquet 12.3
meeting 12.2
mature 12.1
team 11.6
old 11.1
teamwork 11.1
camera 11.1
wedding 11
day 11
classroom 10.7
elderly 10.5
executive 10.5
indoor 10
groom 10
suit 9.9
mid adult 9.6
looking 9.6
husband 9.5
education 9.5
enjoying 9.5
desk 9.4
work 9.4
dress 9
group 8.9
coworkers 8.8
working 8.8
blackboard 8.7
love 8.7
30s 8.7
dining-room attendant 8.6
married 8.6
drinking 8.6
smile 8.5
businesspeople 8.5
wife 8.5
face 8.5
friends 8.4
enjoyment 8.4
color 8.3
student 8.3
fashion 8.3
life 8
celebration 8
interior 8
teaching 7.8
retirement 7.7
talking 7.6
coat 7.5
church 7.4
laptop 7.3
employee 7.2
family 7.1
to 7.1

Google
created on 2022-03-05

Hairstyle 95.1
Table 90.8
Black-and-white 86
Style 83.9
Tablecloth 77.8
Monochrome photography 77.3
Monochrome 76.6
Event 71
Vintage clothing 69
Room 68.8
Stock photography 65.1
Picture frame 65
Sitting 63.6
T-shirt 61
Fashion design 58.8
Cooking 58.4
History 56.1
Uniform 50.8

Microsoft
created on 2022-03-05

person 99.3
clothing 93.4
woman 80.7
black and white 62.5

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 99%
Happy 40.1%
Angry 37.7%
Surprised 6.9%
Fear 5.1%
Sad 3.6%
Disgusted 3%
Calm 2.8%
Confused 0.7%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 62.7%
Happy 11.2%
Surprised 11.1%
Confused 5.7%
Angry 3.4%
Disgusted 3%
Sad 2.2%
Fear 0.7%

AWS Rekognition

Age 54-64
Gender Male, 91.8%
Sad 33%
Calm 32.3%
Happy 23.9%
Confused 4.2%
Angry 2.5%
Disgusted 2.1%
Fear 1.2%
Surprised 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man and a woman standing in front of a cake 83%
a man and a woman standing in front of a wedding cake 75.8%
a group of people standing in front of a cake 75.7%