Human Generated Data

Title

Untitled (small group standing around birthday cake)
Date

1950
People

Artist: Hamblin Studio, American active 1930s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2047

Human Generated Data

Title

Untitled (small group standing around birthday cake)

People

Artist: Hamblin Studio, American active 1930s

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2047

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.4
Human 99.4
Person 99.2
Person 99.2
Person 99.2
Person 98.9
Person 98.8
Clothing 98.7
Apparel 98.7
Person 97.7
Person 96.6
People 92.1
Shoe 81.9
Footwear 81.9
Tablecloth 79
Table 72.5
Furniture 72.5
Tie 67.4
Accessories 67.4
Accessory 67.4
Photography 66.9
Photo 66.9
Portrait 66
Face 66
Suit 64.2
Coat 64.2
Overcoat 64.2
Crowd 59.4
Gown 56.5
Fashion 56.5
Robe 56.1

Clarifai
created on 2023-10-25

people 99.8
group 99.7
woman 98
group together 96.6
man 95.8
adult 95.4
education 94
actor 93.6
leader 92.9
child 91.7
many 86.5
family 86.2
teacher 81
presentation 80.8
music 80.7
indoors 80
school 79.9
partnership 78.2
interaction 78.1
dress 75.2

Imagga
created on 2021-12-14

man 39.7
male 38.3
people 36.3
business 35.2
businessman 34.4
meeting 33.9
teacher 32.6
person 32.4
professional 32.1
office 30.7
group 29.8
team 29.6
adult 28.9
teamwork 27.8
happy 27.6
corporate 25.8
men 25.8
executive 25.3
businesswoman 24.5
women 24.5
table 24.2
room 23.1
work 22.8
sitting 22.3
smiling 21.7
job 20.4
worker 19.9
outfit 19
together 18.4
educator 18.2
communication 17.6
conference 17.6
couple 17.4
boss 17.2
businesspeople 17.1
manager 16.8
indoors 16.7
smile 16.4
portrait 16.2
life 16.1
successful 15.6
modern 15.4
musical instrument 15.4
success 15.3
talking 15.2
desk 15.1
presentation 14.9
suit 14.4
marimba 13.6
colleagues 13.6
home 13.6
ethnic 13.3
mature 13
classroom 13
lifestyle 13
laptop 12.8
two 12.7
percussion instrument 12.6
diversity 12.5
employee 12.5
interior 12.4
working 12.4
standing 12.2
holding 11.6
partnership 11.5
education 11.3
company 11.2
chair 10.4
career 10.4
happiness 10.2
training 10.2
finance 10.1
confident 10
board 10
coworkers 9.8
diverse 9.8
cheerful 9.8
teaching 9.7
indoor 9.1
hall 9.1
family 8.9
student 8.9
seminar 8.9
computer 8.8
partner 8.7
leader 8.7
staff 8.6
togetherness 8.5
ideas 8.4
study 8.4
attractive 8.4
phone 8.3
building 8.2
new 8.1
handsome 8
looking 8
casual clothing 7.8
40s 7.8
cooperation 7.7
class 7.7
pretty 7.7
30s 7.7
drinking 7.7
clothing 7.6
casual 7.6
workplace 7.6
enjoying 7.6
smart 7.5
groom 7.5
director 7.5
hospital 7.4
color 7.2
day 7.1

Google
created on 2021-12-14

Black 89.5
Dress 87.3
Table 84.9
Art 83.3
Suit 83
People 78.4
Painting 76
Monochrome 74
Monochrome photography 71.8
Rectangle 71.1
Room 69.1
Event 68.5
Vintage clothing 65.3
Classic 64.4
Font 63.1
Chair 62.6
Stock photography 62.5
Illustration 61
History 59.5
Visual arts 59.2

Microsoft
created on 2021-12-14

person 97.1
clothing 95.8
wedding dress 95.3
dress 92.8
text 90.2
bride 89.8
woman 89.6
standing 82.8
posing 81
people 57.5
old 51.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 15-27
Gender Female, 56.2%
Calm 29.7%
Happy 23.4%
Surprised 22%
Confused 11.9%
Sad 9.5%
Angry 1.7%
Fear 1.1%
Disgusted 0.8%

AWS Rekognition

Age 22-34
Gender Male, 69.6%
Calm 50.8%
Happy 22.1%
Sad 19.1%
Surprised 3.6%
Confused 2.8%
Fear 1%
Angry 0.4%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 96.6%
Calm 97.8%
Sad 1.2%
Happy 0.4%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 48-66
Gender Male, 84.6%
Calm 75.7%
Sad 15.7%
Happy 5.6%
Confused 1.8%
Surprised 0.7%
Angry 0.3%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 30-46
Gender Male, 85%
Calm 55.2%
Sad 27.1%
Angry 8.2%
Happy 3.6%
Surprised 3.3%
Confused 1.7%
Fear 0.5%
Disgusted 0.5%

AWS Rekognition

Age 22-34
Gender Male, 55.9%
Calm 72.6%
Sad 10.8%
Happy 10%
Confused 2.8%
Surprised 2.2%
Angry 0.8%
Fear 0.6%
Disgusted 0.3%

AWS Rekognition

Age 8-18
Gender Female, 63.9%
Calm 73.7%
Happy 15%
Sad 9.4%
Surprised 0.8%
Confused 0.4%
Fear 0.3%
Angry 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Tie
Person 99.4%
Person 99.2%
Person 99.2%
Person 99.2%
Person 98.9%
Person 98.8%
Person 97.7%
Person 96.6%
Shoe 81.9%
Tie 67.4%

Categories

Imagga

people portraits 82.3%
interior objects 8.7%
paintings art 4.7%
events parties 2.3%