Human Generated Data

Title

Untitled (group of six in party hats raising a toast)

Date

1933

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2111

Human Generated Data

Title

Untitled (group of six in party hats raising a toast)

People

Artist: Hamblin Studio, American active 1930s

Date

1933

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Apparel 98.6
Clothing 98.6
Person 98.5
Human 98.5
Person 97.9
Person 96.7
Person 96.2
Person 95
Person 94.5
Person 93.9
Person 92.1
Accessory 88.1
Tie 88.1
Accessories 88.1
Home Decor 84.4
Tablecloth 83
Table 73.8
Furniture 73.8
People 72.3
Food 71.6
Meal 71.6
Photography 67.4
Face 67.4
Portrait 67.4
Photo 67.4
Clinic 63.6
Indoors 62.2
Dining Table 59.3
Glass 56.2
Art 56.2
Drawing 56.2
Coat 56.2
Sleeve 55.8
Suit 55.5
Overcoat 55.5
Person 48

Imagga
created on 2021-12-14

people 33.5
person 29.1
man 27.5
professional 26.1
groom 25.8
nurse 24.8
adult 24.6
couple 24.4
bride 23.1
male 21.3
happy 20.7
wedding 19.3
men 18
businessman 17.7
women 17.4
teacher 17.3
business 17
dress 16.3
marriage 16.1
team 15.2
love 15
work 14.9
two 14.4
celebration 14.4
happiness 14.1
outfit 13.9
smiling 13.7
group 13.7
human 13.5
job 13.3
bouquet 13
flowers 13
teamwork 13
corporate 12.9
smile 12.8
worker 12.8
businesswoman 12.7
attractive 12.6
cheerful 12.2
clothing 12.2
room 12
educator 11.8
day 11.8
negative 11.6
ceremony 11.6
lifestyle 11.6
together 11.4
doctor 11.3
office 11.2
portrait 11
romance 10.7
medical 10.6
health 10.4
coat 10.4
meeting 10.4
film 10.2
holding 9.9
suit 9.9
modern 9.8
fashion 9.8
pretty 9.8
bridal 9.7
husband 9.7
medicine 9.7
indoors 9.7
home 9.6
table 9.5
businesspeople 9.5
wife 9.5
sitting 9.4
life 9.3
elegance 9.2
romantic 8.9
matrimony 8.9
standing 8.7
married 8.6
casual 8.5
lady 8.1
boutique 8
gown 8
interior 8
working 8
lab 7.8
party 7.7
old 7.7
talking 7.6
uniform 7.6
career 7.6
adults 7.6
executive 7.6
relationship 7.5
hospital 7.5
20s 7.3
color 7.2
photographic paper 7.2
handsome 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

wall 96.6
table 94.6
text 93.3
indoor 91.9
person 89.4
vase 81.5
clothing 80.8
candle 77.8
wedding dress 77.2
woman 72.1
wedding 70.8
furniture 69.7
wedding cake 57.5
room 52.6
posing 48.6
old 40.9
clothes 15.1

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Male, 88%
Calm 63.8%
Happy 31%
Confused 1.9%
Surprised 1.5%
Sad 1.1%
Angry 0.4%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 91.5%
Calm 73.1%
Sad 13.2%
Fear 5.7%
Surprised 2.6%
Angry 2.1%
Disgusted 1.6%
Happy 1.1%
Confused 0.6%

AWS Rekognition

Age 21-33
Gender Male, 56.8%
Angry 42.7%
Calm 38.8%
Happy 5.3%
Surprised 3.4%
Sad 2.8%
Fear 2.6%
Confused 2.3%
Disgusted 2.1%

AWS Rekognition

Age 35-51
Gender Male, 62%
Happy 94.6%
Calm 4.2%
Sad 0.7%
Surprised 0.2%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 26-40
Gender Male, 86.4%
Calm 35.5%
Disgusted 18.5%
Confused 12%
Angry 11.2%
Sad 11.2%
Happy 7.8%
Fear 2.2%
Surprised 1.6%

AWS Rekognition

Age 21-33
Gender Female, 63.2%
Sad 38.2%
Calm 36.8%
Angry 9%
Disgusted 5.9%
Surprised 5.3%
Happy 2.4%
Confused 2%
Fear 0.4%

AWS Rekognition

Age 22-34
Gender Male, 68.1%
Calm 34.9%
Sad 34%
Happy 10.7%
Surprised 9.3%
Confused 4.5%
Angry 2.4%
Fear 2.1%
Disgusted 2.1%

AWS Rekognition

Age 23-37
Gender Male, 68.8%
Happy 42.3%
Calm 41.7%
Sad 9.8%
Confused 3.1%
Angry 1.2%
Disgusted 0.9%
Fear 0.6%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Tie 88.1%
Suit 55.5%

Captions

Microsoft

a group of people posing for a photo 86.8%
a group of people standing in a room 86.7%
a group of people posing for the camera 86.6%