Human Generated Data

Title

Untitled (montage of portraits)

Date

c. 1964

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.643

Human Generated Data

Title

Untitled (montage of portraits)

People

Artist: Claseman Studio, American 20th century

Date

c. 1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Face 99
Human 99
Person 98
Person 97.8
Head 97
Advertisement 96.3
Poster 96.3
Collage 96.3
Accessories 95.2
Accessory 95.2
Glasses 95.2
Person 94.6
Person 93.9
Glasses 93.6
Person 92.4
Jaw 90.4
Person 86.3
Person 86.3
Boy 84.1
Smile 84
Person 83.6
Person 78.8
Person 75.5
Female 72.6
People 72.5
Hair 72.2
Photo 67.8
Portrait 67.8
Photography 67.8
Girl 65.3
Kid 64.1
Child 64.1
Teen 59.8

Imagga
created on 2022-01-09

sibling 65
mother 48.3
family 48.1
smiling 46.4
happy 45.9
people 44.2
child 43.5
father 40.2
boy 39.7
group 37.2
happiness 36.9
together 35.1
man 33.8
children 32.9
portrait 32.4
smile 32.1
male 31.7
grandfather 31.1
brother 26.9
cheerful 26.1
kid 25.8
parent 25.4
son 25
daughter 24.8
love 24.5
dad 23.7
person 23.1
childhood 22.4
cute 22.3
casual 21.2
adult 20.7
fun 20.3
parents 19.6
little 19.5
togetherness 18.9
looking 18.4
women 17.4
lifestyle 17.4
joy 16.7
mom 16.5
friends 16
girls 15.5
men 15.5
youth 15.4
studio 15.2
kids 15.1
relationship 15
couple 14.8
team 14.4
human 14.3
holding 14.1
pretty 14
generation 13.5
horizontal 13.4
home 12.8
sister 12.7
four 12.5
senior 12.2
friendship 12.2
offspring 12.1
teamwork 12.1
two 11.9
boys 11.7
hug 11.6
standing 11.3
kin 11.3
camera 11.1
face 10.7
infant 10.6
attractive 10.5
laughing 10.4
sitting 10.3
buddy 10.3
baby 9.8
parenthood 9.8
wife 9.5
expression 9.4
three 9.3
mature 9.3
20s 9.2
lady 8.9
handsome 8.9
mum 8.8
husband 8.7
education 8.7
females 8.5
business 8.5
modern 8.4
adorable 8.3
teen 8.3
joyful 8.3
teenager 8.2
businesswoman 8.2
life 8.2
to 8
hands 7.8
students 7.8
colleagues 7.8
affectionate 7.8
corporate 7.7
elderly 7.7
toddler 7.7
loving 7.6
adults 7.6
positive 7.4
businessman 7.1
indoors 7

Google
created on 2022-01-09

Face 98.4
Smile 98.4
Nose 98.4
Hair 98.3
Head 97.2
Chin 96.8
Hairstyle 95.1
Eyebrow 94.7
Photograph 94.3
Facial expression 93.3
White 92.2
Human 90.2
Jaw 88.3
Happy 87.4
Font 80
People 78.4
Beauty 74.9
Snapshot 74.3
Sharing 69.5
Event 68.5

Microsoft
created on 2022-01-09

wall 100
person 99.8
human face 98.4
smile 98.4
posing 97.7
group 95.5
child 95.3
baby 93.6
boy 92.7
toddler 89.1
indoor 86.7
clothing 85.3
text 59.8
team 33.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 99.7%
Happy 99.4%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Sad 0.1%
Fear 0.1%
Calm 0%

AWS Rekognition

Age 9-17
Gender Female, 88.4%
Calm 86.2%
Happy 8.2%
Confused 1.9%
Surprised 1.4%
Angry 0.9%
Sad 0.7%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 0-3
Gender Female, 75.7%
Happy 99%
Confused 0.2%
Calm 0.2%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 9-17
Gender Female, 57.9%
Happy 99.8%
Confused 0.1%
Surprised 0.1%
Calm 0%
Disgusted 0%
Angry 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Calm 98.1%
Angry 0.5%
Confused 0.4%
Sad 0.4%
Happy 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 99.9%
Happy 98.8%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%
Angry 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 38-46
Gender Female, 99.6%
Happy 56.7%
Fear 16.2%
Surprised 7.7%
Calm 6.2%
Confused 6%
Disgusted 3.3%
Angry 2.4%
Sad 1.6%

AWS Rekognition

Age 2-8
Gender Male, 91.3%
Calm 92.2%
Surprised 4.4%
Confused 1.4%
Fear 0.6%
Sad 0.4%
Angry 0.4%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 41-49
Gender Male, 95.5%
Calm 53.2%
Happy 13.4%
Disgusted 9%
Confused 7.7%
Surprised 4.6%
Fear 4.6%
Angry 3.8%
Sad 3.8%

AWS Rekognition

Age 2-10
Gender Female, 99.7%
Happy 99.4%
Disgusted 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Calm 0.1%
Sad 0.1%
Fear 0%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Glasses 95.2%

Captions

Microsoft

a group of people posing for a photo 97.2%
a group of people posing for the camera 97.1%
a group of kids posing for a photo 90.8%