Human Generated Data

Title

Untitled (group portrait of Yakima Valley Sports Women)
Date

c. 1970
People

Artist: Ken Whitmire Associates, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12356

Human Generated Data

Title

Untitled (group portrait of Yakima Valley Sports Women)

People

Artist: Ken Whitmire Associates, American

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.5
Human 99.5
Person 99.1
Person 99.1
Person 99
Person 99
Person 98.9
Person 98.8
Person 98.3
Person 97.8
Person 96.6
Person 95.6
Person 94.9
Crowd 93.9
People 92.4
Person 92.1
Glasses 91.2
Accessories 91.2
Accessory 91.2
Face 86.8
Audience 78.5
Glasses 74.3
Glasses 71.8
Performer 67.5
Apparel 66.3
Clothing 66.3
Family 59.3
Glasses 54.9
Glasses 50

Imagga
created on 2022-01-22

kin 100
golfer 42.9
group 38.7
happy 35.1
people 34
smiling 34
player 33.3
man 32.3
male 31.3
person 30.9
family 29.3
together 27.2
contestant 25.5
adult 25.2
happiness 23.5
team 23.3
mother 22.8
smile 22.8
portrait 22.6
men 22.3
couple 21.8
women 21.4
lifestyle 18.8
30s 18.3
child 17.9
businesswoman 17.3
father 16.6
daughter 16.4
business 16.4
cheerful 16.3
love 15.8
boy 15.6
attractive 15.4
home 15.2
friends 15
children 14.6
businessman 14.1
senior 14.1
teamwork 13.9
looking 13.6
businesspeople 13.3
holding 13.2
indoors 13.2
son 12.6
standing 12.2
office 12
professional 11.8
colleagues 11.7
fun 11.2
youth 11.1
20s 11
successful 11
girls 10.9
thirties 10.7
husband 10.6
job 10.6
diversity 10.6
doctor 10.3
school 9.9
classroom 9.8
nurse 9.8
40s 9.7
success 9.7
teacher 9.6
wife 9.5
corporate 9.5
friendship 9.4
casual 9.3
camera 9.2
face 9.2
executive 9.2
horizontal 9.2
room 9
kid 8.9
working 8.8
education 8.7
partnership 8.6
four 8.6
buddy 8.5
meeting 8.5
kids 8.5
two 8.5
parent 8.5
brother 8.4
color 8.3
care 8.2
confident 8.2
suit 8.1
medical 7.9
coworkers 7.9
forties 7.8
parents 7.8
students 7.8
sitting 7.7
life 7.7
looking camera 7.7
pretty 7.7
generation 7.7
elderly 7.7
adults 7.6
uniform 7.5
clothing 7.5
mature 7.4
teen 7.3
indoor 7.3
new 7.3
interior 7.1
work 7.1
medicine 7

Google
created on 2022-01-22

Outerwear 95.1
Photograph 94.2
Facial expression 93.2
Smile 92.5
Black 89.6
Human 89.1
Coat 85.3
Suit 77.4
Font 76.9
Vintage clothing 76.6
Snapshot 74.3
Crew 74.2
Event 73.5
Monochrome 67.9
History 66.8
Stock photography 65.5
Team 63.7
Fun 58.7
Guitar 56.2
Musical instrument 55.3

Microsoft
created on 2022-01-22

person 99.9
posing 99.9
smile 98.9
human face 98.8
group 98.6
clothing 97.4
text 89.1
man 81.7
standing 81.3
people 80.6
woman 73.4
black and white 62.4
crowd 0.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Female, 100%
Confused 88.4%
Disgusted 5.6%
Calm 2.2%
Happy 1.3%
Angry 1.3%
Surprised 0.5%
Fear 0.4%
Sad 0.4%

AWS Rekognition

Age 64-74
Gender Female, 99.8%
Calm 86.8%
Happy 5.7%
Disgusted 3.2%
Confused 2%
Angry 0.8%
Sad 0.7%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 53-61
Gender Female, 98.9%
Happy 87.8%
Fear 2.9%
Surprised 2.8%
Calm 1.7%
Confused 1.6%
Disgusted 1.4%
Angry 1.3%
Sad 0.6%

AWS Rekognition

Age 49-57
Gender Female, 93.7%
Happy 99.5%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Surprised 0.1%
Calm 0.1%

AWS Rekognition

Age 27-37
Gender Female, 99.8%
Happy 85.2%
Calm 8.6%
Confused 1.4%
Surprised 1.3%
Angry 1.2%
Disgusted 0.9%
Fear 0.8%
Sad 0.7%

AWS Rekognition

Age 50-58
Gender Female, 99.9%
Happy 99.4%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Calm 0%

AWS Rekognition

Age 57-65
Gender Female, 100%
Calm 39.5%
Happy 30.3%
Sad 9%
Disgusted 7.8%
Fear 5.4%
Confused 3.3%
Surprised 3%
Angry 1.8%

AWS Rekognition

Age 54-64
Gender Female, 83.9%
Calm 65.6%
Happy 26%
Disgusted 1.8%
Confused 1.7%
Angry 1.5%
Sad 1.4%
Surprised 1.3%
Fear 0.6%

AWS Rekognition

Age 52-60
Gender Female, 99.9%
Happy 97.4%
Disgusted 0.7%
Confused 0.5%
Surprised 0.3%
Calm 0.3%
Fear 0.3%
Angry 0.3%
Sad 0.2%

AWS Rekognition

Age 50-58
Gender Female, 100%
Happy 97.5%
Disgusted 1.1%
Calm 0.6%
Confused 0.4%
Surprised 0.2%
Angry 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 65-75
Gender Female, 100%
Happy 95.3%
Calm 1.3%
Disgusted 0.8%
Angry 0.5%
Surprised 0.5%
Sad 0.5%
Fear 0.5%
Confused 0.5%

AWS Rekognition

Age 54-64
Gender Female, 100%
Surprised 83.8%
Happy 4.3%
Calm 4%
Confused 2.5%
Disgusted 2.5%
Fear 1.4%
Angry 1%
Sad 0.5%

AWS Rekognition

Age 52-60
Gender Male, 99.8%
Happy 98.9%
Disgusted 0.4%
Calm 0.2%
Confused 0.2%
Sad 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 69
Gender Female

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 50
Gender Female

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 59
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 61
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Glasses 91.2%

Captions

Microsoft

a group of people posing for a photo 99.4%
a group of people posing for the camera 99.3%
a group of people posing for a picture 99.2%