Human Generated Data

Title

Untitled (Jeffrey Gamache family portrait)

Date

c. 1970

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1365

Human Generated Data

Title

Untitled (Jeffrey Gamache family portrait)

People

Artist: Ken Whitmire Associates, American

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Person 99.4
Person 99.3
Person 98.9
Family 98.4
People 98.4
Person 97.9
Person 97.8
Person 97.7
Person 97.2
Clothing 96.9
Apparel 96.9
Person 94
Person 92.7
Person 89.7
Person 84.1
Person 83
Person 82.9
Person 82
Person 80.8
Female 76.7
Shoe 75
Footwear 75
Person 74.6
Person 74.4
Person 63
Stage 60.7
Woman 56.6
Gown 55.9
Fashion 55.9
Evening Dress 55.2
Robe 55.2

Imagga
created on 2022-01-22

person 37.7
people 37.4
group 36.3
teacher 33.7
smiling 32.5
professional 31.2
student 30
child 29.7
men 28.3
adult 27.8
male 27.1
happy 26.9
women 26.9
man 26.9
smile 25.6
team 24.2
educator 20.8
businessman 19.4
standing 19.1
friends 17.8
business 17.6
together 17.5
family 16.9
kin 16.8
room 16.6
portrait 16.2
holding 15.7
couple 15.7
boy 15.6
enrollee 15.1
classroom 14.8
cheerful 14.6
mother 13.7
nurse 13.6
staff 13.4
lifestyle 13
teamwork 13
party 12.9
doctor 12.2
education 12.1
casual 11.9
two 11.9
businesswoman 11.8
happiness 11.8
life 11.2
fun 11.2
looking 11.2
pretty 11.2
attractive 11.2
home 11.2
love 11
work 11
father 10.8
school 10.8
workers 10.7
worker 10.7
medical 10.6
success 10.5
girls 10
confident 10
colleagues 9.7
medicine 9.7
hospital 9.5
buddy 9.4
three 9.3
executive 9.2
center 9.2
occupation 9.2
suit 9
son 8.9
job 8.9
students 8.8
30s 8.7
expression 8.5
friendship 8.4
friendly 8.2
teenager 8.2
children 8.2
dress 8.1
groom 8.1
handsome 8
kid 8
working 8
indoors 7.9
daughter 7.9
parents 7.8
businessmen 7.8
employment 7.7
corporate 7.7
sitting 7.7
diversity 7.7
parent 7.7
reading 7.6
females 7.6
joy 7.5
learning 7.5
office 7.2
black 7.2

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 100
posing 100
group 99.6
clothing 99.5
smile 99.3
woman 95.9
standing 94.5
team 87.5
human face 87.3
footwear 85
dress 76.4
people 73
man 70.8
dressed 26

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 98.8%
Surprised 0.5%
Calm 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Female, 99.9%
Happy 99.9%
Surprised 0.1%
Calm 0%
Confused 0%
Angry 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 13-21
Gender Female, 99%
Happy 99.6%
Calm 0.2%
Sad 0.1%
Surprised 0.1%
Confused 0%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Happy 99.9%
Surprised 0%
Angry 0%
Calm 0%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Female, 100%
Happy 99.7%
Surprised 0.1%
Calm 0%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 29-39
Gender Female, 100%
Happy 99.7%
Surprised 0.1%
Fear 0.1%
Angry 0.1%
Confused 0%
Calm 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 99.6%
Surprised 0.1%
Angry 0.1%
Calm 0.1%
Fear 0%
Sad 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Happy 98.7%
Calm 0.6%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-53
Gender Female, 100%
Happy 99.8%
Surprised 0%
Confused 0%
Fear 0%
Calm 0%
Sad 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Female, 100%
Happy 99.4%
Surprised 0.2%
Calm 0.2%
Angry 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 23-31
Gender Male, 99.1%
Happy 99.5%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Calm 0.1%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 43-51
Gender Female, 99.6%
Happy 99.9%
Surprised 0%
Angry 0%
Calm 0%
Fear 0%
Confused 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Male, 100%
Happy 78.4%
Calm 8.5%
Confused 5.1%
Angry 2.6%
Fear 1.8%
Sad 1.7%
Surprised 1.4%
Disgusted 0.5%

AWS Rekognition

Age 58-66
Gender Female, 100%
Happy 99.8%
Angry 0.1%
Surprised 0%
Fear 0%
Calm 0%
Disgusted 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 20-28
Gender Female, 100%
Happy 99.9%
Surprised 0%
Angry 0%
Confused 0%
Calm 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 98.1%
Happy 99.8%
Calm 0%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-37
Gender Male, 100%
Happy 94.8%
Calm 2.3%
Angry 0.6%
Surprised 0.6%
Confused 0.5%
Sad 0.5%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 31-41
Gender Female, 100%
Happy 99.9%
Surprised 0%
Calm 0%
Confused 0%
Angry 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 41-49
Gender Male, 98.7%
Happy 97.8%
Surprised 1.5%
Calm 0.3%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Sad 0%

AWS Rekognition

Age 56-64
Gender Male, 100%
Happy 88.6%
Calm 7.3%
Confused 0.9%
Sad 0.7%
Surprised 0.7%
Disgusted 0.7%
Fear 0.6%
Angry 0.5%

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 69
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 75%

Captions

Microsoft

a group of people posing for a photo 98.9%
a group of people posing for the camera 98.8%
a group of people posing for a picture 98.7%

Text analysis

Amazon

Whitmine
Kon Whitmine
Associates
Kon