Human Generated Data

Title

Untitled (men and women in bright pink vests and dresses)
Date

1972
People

Artist: Ken Whitmire Associates, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1362

Human Generated Data

Title

Untitled (men and women in bright pink vests and dresses)

People

Artist: Ken Whitmire Associates, American

Date

1972

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.6
Person 99.6
Person 99.6
Person 99.5
Person 99.4
Person 99.3
Person 99.3
Person 99.2
Person 99.1
Clothing 98.2
Apparel 98.2
Female 95.9
Person 95.5
Wood 94.9
Leisure Activities 88.3
Dance Pose 88.3
Skirt 87.7
Flooring 85.2
Stage 85.2
Hardwood 83.9
Dress 81.6
Person 81.5
Floor 81.3
Person 80.3
Person 79.9
Girl 77.4
Furniture 76.7
Chair 76.7
Woman 75.3
Person 69.9
Shoe 69.2
Footwear 69.2
People 66.8
Accessories 63.3
Tie 63.3
Accessory 63.3
Dance 62.9
Shoe 62.5
Tie 54.4

Imagga
created on 2022-01-22

person 37
people 36.8
child 34.8
dancer 33.7
happy 31.9
group 31.4
smiling 30.4
performer 28.2
adult 25.4
portrait 24.6
women 23.7
man 23.5
smile 23.5
team 21.5
professional 21.5
together 20.1
male 19.8
hospital 19.5
cheerful 19.5
nurse 19.3
children 19.1
teacher 19
entertainer 19
room 19
happiness 18.8
friends 18.8
classroom 18
fun 17.2
ocarina 17.1
lifestyle 15.9
men 15.4
school 15.3
wind instrument 14.8
childhood 14.3
family 14.2
student 13.8
looking 13.6
clothing 13.6
casual 13.6
holding 13.2
couple 13.1
home 12.8
girls 12.8
educator 12.4
businessman 12.4
cute 12.2
mother 12
pretty 11.9
work 11.8
kid 11.5
standing 11.3
kids 11.3
boy 11.3
attractive 11.2
teamwork 11.1
musical instrument 11
two 11
joy 10.9
dress 10.8
little 10.6
fashion 10.5
indoors 10.5
doctor 10.3
business 10.3
friendship 10.3
love 10.2
20s 10.1
leisure 10
worker 9.9
blond 9.9
education 9.5
laughing 9.4
meeting 9.4
daughter 9.4
human 9
job 8.8
medical 8.8
day 8.6
sitting 8.6
face 8.5
color 8.3
health 8.3
traditional 8.3
camera 8.3
businesswoman 8.2
suit 8.1
building 8
play 7.8
diversity 7.7
father 7.7
expression 7.7
youth 7.7
staff 7.6
husband 7.6
player 7.6
uniform 7.6
adults 7.6
elegance 7.5
drink 7.5
clothes 7.5
three 7.4
executive 7.4
exercise 7.3
golfer 7.2
life 7.1
medicine 7

Google
created on 2022-01-22

Entertainment 86.5
Pink 84.6
Music 84.4
Recital 80
Performing arts 79.4
Magenta 77
Choir 75.3
Smile 75.2
Event 74.6
Curtain 73.1
Uniform 72
Team 67.6
Performance art 63.3
Performance 62.1
Public event 59.7
Competition 57.5
Concert 57.3
Child 56.4
Stage 55.9
heater 55.6

Microsoft
created on 2022-01-22

person 100
posing 99.5
sport 99.4
girl 98.1
group 97.5
floor 96.4
dress 96.3
dance 95.4
dancer 92.5
clothing 92.2
indoor 89.4
footwear 80.8
standing 79.3
little 76.2
skirt 54.1
dressed 45
team 40.1
family 22.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Female, 100%
Happy 99.7%
Surprised 0.1%
Calm 0.1%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 28-38
Gender Female, 100%
Happy 99.6%
Surprised 0.2%
Fear 0.1%
Angry 0%
Sad 0%
Calm 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 36-44
Gender Female, 100%
Happy 98.5%
Surprised 0.6%
Fear 0.3%
Calm 0.2%
Confused 0.2%
Angry 0.1%
Sad 0.1%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Female, 100%
Calm 96.2%
Surprised 1%
Happy 0.6%
Angry 0.6%
Confused 0.6%
Sad 0.5%
Fear 0.3%
Disgusted 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 59.2%
Happy 32.8%
Surprised 2.5%
Angry 1.6%
Fear 1.3%
Sad 1%
Confused 1%
Disgusted 0.6%

AWS Rekognition

Age 57-65
Gender Female, 100%
Happy 95.2%
Fear 1.6%
Calm 1.5%
Surprised 0.7%
Disgusted 0.3%
Angry 0.3%
Sad 0.2%
Confused 0.2%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Happy 99.1%
Calm 0.3%
Confused 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 47-53
Gender Male, 96.4%
Happy 97.7%
Surprised 0.6%
Fear 0.6%
Angry 0.3%
Confused 0.2%
Sad 0.2%
Calm 0.2%
Disgusted 0.2%

AWS Rekognition

Age 34-42
Gender Female, 100%
Happy 99.9%
Surprised 0%
Angry 0%
Confused 0%
Calm 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 37-45
Gender Male, 100%
Happy 91.6%
Surprised 3%
Calm 2.7%
Angry 0.7%
Fear 0.7%
Sad 0.5%
Confused 0.4%
Disgusted 0.4%

AWS Rekognition

Age 49-57
Gender Female, 100%
Happy 99.3%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Fear 0.1%
Calm 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 54-62
Gender Male, 99.8%
Happy 98.4%
Surprised 0.4%
Confused 0.4%
Calm 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 49-57
Gender Female, 100%
Happy 60.8%
Surprised 12.4%
Angry 7.3%
Disgusted 6.8%
Calm 5.9%
Fear 2.5%
Confused 2.4%
Sad 1.9%

AWS Rekognition

Age 48-56
Gender Male, 99.9%
Happy 98.3%
Calm 0.5%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Sad 0.1%

AWS Rekognition

Age 45-51
Gender Male, 88.6%
Happy 99.8%
Surprised 0.1%
Fear 0%
Confused 0%
Calm 0%
Disgusted 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 50-58
Gender Male, 99.3%
Calm 83.9%
Angry 9.9%
Happy 2.3%
Surprised 1.4%
Confused 0.8%
Fear 0.8%
Sad 0.6%
Disgusted 0.3%

AWS Rekognition

Age 58-66
Gender Female, 100%
Happy 98.9%
Surprised 0.3%
Angry 0.2%
Fear 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Calm 0.1%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 78%
Happy 6.7%
Confused 4.8%
Angry 3.8%
Surprised 2.9%
Fear 1.5%
Sad 1.5%
Disgusted 0.8%

AWS Rekognition

Age 53-61
Gender Male, 100%
Happy 99.8%
Surprised 0.1%
Calm 0.1%
Confused 0%
Fear 0%
Angry 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 48-54
Gender Male, 98%
Calm 91.4%
Confused 2.9%
Angry 2.9%
Fear 0.8%
Surprised 0.6%
Happy 0.5%
Sad 0.5%
Disgusted 0.4%

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 63
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 69.2%
Tie 63.3%

Captions

Microsoft

a group of people posing for a photo 98%
a group of people standing next to a little girl posing for a photo 86.8%
a group of people posing for the camera 86.7%