Human Generated Data

Title

Untitled (class reunion group portrait)

Date

c. 1970

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19811

Human Generated Data

Title

Untitled (class reunion group portrait)

People

Artist: Ken Whitmire Associates, American

Date

c. 1970

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19811

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.5
Human 99.5
Person 98.7
Person 98.7
Person 98.2
Person 97.9
Person 97.9
Person 97.3
Clothing 97.1
Apparel 97.1
Person 96.7
Person 96.2
Person 94.6
Person 91.6
Person 90.8
Person 90.3
Indoors 84.7
People 80.8
Bag 79.1
Room 79.1
Person 75.4
Kid 72.5
Child 72.5
Shorts 71.8
School 71.5
Person 70.5
Handbag 70.5
Accessories 70.5
Accessory 70.5
Person 70.4
Floor 68.7
Crowd 68.6
Dress 67.9
Person 66.9
Female 66.8
Classroom 66.7
Meal 62.4
Food 62.4
Person 62
Chair 57.3
Furniture 57.3
Girl 56.4
Face 56.1
Suit 55.7
Coat 55.7
Overcoat 55.7

Clarifai
created on 2023-10-22

people 99.9
education 99.4
many 99.2
child 99.1
group 99
school 97.8
group together 96.1
elementary school 95.6
man 94.4
boy 93.5
crowd 93.2
woman 92.2
adult 91.5
teacher 90.5
classroom 86.3
audience 86.1
music 85.2
adolescent 81.1
indoors 78.7
spectator 77.1

Imagga
created on 2022-03-05

people 32.9
person 27.2
man 26.9
stage 26.3
silhouette 24
group 22.6
couple 20.9
men 19.7
adult 19.7
platform 18.9
performer 17.4
outfit 17.1
male 17
business 16.4
crowd 16.3
happy 16.3
dancer 15.2
businessman 15
happiness 14.9
dance 14.6
women 14.2
musician 13.5
black 13.4
love 12.6
wind instrument 11.7
life 11.5
teacher 11.3
world 10.9
brass 10.8
musical instrument 10.8
dress 10.8
band 10.7
concert 10.7
bride 10.5
performance 10.5
together 10.5
human 10.5
art 10.5
music 10
entertainer 9.9
family 9.8
portrait 9.7
success 9.6
active 9.4
groom 9.3
fashion 9
design 9
fun 9
team 9
sport 8.9
boy 8.7
professional 8.6
party 8.6
spectator 8.5
two 8.5
dark 8.3
leisure 8.3
wedding 8.3
singer 8.3
activity 8.1
light 8
night 8
celebration 8
lifestyle 7.9
holiday 7.9
gymnasium 7.8
scene 7.8
dancing 7.7
attractive 7.7
youth 7.7
musical 7.7
classical 7.6
casual 7.6
style 7.4
competition 7.3
sunset 7.2
guitar 7.2

Google
created on 2022-03-05

Black 89.6
Crew 75.1
Team 73
Font 73
Monochrome photography 72.8
Monochrome 72
Event 71.2
Suit 70.4
Vintage clothing 69.1
Room 67.5
Stock photography 64.9
History 63.8
Crowd 61.8
Class 51.9

Microsoft
created on 2022-03-05

person 97.4
text 86.2
clothing 86
group 76.3
people 66.2
crowd 27.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Sad 99%
Calm 0.5%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 27-37
Gender Male, 98.7%
Sad 97.2%
Confused 1.3%
Angry 0.6%
Calm 0.3%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 36-44
Gender Male, 98.8%
Sad 49.1%
Calm 33.6%
Disgusted 12.5%
Fear 1.5%
Happy 1%
Confused 0.9%
Surprised 0.7%
Angry 0.7%

AWS Rekognition

Age 24-34
Gender Female, 88.2%
Happy 91.8%
Calm 6.3%
Sad 1.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Confused 44.9%
Surprised 15.8%
Sad 15.7%
Calm 15.3%
Happy 3.7%
Fear 1.9%
Disgusted 1.7%
Angry 1%

AWS Rekognition

Age 47-53
Gender Male, 99.1%
Sad 96.4%
Calm 2.5%
Confused 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 40-48
Gender Male, 97.7%
Sad 97%
Happy 1.3%
Confused 0.7%
Disgusted 0.4%
Calm 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 86.4%
Confused 87.9%
Sad 4.9%
Calm 4.2%
Disgusted 1.5%
Happy 0.5%
Surprised 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 35-43
Gender Female, 64.3%
Calm 44.5%
Sad 40.5%
Happy 6.9%
Angry 2.6%
Confused 1.6%
Fear 1.5%
Surprised 1.3%
Disgusted 1%

AWS Rekognition

Age 9-17
Gender Female, 73.5%
Confused 93.7%
Sad 3.2%
Surprised 1%
Calm 0.8%
Fear 0.5%
Angry 0.3%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 49-57
Gender Male, 54.3%
Happy 88.7%
Calm 4.2%
Sad 1.9%
Angry 1.4%
Disgusted 1.3%
Surprised 1.1%
Confused 0.7%
Fear 0.6%

AWS Rekognition

Age 31-41
Gender Male, 85.1%
Happy 82.2%
Calm 12.3%
Sad 3.1%
Confused 0.6%
Angry 0.6%
Disgusted 0.4%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 51-59
Gender Male, 86.5%
Calm 74.7%
Sad 9.3%
Fear 4%
Disgusted 3.7%
Angry 2.9%
Confused 2.8%
Happy 1.3%
Surprised 1.3%

AWS Rekognition

Age 24-34
Gender Female, 91.3%
Happy 39.8%
Confused 38.4%
Calm 10.2%
Fear 3.3%
Sad 3.1%
Surprised 2.4%
Angry 1.7%
Disgusted 1.1%

AWS Rekognition

Age 13-21
Gender Male, 87.4%
Sad 96.6%
Calm 1.3%
Angry 0.8%
Disgusted 0.5%
Fear 0.3%
Surprised 0.3%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 31-41
Gender Male, 98.4%
Happy 88.3%
Sad 7.5%
Calm 3%
Confused 0.5%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 23-31
Gender Male, 82.5%
Calm 42.8%
Happy 41.7%
Sad 7.8%
Fear 2.1%
Surprised 1.7%
Disgusted 1.6%
Angry 1.4%
Confused 1%

AWS Rekognition

Age 50-58
Gender Male, 93.9%
Angry 53.7%
Calm 31.2%
Disgusted 4.3%
Surprised 3.5%
Sad 2.3%
Confused 1.8%
Happy 1.8%
Fear 1.4%

AWS Rekognition

Age 53-61
Gender Female, 74.5%
Calm 98.7%
Sad 1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0%
Angry 0%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Female, 96.5%
Sad 98.3%
Happy 0.7%
Angry 0.6%
Fear 0.1%
Calm 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0%

AWS Rekognition

Age 23-33
Gender Male, 67.3%
Sad 99.4%
Calm 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0%
Surprised 0%

AWS Rekognition

Age 18-24
Gender Male, 72.7%
Sad 60.4%
Happy 23.2%
Surprised 6.1%
Calm 4.1%
Angry 2.6%
Confused 1.8%
Fear 1.1%
Disgusted 0.6%

AWS Rekognition

Age 27-37
Gender Female, 71%
Calm 98.4%
Fear 0.7%
Sad 0.4%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 37-45
Gender Male, 72.6%
Calm 53.4%
Happy 17.1%
Sad 12.7%
Disgusted 5.5%
Confused 4.1%
Angry 2.9%
Surprised 2.2%
Fear 2.1%

AWS Rekognition

Age 35-43
Gender Male, 89.1%
Sad 74.3%
Calm 17.3%
Confused 3.5%
Happy 1.8%
Angry 1.1%
Disgusted 1%
Fear 0.8%
Surprised 0.3%

AWS Rekognition

Age 50-58
Gender Male, 94.8%
Sad 96.5%
Happy 2.2%
Angry 0.5%
Fear 0.3%
Surprised 0.2%
Disgusted 0.1%
Confused 0.1%
Calm 0%

AWS Rekognition

Age 4-12
Gender Female, 76.9%
Calm 55.6%
Sad 34.7%
Angry 3.4%
Confused 3.2%
Fear 1.1%
Disgusted 0.7%
Happy 0.7%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person
Chair
Person 99.5%
Person 98.7%
Person 98.7%
Person 98.2%
Person 97.9%
Person 97.9%
Person 97.3%
Person 96.7%
Person 96.2%
Person 94.6%
Person 91.6%
Person 90.8%
Person 90.3%
Person 75.4%
Person 70.5%
Person 70.4%
Person 66.9%
Person 62%
Chair 57.3%

Text analysis

Amazon

EXIT
LIO

Google

EXIT
EXIT