Human Generated Data

Title

Untitled (masked wrestler)

Date

1971

People

Artist: Geoff Winningham, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1698

Human Generated Data

Title

Untitled (masked wrestler)

People

Artist: Geoff Winningham, American 20th century

Date

1971

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 93.8
Person 85.6
Leisure Activities 83.3
Sports 80.5
Sport 80.5
Dance Pose 80.2
Person 72.2
Person 72.2
Person 65.1
Dance 62.8
Person 61
Shoe 60.4
Apparel 60.4
Clothing 60.4
Footwear 60.4
Person 57.9
Shoe 55.4
Runway 55.3
Person 53
Person 49.8
Person 49.1

Imagga
created on 2022-01-08

skate 100
man 28.9
sport 25.3
active 25.2
people 24.6
male 24.1
action 23.2
snow 22.7
person 22
winter 21.3
fitness 19.9
activity 18.8
lifestyle 18.8
dancer 18.4
exercise 18.2
adult 18
motion 17.1
outdoors 16.4
fashion 15.8
cold 15.5
posing 15.1
dance 15.1
fun 15
silhouette 14.9
boy 14.9
outdoor 14.5
athlete 13.7
jumping 13.5
moving 13.4
leisure 13.3
black 13.2
skateboard 13
happy 11.9
pose 11.8
elegance 11.8
portrait 11.7
city 11.7
dancing 11.6
cool 11.6
urban 11.4
men 11.2
performance 10.5
body 10.4
play 10.3
happiness 10.2
model 10.1
board 9.9
sunset 9.9
attractive 9.8
ski 9.7
style 9.7
jump 9.6
walk 9.5
walking 9.5
movement 9.4
season 9.4
player 9.3
performer 9.2
joy 9.2
pretty 9.1
park 9.1
health 9
vacation 9
wheeled vehicle 9
mountain 8.9
aerobics 8.8
stick 8.8
bright 8.6
balance 8.5
ballplayer 8.4
sports 8.3
fit 8.3
teenager 8.2
dress 8.1
recreation 8.1
shadow 8.1
success 8.1
businessman 8
hockey stick 7.9
business 7.9
rap 7.9
skiing 7.9
standing 7.8
full length 7.8
gloves 7.8
corporate 7.7
extreme 7.7
sky 7.7
healthy 7.6
free 7.5
human 7.5
one 7.5
back 7.4
speed 7.3
competition 7.3
sensuality 7.3
suit 7.2
women 7.1
weather 7.1
modern 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

dance 95.9
text 92.7
ice skating 87.5
footwear 85.9
person 81.2
clothing 70.3
snow 59
snowboarding 51.3
posing 37.6
skiing 12.6

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 98.7%
Happy 0.4%
Surprised 0.4%
Confused 0.2%
Angry 0.2%
Sad 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 88.8%
Calm 92%
Sad 6%
Confused 1.2%
Angry 0.2%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 47-53
Gender Male, 98.7%
Happy 65.8%
Calm 30.3%
Angry 1.4%
Disgusted 0.9%
Sad 0.7%
Surprised 0.4%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 31-41
Gender Male, 54.7%
Sad 79.1%
Calm 14.2%
Fear 2.1%
Angry 1.7%
Disgusted 1.4%
Confused 0.7%
Surprised 0.6%
Happy 0.2%

AWS Rekognition

Age 11-19
Gender Male, 96.6%
Confused 58%
Calm 37.2%
Angry 1.8%
Sad 1%
Disgusted 0.7%
Surprised 0.7%
Fear 0.5%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 99.4%
Happy 97.9%
Calm 0.8%
Fear 0.6%
Surprised 0.2%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Confused 25.4%
Calm 22.4%
Sad 21.1%
Fear 13.8%
Disgusted 6.8%
Happy 5.8%
Surprised 2.8%
Angry 1.8%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Calm 95.4%
Sad 2.9%
Confused 0.9%
Angry 0.4%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 96.1%
Angry 54.9%
Fear 14%
Calm 10.4%
Disgusted 9.2%
Surprised 4.5%
Sad 2.9%
Confused 2.4%
Happy 1.6%

AWS Rekognition

Age 13-21
Gender Male, 99.3%
Happy 53.4%
Fear 28.6%
Sad 7%
Angry 6.7%
Calm 1.9%
Surprised 1.4%
Disgusted 0.7%
Confused 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Calm 87.9%
Sad 8.4%
Angry 1.9%
Confused 0.8%
Fear 0.3%
Surprised 0.2%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 30-40
Gender Female, 99.9%
Confused 31.3%
Disgusted 29.6%
Angry 18.1%
Calm 12%
Sad 3.1%
Fear 2.9%
Surprised 2%
Happy 1%

AWS Rekognition

Age 21-29
Gender Male, 97.3%
Calm 85.3%
Sad 6.3%
Happy 4.8%
Fear 1.9%
Surprised 0.5%
Angry 0.5%
Disgusted 0.4%
Confused 0.3%

AWS Rekognition

Age 18-26
Gender Male, 92.9%
Fear 97%
Calm 1.2%
Disgusted 0.4%
Angry 0.4%
Sad 0.3%
Happy 0.3%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 21-29
Gender Female, 88.7%
Happy 56%
Disgusted 24.4%
Angry 8.9%
Calm 4.4%
Fear 2.5%
Sad 1.6%
Surprised 1.2%
Confused 1.1%

AWS Rekognition

Age 14-22
Gender Male, 99.8%
Calm 99.7%
Confused 0.2%
Surprised 0.1%
Sad 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 95.2%
Sad 47.9%
Confused 45.6%
Fear 2.6%
Disgusted 2.2%
Surprised 0.7%
Calm 0.5%
Angry 0.4%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Male, 79.9%
Calm 60.7%
Angry 12.3%
Sad 8.9%
Disgusted 7.4%
Happy 4.7%
Fear 2.9%
Confused 1.7%
Surprised 1.3%

AWS Rekognition

Age 25-35
Gender Male, 99.3%
Sad 63.7%
Confused 11.1%
Angry 10%
Calm 7.1%
Fear 6.3%
Disgusted 0.8%
Surprised 0.5%
Happy 0.5%

AWS Rekognition

Age 16-22
Gender Male, 80.5%
Calm 98.8%
Confused 0.5%
Sad 0.3%
Angry 0.3%
Fear 0.1%
Disgusted 0.1%
Happy 0%
Surprised 0%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Happy 99.4%
Surprised 0.3%
Confused 0.1%
Sad 0.1%
Calm 0.1%
Fear 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 6-16
Gender Female, 56.8%
Calm 59.8%
Fear 17.6%
Sad 10.2%
Happy 10%
Confused 0.6%
Angry 0.6%
Surprised 0.6%
Disgusted 0.6%

AWS Rekognition

Age 21-29
Gender Male, 81.6%
Happy 74.8%
Fear 11.5%
Sad 4.6%
Calm 3.1%
Surprised 1.9%
Angry 1.5%
Disgusted 1.4%
Confused 1.3%

AWS Rekognition

Age 27-37
Gender Male, 100%
Fear 42.9%
Calm 19.6%
Sad 10.8%
Confused 9.4%
Angry 5.6%
Disgusted 4%
Happy 3.9%
Surprised 3.7%

AWS Rekognition

Age 7-17
Gender Male, 99.2%
Fear 56.7%
Calm 16.5%
Angry 14.8%
Sad 5.8%
Happy 2.3%
Surprised 1.7%
Confused 1.4%
Disgusted 0.9%

AWS Rekognition

Age 18-26
Gender Male, 97.9%
Calm 94%
Surprised 2.5%
Fear 1.4%
Sad 1.3%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Female, 95.1%
Sad 66.9%
Calm 19.5%
Happy 4.5%
Disgusted 3.8%
Angry 3.1%
Fear 0.8%
Confused 0.7%
Surprised 0.7%

AWS Rekognition

Age 24-34
Gender Male, 96.2%
Happy 45.4%
Calm 21.3%
Angry 11.8%
Fear 8.2%
Sad 5.1%
Confused 5%
Disgusted 1.6%
Surprised 1.5%

AWS Rekognition

Age 18-24
Gender Male, 72.9%
Angry 57.1%
Calm 34.9%
Fear 3.9%
Sad 1.7%
Confused 1.1%
Surprised 0.5%
Disgusted 0.4%
Happy 0.4%

AWS Rekognition

Age 45-53
Gender Male, 98.2%
Calm 65%
Sad 24.9%
Confused 2.9%
Disgusted 1.9%
Fear 1.7%
Surprised 1.7%
Happy 1.1%
Angry 0.8%

AWS Rekognition

Age 4-10
Gender Male, 86.6%
Calm 90.4%
Surprised 2.6%
Angry 1.9%
Confused 1.7%
Sad 1%
Fear 0.9%
Happy 0.9%
Disgusted 0.6%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Calm 83.1%
Fear 8.8%
Sad 5.7%
Confused 1%
Disgusted 0.6%
Surprised 0.3%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 6-16
Gender Male, 98.5%
Calm 99.8%
Surprised 0.1%
Happy 0%
Disgusted 0%
Angry 0%
Sad 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 88.8%
Fear 5.5%
Sad 3.4%
Angry 1.1%
Confused 0.6%
Happy 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 16-22
Gender Female, 65.3%
Calm 68.3%
Fear 20.4%
Confused 4%
Happy 2%
Surprised 1.6%
Sad 1.4%
Angry 1.4%
Disgusted 0.9%

AWS Rekognition

Age 23-33
Gender Male, 93.8%
Disgusted 71.7%
Confused 15%
Calm 5.2%
Sad 4.6%
Angry 1.8%
Happy 0.9%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 0-6
Gender Female, 91.1%
Fear 86.9%
Calm 5.5%
Sad 3.3%
Confused 1.7%
Surprised 1%
Happy 0.9%
Disgusted 0.5%
Angry 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 49.6%
Sad 40.7%
Angry 3.4%
Happy 2.5%
Fear 2.5%
Disgusted 0.5%
Surprised 0.4%
Confused 0.3%

AWS Rekognition

Age 38-46
Gender Male, 97.5%
Calm 97.5%
Sad 1.1%
Confused 0.6%
Surprised 0.2%
Disgusted 0.2%
Happy 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 89.2%
Angry 4.4%
Sad 4.3%
Confused 0.7%
Disgusted 0.6%
Surprised 0.4%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 19-27
Gender Male, 53.1%
Calm 53.7%
Sad 37.4%
Confused 2.7%
Fear 1.6%
Surprised 1.5%
Angry 1.3%
Disgusted 1.2%
Happy 0.6%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 95.6%
Confused 1.2%
Angry 1%
Surprised 0.7%
Fear 0.7%
Happy 0.4%
Disgusted 0.3%
Sad 0.3%

AWS Rekognition

Age 6-12
Gender Female, 61.8%
Fear 90.4%
Calm 6.4%
Confused 0.9%
Sad 0.8%
Happy 0.5%
Surprised 0.5%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 23-33
Gender Male, 97.8%
Calm 72.7%
Angry 7.2%
Sad 6.1%
Disgusted 4.7%
Fear 3.6%
Surprised 2.6%
Confused 2.3%
Happy 0.7%

AWS Rekognition

Age 2-10
Gender Male, 95%
Fear 35.3%
Surprised 33.6%
Calm 18.7%
Sad 4.3%
Confused 3.7%
Angry 2.1%
Disgusted 1.3%
Happy 0.9%

AWS Rekognition

Age 13-21
Gender Female, 67.1%
Calm 66.2%
Sad 25.6%
Disgusted 2.2%
Fear 2%
Confused 1.4%
Angry 1.2%
Happy 0.8%
Surprised 0.7%

AWS Rekognition

Age 18-26
Gender Male, 99.7%
Calm 45%
Sad 35.8%
Confused 4.9%
Angry 3.7%
Surprised 3.6%
Disgusted 3.5%
Fear 2.8%
Happy 0.7%

AWS Rekognition

Age 6-14
Gender Male, 97.4%
Calm 66.2%
Sad 20.1%
Fear 3.9%
Happy 2.8%
Angry 2.1%
Confused 1.9%
Disgusted 1.5%
Surprised 1.4%

AWS Rekognition

Age 22-30
Gender Male, 95.1%
Fear 76.9%
Sad 15.4%
Angry 3.9%
Calm 1.2%
Confused 1%
Disgusted 0.7%
Surprised 0.6%
Happy 0.4%

AWS Rekognition

Age 21-29
Gender Male, 90.4%
Calm 77.5%
Sad 10.7%
Confused 3.9%
Fear 3.4%
Disgusted 1.9%
Surprised 1.7%
Angry 0.6%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 100%
Angry 91.5%
Calm 3.6%
Sad 1.8%
Fear 0.8%
Happy 0.7%
Confused 0.7%
Surprised 0.6%
Disgusted 0.3%

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Calm 52%
Sad 21.1%
Happy 10%
Angry 5.3%
Surprised 5%
Fear 4.1%
Disgusted 1.8%
Confused 0.7%

AWS Rekognition

Age 12-20
Gender Male, 82.5%
Fear 92.5%
Calm 3.8%
Sad 0.9%
Surprised 0.7%
Happy 0.7%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%

AWS Rekognition

Age 26-36
Gender Male, 99%
Disgusted 81.1%
Fear 8.9%
Sad 5.2%
Confused 2.1%
Happy 1%
Angry 0.6%
Calm 0.6%
Surprised 0.4%

AWS Rekognition

Age 19-27
Gender Male, 98.5%
Calm 98.9%
Sad 0.5%
Angry 0.3%
Surprised 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 98.5%
Sad 67.8%
Calm 16.5%
Fear 12.2%
Angry 0.9%
Disgusted 0.8%
Surprised 0.7%
Confused 0.6%
Happy 0.6%

AWS Rekognition

Age 19-27
Gender Female, 84.4%
Fear 93.6%
Happy 2.6%
Calm 1.1%
Angry 0.7%
Disgusted 0.7%
Sad 0.6%
Surprised 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.7%
Shoe 60.4%

Captions

Microsoft

a person standing in front of a snow covered slope 75.4%
a person standing in front of a monitor 67.4%
a person that is standing in the snow 67.3%

Text analysis

Amazon

20
8