Human Generated Data

Title

Untitled (class picture, Columbia Prep. School)

Date

1950

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22299

Human Generated Data

Title

Untitled (class picture, Columbia Prep. School)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Accessory 99.8
Accessories 99.8
Tie 99.8
Clothing 99.7
Apparel 99.7
Shorts 99.7
Person 98.3
Human 98.3
Person 98.1
Person 97.8
Tie 97.3
Person 96.8
Person 96.7
Tie 96.6
Person 96.5
Person 96.2
Tie 94
Person 93.9
Person 93.3
Person 91.1
Tie 90.9
Person 89.2
Tie 87.8
Person 87.6
People 87.1
Tie 85.3
Female 82.4
Tie 81.1
Crowd 80.9
Person 72.2
Boy 72
Kid 71
Child 71
Girl 66.1
Tie 65.2
Face 64
Sports 58.5
Sport 58.5
Parade 57.1
Tie 56.4
Audience 56.3
Team 56.2
Costume 56
Sailor Suit 55.6
Hat 55.1
Person 53.7
Tie 52.3
Person 44.5

Imagga
created on 2022-03-11

graffito 37.4
decoration 29.3
freight car 27.8
car 20.8
art 19.4
wheeled vehicle 17.7
old 17.4
business 16.4
ancient 13.8
grunge 13.6
architecture 13.6
black 12.6
design 12.4
blackboard 12.3
vehicle 11.8
wall 11.2
pattern 10.9
history 10.7
man 10.7
people 10.6
building 10.5
technology 10.4
finance 10.1
silhouette 9.9
modern 9.8
antique 9.7
digital 9.7
crowd 9.6
wallpaper 9.2
vintage 9.1
aged 9
retro 9
success 8.8
computer 8.8
texture 8.3
city 8.3
board 8.3
equipment 8
money 7.6
chandelier 7.6
sign 7.5
monument 7.5
drawing 7.4
data 7.3
graphic 7.3
paint 7.2
metal 7.2
dirty 7.2
sculpture 7.1
science 7.1
male 7.1
travel 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

person 98.9
outdoor 90.8
clothing 88.4
text 86.3
group 81
posing 78.6
man 56.2
team 35.9

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 99.8%
Happy 0.1%
Sad 0%
Surprised 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 95.9%
Happy 3.7%
Surprised 0.2%
Sad 0.1%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 22-30
Gender Male, 84.5%
Calm 99.9%
Sad 0%
Angry 0%
Surprised 0%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.3%
Calm 99.5%
Happy 0.4%
Surprised 0%
Sad 0%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Female, 76%
Calm 91.6%
Happy 6.8%
Sad 0.7%
Fear 0.3%
Surprised 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 77.9%
Calm 90.7%
Happy 8.1%
Surprised 0.5%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 99.4%
Calm 97.8%
Surprised 1.5%
Angry 0.2%
Sad 0.1%
Happy 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 38-46
Gender Female, 95.5%
Happy 93.3%
Surprised 2.7%
Calm 1.9%
Fear 0.7%
Angry 0.5%
Sad 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.8%
Calm 98.1%
Happy 0.5%
Surprised 0.4%
Confused 0.4%
Disgusted 0.3%
Sad 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 85.6%
Calm 97.4%
Surprised 1.5%
Happy 0.7%
Sad 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 35-43
Gender Female, 87.4%
Calm 99.8%
Sad 0.1%
Happy 0.1%
Surprised 0%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 98.5%
Calm 80%
Happy 16.3%
Sad 0.9%
Confused 0.9%
Disgusted 0.7%
Fear 0.5%
Surprised 0.3%
Angry 0.3%

AWS Rekognition

Age 40-48
Gender Male, 74.3%
Calm 84.1%
Happy 7.6%
Surprised 3%
Angry 1.3%
Sad 1.3%
Fear 1.1%
Confused 1%
Disgusted 0.6%

AWS Rekognition

Age 25-35
Gender Female, 60.7%
Calm 96.5%
Surprised 3%
Happy 0.2%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 42-50
Gender Male, 58.2%
Calm 90.7%
Surprised 3.8%
Confused 1.7%
Happy 1.5%
Angry 1.1%
Sad 0.8%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Male, 91.1%
Calm 99.1%
Happy 0.5%
Surprised 0.2%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 36-44
Gender Male, 99.3%
Calm 97.9%
Surprised 1.3%
Confused 0.3%
Sad 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 50.8%
Calm 67%
Happy 29.3%
Sad 1.3%
Fear 0.9%
Surprised 0.6%
Angry 0.5%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 31-41
Gender Male, 87.6%
Calm 94.3%
Happy 3.1%
Sad 1.4%
Surprised 0.5%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 31-41
Gender Female, 99.8%
Calm 53.4%
Happy 42.9%
Surprised 1.9%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 94.5%
Calm 98.8%
Fear 0.7%
Happy 0.3%
Surprised 0.2%
Disgusted 0%
Sad 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 25-35
Gender Male, 95.6%
Calm 86.7%
Surprised 5.4%
Angry 2.7%
Happy 1.7%
Confused 1.2%
Sad 1.1%
Disgusted 0.7%
Fear 0.6%

AWS Rekognition

Age 36-44
Gender Male, 98.2%
Calm 99.1%
Happy 0.5%
Surprised 0.3%
Confused 0.1%
Disgusted 0%
Sad 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 43-51
Gender Male, 67.5%
Calm 99.7%
Happy 0.2%
Sad 0%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 59.1%
Calm 99.7%
Happy 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0%
Fear 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 28-38
Gender Female, 71.6%
Calm 79.5%
Surprised 13.5%
Happy 3.6%
Sad 1%
Angry 0.8%
Confused 0.7%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 41-49
Gender Female, 89.6%
Calm 77.5%
Surprised 18.7%
Fear 1.3%
Happy 1.1%
Sad 0.5%
Angry 0.4%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Female, 85.2%
Happy 58.2%
Calm 35.6%
Sad 2.3%
Fear 2.2%
Surprised 0.7%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 31-41
Gender Female, 59.1%
Calm 41.1%
Happy 26.8%
Surprised 12%
Fear 6.9%
Confused 5.9%
Disgusted 3.2%
Angry 2.3%
Sad 1.7%

AWS Rekognition

Age 40-48
Gender Male, 99.5%
Fear 73.4%
Calm 12.2%
Happy 5.8%
Surprised 4%
Sad 3.4%
Confused 0.6%
Angry 0.4%
Disgusted 0.4%

AWS Rekognition

Age 24-34
Gender Male, 98.3%
Calm 75%
Surprised 15.1%
Happy 5.1%
Confused 3%
Fear 0.6%
Disgusted 0.5%
Sad 0.4%
Angry 0.3%

AWS Rekognition

Age 27-37
Gender Male, 66.1%
Calm 71.3%
Surprised 11.4%
Confused 3.6%
Fear 3.3%
Happy 2.9%
Disgusted 2.9%
Sad 2.4%
Angry 2.1%

AWS Rekognition

Age 41-49
Gender Male, 98.7%
Calm 92.6%
Surprised 4.8%
Confused 1.2%
Happy 0.7%
Sad 0.3%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Male, 92.8%
Surprised 49.1%
Happy 27.9%
Calm 17.8%
Angry 2.1%
Sad 1.1%
Disgusted 0.9%
Fear 0.6%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.8%
Person 98.3%

Captions

Microsoft

a group of people posing for a photo 95.9%
a group of people posing for the camera 95.8%
a group of people posing for a picture 95.7%

Text analysis

Amazon

SCHWOL
PREPARATORY SCHWOL
PREPARATORY
181

Google

COUTISTAN PERATOPY SUOL
COUTISTAN
PERATOPY
SUOL