Human Generated Data

Title

Untitled (football team, Friends School)
Date

1939
People

Artist: Harris & Ewing, American 1910s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22268

Human Generated Data

Title

Untitled (football team, Friends School)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Human 99.8
Boy 99.8
Person 99.6
Clothing 99.6
Apparel 99.6
Shorts 99.2
Person 98.9
Person 98.4
Person 98.2
Person 97.6
Person 97
Person 95
Person 90.8
Person 88.2
Person 87.8
Person 86.2
Person 84.5
Child 82.9
Kid 82.9
Person 82.2
Face 82.1
Person 80.1
Person 77.7
Person 76.4
People 76.3
Person 75.2
Photo 68.9
Portrait 68.9
Photography 68.9
Person 66.7
Person 65.5
Shirt 64.2
T-Shirt 63.1
Person 62.1
Sleeve 60.7
Hand 58
Teeth 55.1
Lip 55.1
Mouth 55.1
Person 43.1

Imagga
created on 2022-03-11

film 32.8
photographic paper 24.6
x-ray film 22.1
negative 20.6
graffito 18.8
dark 18.4
grunge 17.9
decoration 16.9
photographic equipment 16.4
black 13.8
landscape 13.4
art 13.3
night 13.3
old 12.5
texture 12.5
tree 12.3
vintage 11.8
space 11.6
park 11.5
light 11.4
aged 10.8
structure 10.4
man 10
water 10
surface 9.7
building 9.6
forest 9.6
pattern 9.6
grungy 9.5
stone 9.3
design 9.1
equipment 9.1
silhouette 9.1
pawn 9.1
glass 8.3
city 8.3
sky 8.3
dirty 8.1
backgrounds 8.1
wet 8
cool 8
antique 7.9
wall 7.9
urban 7.9
ice 7.9
text 7.8
rock 7.8
architecture 7.8
people 7.8
scene 7.8
ancient 7.8
crowd 7.7
wallpaper 7.7
world 7.6
bottle 7.3
graphic 7.3
digital 7.3
paint 7.2
mountain 7.1
trees 7.1
travel 7
season 7
dance 7
textured 7

Google
created on 2022-03-11

Dress 86.7
Font 75.7
Team 72.9
Event 72.7
Monochrome 69.5
Crew 67.7
Uniform 64.8
Class 64.6
History 64
Vintage clothing 62.9
Photo caption 56.9
Room 56
Collection 55.2
Monochrome photography 53.8
Paper product 50.8

Microsoft
created on 2022-03-11

text 95.9
person 93.9
boy 87.1
clothing 73.8
soccer 69.5
posing 68.8
black and white 56.9
group 56
team 47

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 96.3%
Sad 52%
Calm 42.7%
Happy 2.7%
Surprised 0.9%
Fear 0.7%
Angry 0.3%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 26-36
Gender Female, 98.5%
Calm 99.9%
Fear 0%
Surprised 0%
Confused 0%
Happy 0%
Sad 0%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 19-27
Gender Male, 97.1%
Calm 99.5%
Sad 0.3%
Fear 0.1%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 24-34
Gender Male, 97.9%
Fear 69.5%
Happy 19.3%
Calm 6.9%
Sad 1.8%
Surprised 0.8%
Confused 0.7%
Angry 0.7%
Disgusted 0.4%

AWS Rekognition

Age 34-42
Gender Male, 84.2%
Calm 99.6%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Female, 55.6%
Happy 77.6%
Calm 18.8%
Sad 2%
Angry 0.5%
Surprised 0.4%
Disgusted 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 90.7%
Happy 93.8%
Calm 4.9%
Fear 0.4%
Surprised 0.4%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Happy 32.8%
Calm 30.1%
Sad 16.6%
Confused 7.6%
Surprised 4%
Angry 3.4%
Fear 3.1%
Disgusted 2.3%

AWS Rekognition

Age 34-42
Gender Male, 97.9%
Happy 74.8%
Calm 21.1%
Sad 1.1%
Surprised 1.1%
Confused 0.8%
Disgusted 0.6%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 96.2%
Angry 1.4%
Sad 1.2%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%
Happy 0.2%
Surprised 0.1%

AWS Rekognition

Age 28-38
Gender Male, 97.8%
Calm 37%
Happy 33.4%
Surprised 8.6%
Fear 6%
Sad 5.9%
Confused 4.9%
Disgusted 2.5%
Angry 1.8%

AWS Rekognition

Age 25-35
Gender Male, 95.6%
Calm 37.9%
Sad 35.3%
Happy 16.5%
Fear 3.5%
Disgusted 2.1%
Confused 1.7%
Angry 1.6%
Surprised 1.3%

AWS Rekognition

Age 12-20
Gender Male, 95.3%
Calm 93.3%
Fear 2.5%
Sad 1.8%
Angry 1.1%
Confused 0.4%
Happy 0.3%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 34-42
Gender Female, 69.7%
Sad 85.8%
Happy 5.1%
Fear 3.1%
Confused 3%
Disgusted 1%
Surprised 0.9%
Calm 0.7%
Angry 0.5%

AWS Rekognition

Age 35-43
Gender Male, 62.5%
Happy 50.7%
Calm 18.8%
Sad 11.1%
Fear 8.9%
Angry 4.1%
Surprised 2.4%
Confused 2.3%
Disgusted 1.7%

AWS Rekognition

Age 23-33
Gender Female, 99.6%
Calm 98.4%
Sad 0.5%
Angry 0.4%
Fear 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 26-36
Gender Male, 79.6%
Calm 60.3%
Sad 25.3%
Happy 6.6%
Fear 2.4%
Angry 1.8%
Confused 1.3%
Surprised 1.3%
Disgusted 1.1%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 73.2%
Sad 19%
Happy 4.4%
Confused 1.7%
Angry 0.6%
Disgusted 0.5%
Fear 0.3%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 89.9%
a group of people posing for the camera 89.8%
a group of people posing for a picture 89.7%

Text analysis

Amazon

F
UMT