Human Generated Data

Title

Untitled (youth football team, Friends School)

Date

1939

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22267

Human Generated Data

Title

Untitled (youth football team, Friends School)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1939

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22267

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Boy 100
Human 100
Person 99.6
Person 99.4
Clothing 99.2
Apparel 99.2
Person 99
Person 97.9
Person 97.3
Person 97.2
Shorts 96.9
Person 95.9
Person 95.3
Person 93.7
Face 90.9
Person 87.6
Person 87.4
Kid 86.8
Child 86.8
Person 86.6
Person 86.5
Person 86.4
Person 86.4
Person 84.2
Person 83.4
Person 80.1
Grass 76.7
Plant 76.7
Person 76.2
Shirt 74.2
People 73.5
Portrait 71.7
Photography 71.7
Photo 71.7
Person 69.8
Person 62.4
Hand 57.1
Person 49.8

Clarifai
created on 2023-10-22

people 99.9
many 99.2
group together 98.3
group 97.6
adult 97.4
uniform 96.9
child 95.7
man 95.6
wear 91.3
portrait 87.4
woman 86.9
competition 86.7
boy 83.9
recreation 82.9
outfit 82.1
position 81.2
education 79
school 77.9
crowd 74.8
athlete 71.6

Imagga
created on 2022-03-11

graffito 33.4
negative 32.1
film 27.3
decoration 24
landscape 20.8
grunge 19.6
photographic paper 18.9
park 16.5
art 16.2
dance 15.6
black 15
tree 14.6
texture 14.6
dark 14.2
old 13.9
forest 13
photographic equipment 12.6
vintage 12.4
structure 12.4
silhouette 11.6
creation 11.6
sky 11.5
rock 11.3
stone 11
space 10.9
dirty 10.8
outdoor 10.7
water 10.7
night 10.7
scene 10.4
pattern 10.3
man 9.5
people 9.5
wood 9.2
snow 9
trees 8.9
antique 8.8
light 8.7
season 8.6
grungy 8.5
winter 8.5
lake 8.5
design 8.5
rough 8.2
paint 8.1
aged 8.1
sun 8
material 8
natural 8
textured 7.9
travel 7.7
weathered 7.6
city 7.5
ocean 7.5
retro 7.4
building 7.3
graphic 7.3
group 7.3
wall 7.2
scenery 7.2
world 7.2
sunset 7.2
cool 7.1
surface 7.1
autumn 7
scenic 7

Google
created on 2022-03-11

Dress 88.7
Human body 88.4
Headgear 82.9
Crew 72.1
Event 71.4
Font 71.1
Monochrome 68.8
Class 68.3
Team 66.6
Uniform 65.3
History 65.1
Vintage clothing 63.4
Team sport 63.3
Photo caption 61.2
Room 59.3
Child 58.7
Collection 51
Paper product 50.4

Microsoft
created on 2022-03-11

outdoor 94.3
text 93.3
person 90.1
soccer 72.3
boy 69.3
posing 66
group 57.1
clothing 52.6
team 33.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 95.8%
Calm 95.7%
Sad 1.9%
Fear 1.8%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 29-39
Gender Male, 89.5%
Calm 81.2%
Sad 15.5%
Surprised 1.9%
Confused 0.4%
Happy 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 99.5%
Happy 0.2%
Fear 0.1%
Sad 0.1%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 81.7%
Happy 7.7%
Confused 6.4%
Angry 1.6%
Sad 1.3%
Disgusted 0.7%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 27-37
Gender Male, 73.1%
Calm 65.2%
Happy 30.1%
Angry 2.5%
Sad 1%
Fear 0.6%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 44.4%
Confused 17.3%
Happy 15.3%
Sad 13.2%
Surprised 3.3%
Disgusted 2.3%
Fear 2.2%
Angry 2%

AWS Rekognition

Age 18-26
Gender Female, 82.1%
Calm 38.1%
Sad 36.1%
Angry 12.4%
Happy 6.8%
Surprised 2.2%
Confused 2%
Fear 1.3%
Disgusted 1%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 96.7%
Angry 1.8%
Sad 0.6%
Confused 0.3%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 25-35
Gender Male, 97.8%
Calm 89.3%
Happy 5%
Fear 2.5%
Sad 1.7%
Surprised 0.6%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Calm 38%
Angry 25.3%
Sad 11.1%
Happy 8.3%
Surprised 5.4%
Fear 5.1%
Confused 5%
Disgusted 1.8%

AWS Rekognition

Age 26-36
Gender Male, 97.2%
Calm 90.8%
Sad 3.6%
Fear 2.1%
Happy 1%
Disgusted 0.9%
Confused 0.7%
Angry 0.7%
Surprised 0.2%

AWS Rekognition

Age 36-44
Gender Male, 57.4%
Calm 65.2%
Happy 14.2%
Sad 7.6%
Confused 3.1%
Disgusted 3.1%
Surprised 2.3%
Angry 2.3%
Fear 2.1%

AWS Rekognition

Age 21-29
Gender Female, 95.1%
Calm 87.5%
Happy 8.8%
Angry 1.5%
Sad 0.7%
Fear 0.6%
Confused 0.4%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 33-41
Gender Male, 76.8%
Sad 27.9%
Happy 23%
Surprised 11.1%
Fear 10.7%
Confused 9.3%
Disgusted 8.2%
Calm 7.3%
Angry 2.5%

AWS Rekognition

Age 26-36
Gender Female, 75%
Sad 95.9%
Calm 3.7%
Happy 0.2%
Angry 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 31-41
Gender Male, 97.9%
Sad 90.8%
Calm 6.4%
Fear 0.8%
Angry 0.8%
Happy 0.4%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.6%
Person 99.4%
Person 99%
Person 97.9%
Person 97.3%
Person 97.2%
Person 95.9%
Person 95.3%
Person 93.7%
Person 87.6%
Person 87.4%
Person 86.6%
Person 86.5%
Person 86.4%
Person 86.4%
Person 84.2%
Person 83.4%
Person 80.1%
Person 76.2%
Person 69.8%
Person 62.4%
Person 49.8%

Text analysis

Amazon

F
39