Human Generated Data

Title

Untitled (class portrait of children at Brownsboro Mexican School)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3385

Human Generated Data

Title

Untitled (class portrait of children at Brownsboro Mexican School)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.8
Person 99.8
Person 99.3
Person 99.2
Person 98.8
Person 98.6
Person 98.4
Person 97.9
Person 96.4
School 96.3
Room 95.9
Indoors 95.9
Classroom 95.9
Clothing 95.8
Apparel 95.8
Person 95.4
Person 94.4
Chair 94
Furniture 94
Person 93.7
Person 86
People 85.7
Person 83.5
Crowd 73.7
Tie 70.7
Accessory 70.7
Accessories 70.7
Person 69.2
Person 68.4
Person 68
Person 67.5
Person 63.7
Person 63.5
Child 63.1
Kid 63.1
Boy 60
Sailor Suit 59.8
Kindergarten 58
Audience 57.9
Face 55.4
Advertisement 55.4
Poster 55.4

Imagga
created on 2022-01-22

kin 34.6
people 25.6
room 24.5
gymnasium 24.2
classroom 24.2
silhouette 20.7
athletic facility 19.4
male 17.7
black 16.8
man 16.8
person 16.3
group 16.1
facility 15.9
adult 14.2
men 13.7
world 12.5
sport 12
women 11.8
portrait 11.6
business 11.5
urban 11.3
old 11.1
crowd 10.5
grunge 10.2
happy 10
city 10
vintage 9.9
family 9.8
businessman 9.7
couple 9.6
motion 9.4
walking 8.5
child 8.3
window 8.2
indoor 8.2
outdoors 8.2
activity 8.1
body 8
interior 8
lifestyle 7.9
modern 7.7
move 7.7
youth 7.7
dark 7.5
human 7.5
style 7.4
action 7.4
girls 7.3
aged 7.2
active 7.2
transportation 7.2
team 7.2
working 7.1

Google
created on 2022-01-22

Black 89.5
Dress 83.7
People 78.3
Suit 76.3
Vintage clothing 72.7
Crew 72.2
Picture frame 72.2
Monochrome 70.8
Uniform 69
Room 68.7
Event 68
History 66.4
Monochrome photography 64.6
Stock photography 62.4
Team 62
Class 56.9
Font 56.2
Collection 55.1
Child 54.4
Family 52.8

Microsoft
created on 2022-01-22

person 98.6
text 98.3
clothing 96.2
window 95.3
old 83.9
posing 82.1
group 73.7
hockey 70
white 69.1
black 67.1
team 34

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 77.4%
Calm 90%
Angry 5.5%
Confused 1.7%
Disgusted 1%
Surprised 0.9%
Sad 0.6%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 99.2%
Calm 68.5%
Surprised 8.6%
Happy 7.9%
Sad 5.9%
Disgusted 3.2%
Confused 2.7%
Fear 1.7%
Angry 1.5%

AWS Rekognition

Age 38-46
Gender Male, 97.2%
Surprised 48.4%
Happy 12.8%
Sad 11.2%
Calm 10.9%
Fear 8.6%
Disgusted 3.5%
Angry 2.5%
Confused 2.2%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 82.8%
Confused 13.5%
Sad 1.3%
Disgusted 1%
Happy 0.8%
Surprised 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.1%
Fear 80.1%
Calm 13.2%
Disgusted 2.2%
Happy 1.7%
Sad 1.4%
Confused 0.8%
Angry 0.4%
Surprised 0.3%

AWS Rekognition

Age 47-53
Gender Male, 97.6%
Calm 70.2%
Sad 7.5%
Confused 6%
Fear 5.9%
Happy 3.9%
Surprised 3.5%
Angry 1.9%
Disgusted 1%

AWS Rekognition

Age 47-53
Gender Male, 96.4%
Calm 74.8%
Happy 18.9%
Surprised 3.1%
Disgusted 0.9%
Fear 0.7%
Angry 0.6%
Sad 0.5%
Confused 0.4%

AWS Rekognition

Age 34-42
Gender Male, 99.4%
Confused 33.3%
Calm 27.7%
Sad 19.1%
Angry 6.7%
Disgusted 6%
Happy 3.5%
Fear 2.2%
Surprised 1.4%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Calm 50.6%
Surprised 36%
Fear 5.9%
Happy 2.2%
Disgusted 1.7%
Sad 1.3%
Confused 1.2%
Angry 0.9%

AWS Rekognition

Age 25-35
Gender Male, 99.4%
Happy 49.4%
Sad 31.2%
Calm 13.7%
Fear 4.2%
Angry 0.5%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 41-49
Gender Male, 91.7%
Surprised 98%
Fear 0.7%
Calm 0.4%
Happy 0.3%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%

AWS Rekognition

Age 24-34
Gender Female, 66.4%
Surprised 60.9%
Calm 12.9%
Confused 8.7%
Fear 6.9%
Sad 6.5%
Disgusted 2.4%
Happy 0.9%
Angry 0.8%

AWS Rekognition

Age 34-42
Gender Male, 95%
Sad 46.2%
Fear 20.6%
Calm 15.4%
Confused 8.2%
Angry 4.1%
Surprised 2.5%
Happy 1.6%
Disgusted 1.5%

AWS Rekognition

Age 41-49
Gender Female, 68.7%
Fear 82.6%
Calm 7.4%
Surprised 3.4%
Happy 3.2%
Angry 1%
Sad 0.8%
Confused 0.8%
Disgusted 0.7%

AWS Rekognition

Age 34-42
Gender Male, 98.9%
Fear 75.2%
Surprised 10.3%
Disgusted 5.9%
Sad 2.7%
Angry 2.2%
Confused 1.5%
Happy 1.4%
Calm 0.9%

AWS Rekognition

Age 29-39
Gender Female, 89.6%
Calm 85.3%
Happy 6.1%
Sad 4.9%
Fear 1.6%
Surprised 0.8%
Disgusted 0.7%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Female, 79.9%
Sad 44%
Confused 17.9%
Happy 14.6%
Disgusted 6.1%
Angry 5.4%
Calm 5%
Fear 3.7%
Surprised 3.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Feature analysis

Amazon

Person 99.8%
Tie 70.7%
Poster 55.4%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 93.2%
a vintage photo of a group of people posing for a picture 93.1%
a group of people posing for a photo 93%