Human Generated Data

Title

Untitled (large group of men in prison uniforms staring at an unseen film screen)

Date

1945

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14418

Human Generated Data

Title

Untitled (large group of men in prison uniforms staring at an unseen film screen)

People

Artist: Jack Gould, American

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.7
Human 99.7
Person 99.1
Person 98.9
Person 98.5
Crowd 95.2
Person 94.5
Person 93.6
Person 93
Person 92.1
Person 89.4
People 82.6
Person 82
Person 80.8
Apparel 79.1
Clothing 79.1
Audience 78.9
Person 78.4
Person 72.4
Coat 62.8
Person 62.3
Helmet 61.9
Suit 58.2
Overcoat 58.2
Face 56.8
Parade 56.4

Imagga
created on 2022-01-29

people 28.4
person 23.1
silhouette 20.7
man 19.5
group 17.7
dance 16.1
men 15.4
water 15.3
crowd 14.4
blackboard 14.3
art 13.7
male 13.5
women 13.4
adult 13.4
sunlight 13.3
happy 13.1
party 12.9
happiness 12.5
couple 12.2
business 12.1
human 12
summer 11.6
style 11.1
beach 10.9
music 10.9
joy 10.8
world 10.6
fun 10.5
clothing 10.4
success 10.4
sexy 10.4
hands 10.4
black 10.2
lifestyle 10.1
spectator 10
light 10
team 9.8
attractive 9.8
concert 9.7
businessman 9.7
body 9.6
vacations 9.4
grunge 9.4
holiday 9.3
teacher 9.1
pretty 9.1
park 9
portrait 9
fashion 9
design 9
activity 8.9
wet 8.9
child 8.9
cool 8.9
stage 8.8
sea 8.8
boy 8.7
play 8.6
motion 8.6
model 8.5
show 8.5
two 8.5
outdoor 8.4
hand 8.3
landscape 8.2
life 8.1
hair 7.9
love 7.9
face 7.8
scene 7.8
birds 7.8
travel 7.7
youth 7.7
leisure 7.5
outdoors 7.5
cap 7.4
event 7.4
active 7.3
girls 7.3
reflection 7.3
sun 7.2
smiling 7.2
dress 7.2
celebration 7.2
cute 7.2
night 7.1
sky 7

Google
created on 2022-01-29

Adaptation 79.3
Crew 77.7
Crowd 77
Art 74.9
Font 74.7
Event 72.3
Squad 70.1
Team 68.7
Uniform 66.6
Military organization 66.2
History 63.9
Monochrome 61.4
Hat 60.9
Illustration 59.5
Military uniform 59.2
Pattern 58.1
Vintage clothing 58
Sitting 52.8
Infantry 52.7
Troop 52.5

Microsoft
created on 2022-01-29

person 100
text 95.2
posing 88.4
man 75.6
people 64.8
group 60.1
drawing 51.3
team 29
crowd 26.9

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 98.1%
Sad 67.5%
Calm 28.2%
Angry 1.5%
Happy 0.7%
Disgusted 0.7%
Confused 0.6%
Fear 0.5%
Surprised 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 75.7%
Sad 6.7%
Surprised 6.1%
Angry 4.9%
Disgusted 3%
Confused 2.7%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 57.6%
Angry 17.1%
Sad 14.4%
Confused 4.5%
Disgusted 3.6%
Surprised 1.2%
Happy 1.1%
Fear 0.6%

AWS Rekognition

Age 33-41
Gender Male, 95.1%
Calm 87.3%
Sad 6.3%
Confused 3.7%
Disgusted 0.8%
Happy 0.8%
Angry 0.5%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Calm 69.1%
Sad 26.7%
Angry 1.3%
Surprised 1.1%
Confused 0.7%
Happy 0.6%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Female, 57.9%
Calm 93.9%
Sad 2.9%
Angry 1.1%
Confused 1%
Surprised 0.7%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 99.2%
Calm 94.8%
Sad 2.2%
Confused 0.8%
Disgusted 0.6%
Angry 0.5%
Surprised 0.4%
Happy 0.4%
Fear 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 93.6%
Angry 1.8%
Confused 1.6%
Surprised 1%
Happy 0.9%
Disgusted 0.8%
Sad 0.3%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 99.4%
Calm 30.7%
Sad 29%
Confused 28.4%
Angry 8.3%
Surprised 1.7%
Disgusted 1%
Happy 0.5%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 94.4%
Confused 3.9%
Angry 0.6%
Disgusted 0.3%
Surprised 0.3%
Happy 0.2%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Calm 70%
Angry 17.4%
Sad 7.4%
Confused 2.7%
Disgusted 0.9%
Happy 0.9%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.4%
Sad 44.8%
Calm 38.2%
Confused 6.8%
Angry 2.9%
Disgusted 2.8%
Surprised 1.7%
Happy 1.5%
Fear 1.2%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 89.9%
Surprised 3.6%
Confused 2.7%
Sad 1.7%
Angry 1.5%
Disgusted 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Male, 89.2%
Calm 55.2%
Sad 42.7%
Confused 1.4%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 16-24
Gender Female, 72%
Calm 86.8%
Sad 11.1%
Angry 1.5%
Confused 0.3%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Male, 98.6%
Calm 57.2%
Sad 39%
Angry 1.1%
Surprised 0.9%
Happy 0.7%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 92.7%
Calm 90.9%
Sad 4.1%
Angry 1.8%
Happy 1.3%
Disgusted 0.7%
Surprised 0.6%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Female, 95.7%
Sad 78.3%
Calm 18.2%
Confused 2.6%
Angry 0.4%
Disgusted 0.3%
Surprised 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 91.9%
Sad 68.1%
Angry 15.2%
Calm 13.7%
Happy 1.1%
Confused 1%
Surprised 0.5%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Male, 91.8%
Calm 94.5%
Sad 4.4%
Confused 0.5%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 95.9%
Sad 77.5%
Calm 11.2%
Angry 5.9%
Confused 3.1%
Disgusted 0.7%
Fear 0.6%
Happy 0.6%
Surprised 0.3%

AWS Rekognition

Age 45-53
Gender Male, 97.9%
Sad 76.9%
Calm 18.9%
Angry 3.2%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 42.2%
Sad 29.3%
Confused 19.7%
Angry 5.1%
Disgusted 1.8%
Fear 0.8%
Surprised 0.7%
Happy 0.5%

AWS Rekognition

Age 14-22
Gender Male, 97.9%
Sad 64.5%
Calm 26.7%
Confused 3.7%
Angry 1.6%
Happy 1.4%
Surprised 0.9%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 26-36
Gender Female, 89.4%
Calm 55.3%
Sad 34.4%
Confused 4.5%
Angry 1.8%
Disgusted 1.7%
Happy 1.2%
Fear 0.8%
Surprised 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 68.3%
Sad 28.4%
Confused 1.7%
Disgusted 0.5%
Happy 0.4%
Angry 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 95.6%
Happy 46.5%
Calm 43.6%
Sad 4%
Confused 1.9%
Angry 1.4%
Surprised 0.9%
Disgusted 0.8%
Fear 0.8%

AWS Rekognition

Age 29-39
Gender Male, 97.1%
Sad 74.6%
Calm 14%
Confused 7.9%
Angry 1%
Happy 0.7%
Disgusted 0.7%
Surprised 0.5%
Fear 0.5%

AWS Rekognition

Age 18-26
Gender Male, 75%
Fear 93.1%
Surprised 1.7%
Sad 1.4%
Angry 1.2%
Calm 1%
Disgusted 0.9%
Confused 0.5%
Happy 0.3%

AWS Rekognition

Age 41-49
Gender Male, 96.7%
Sad 99.4%
Angry 0.2%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Calm 91.4%
Sad 5.8%
Surprised 0.8%
Confused 0.6%
Angry 0.6%
Disgusted 0.4%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Female, 57.5%
Calm 36.6%
Sad 34.8%
Confused 12.4%
Happy 5.4%
Fear 4.1%
Angry 2.9%
Disgusted 2.1%
Surprised 1.8%

AWS Rekognition

Age 26-36
Gender Male, 95.8%
Sad 62.9%
Calm 13.2%
Fear 6.8%
Happy 6.3%
Disgusted 4.8%
Angry 2.9%
Confused 1.9%
Surprised 1.1%

AWS Rekognition

Age 42-50
Gender Male, 98.6%
Calm 96.3%
Sad 1.4%
Confused 0.8%
Happy 0.5%
Disgusted 0.4%
Angry 0.3%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Male, 95.2%
Calm 75.2%
Sad 18.4%
Confused 2.1%
Angry 1.7%
Happy 0.8%
Fear 0.8%
Surprised 0.6%
Disgusted 0.4%

AWS Rekognition

Age 35-43
Gender Male, 99.3%
Sad 87.3%
Calm 8.9%
Angry 1.7%
Fear 0.9%
Happy 0.5%
Disgusted 0.3%
Confused 0.3%
Surprised 0.2%

AWS Rekognition

Age 45-51
Gender Male, 98.6%
Sad 91.7%
Confused 5.2%
Calm 1.1%
Angry 0.7%
Disgusted 0.6%
Happy 0.4%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 98.1%
Calm 82%
Sad 11.3%
Confused 1.7%
Angry 1.3%
Disgusted 1.1%
Happy 1.1%
Surprised 0.9%
Fear 0.6%

AWS Rekognition

Age 18-24
Gender Female, 53%
Sad 47.4%
Confused 35.2%
Calm 6.7%
Angry 2.7%
Surprised 2.6%
Fear 2.5%
Disgusted 1.9%
Happy 1%

AWS Rekognition

Age 34-42
Gender Male, 91.2%
Calm 71.9%
Sad 8.5%
Disgusted 8%
Confused 7.4%
Angry 1.6%
Surprised 0.8%
Fear 0.8%
Happy 0.8%

AWS Rekognition

Age 29-39
Gender Male, 83%
Calm 65.5%
Sad 32.8%
Angry 0.5%
Confused 0.5%
Happy 0.2%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 19-27
Gender Male, 92.3%
Sad 37.6%
Calm 33.6%
Confused 21.8%
Happy 3.9%
Angry 1.4%
Disgusted 0.7%
Fear 0.5%
Surprised 0.5%

AWS Rekognition

Age 24-34
Gender Male, 61.1%
Sad 53.7%
Fear 19%
Calm 11.8%
Confused 8.7%
Happy 2.7%
Disgusted 1.6%
Angry 1.5%
Surprised 1%

AWS Rekognition

Age 6-16
Gender Female, 99.3%
Calm 81.7%
Sad 11.6%
Happy 3.7%
Confused 1%
Angry 0.8%
Surprised 0.4%
Disgusted 0.4%
Fear 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.4%
Sad 57.4%
Calm 34.5%
Angry 4.3%
Happy 1.5%
Disgusted 0.8%
Confused 0.7%
Fear 0.5%
Surprised 0.3%

AWS Rekognition

Age 23-31
Gender Female, 87.2%
Calm 84.8%
Sad 10%
Happy 2.3%
Confused 1.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Sad 69.2%
Calm 22%
Angry 4.5%
Confused 1.8%
Disgusted 1%
Fear 0.7%
Happy 0.5%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Female, 66%
Confused 38.7%
Sad 35%
Calm 15.3%
Angry 5.1%
Fear 3.3%
Disgusted 1.1%
Happy 0.8%
Surprised 0.7%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Sad 70.3%
Calm 15.4%
Fear 4.9%
Angry 4.5%
Surprised 1.7%
Disgusted 1.1%
Confused 1.1%
Happy 0.9%

AWS Rekognition

Age 21-29
Gender Female, 98.6%
Sad 41.6%
Happy 27.5%
Calm 14.5%
Angry 9.3%
Confused 2.7%
Fear 1.9%
Disgusted 1.4%
Surprised 1.2%

AWS Rekognition

Age 23-31
Gender Female, 99.8%
Sad 57.2%
Happy 34.1%
Confused 3.6%
Calm 2.1%
Angry 1.7%
Disgusted 0.6%
Fear 0.5%
Surprised 0.3%

AWS Rekognition

Age 26-36
Gender Male, 84%
Sad 36.6%
Angry 23.1%
Calm 16%
Confused 11.4%
Fear 6.7%
Surprised 2.6%
Disgusted 2%
Happy 1.8%

AWS Rekognition

Age 30-40
Gender Male, 90.5%
Calm 75.3%
Sad 18.6%
Confused 4.3%
Angry 0.5%
Disgusted 0.4%
Happy 0.3%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 26-36
Gender Female, 56.3%
Sad 89.8%
Calm 6%
Confused 1.4%
Happy 0.9%
Angry 0.7%
Disgusted 0.7%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 25-35
Gender Female, 86.5%
Sad 69.8%
Calm 27.1%
Confused 0.9%
Angry 0.7%
Happy 0.6%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Male, 88.7%
Sad 91.9%
Calm 2.5%
Confused 1.8%
Angry 1.6%
Disgusted 1.6%
Surprised 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 63.8%
Fear 45.7%
Sad 41.3%
Calm 4.2%
Disgusted 2.6%
Confused 2.1%
Angry 1.8%
Surprised 1.2%
Happy 0.9%

AWS Rekognition

Age 20-28
Gender Female, 84.4%
Sad 74.4%
Calm 11.8%
Fear 8.1%
Confused 2.1%
Happy 1.5%
Surprised 0.8%
Disgusted 0.7%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 61.9%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 94.4%
a group of people posing for a photo in front of a crowd 94.3%
a group of people posing for a photo 94.2%

Text analysis

Amazon

MJI7
MJI7 YT33AS ACCUPE
(2)
YT33AS
ACCUPE

Google

MJI7 YT3RA
MJI7
YT3RA