Human Generated Data

Title

Untitled (group of women with guns in a tank)

Date

1959, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.518

Human Generated Data

Title

Untitled (group of women with guns in a tank)

People

Artist: Lester Cole, American

Date

1959, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 97.9
Human 97.9
Military 95.5
Military Uniform 94
Person 93.2
Person 93
Person 91.2
Person 90.7
Army 83.5
Armored 83.5
Weapon 82.9
Weaponry 82.9
People 80.1
Soldier 75.2
Gun 70.6
Crowd 68.2
Leisure Activities 59.3
Troop 57.5
Person 51.7

Imagga
created on 2021-12-14

man 23.5
male 18.4
black 16.8
city 15
device 14.7
person 14.5
people 12.8
adult 11.7
silhouette 11.6
shop 11.2
music 10.8
light 10.7
art 10.6
night 9.8
rock 9.5
dark 9.2
danger 9.1
old 9
metal 8.8
guitar 8.8
urban 8.7
military 8.7
lifestyle 8.7
men 8.6
grunge 8.5
cockpit 8.5
entertainment 8.3
one 8.2
mercantile establishment 8.2
television 8.2
equipment 8.1
dirty 8.1
posing 8
antique 7.8
world 7.8
sitting 7.7
gun 7.7
vintage 7.4
smoke 7.4
instrument 7.3
life 7.1
portrait 7.1
electric chair 7.1
businessman 7.1
indoors 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 99.8
person 96.4
black and white 87.8
clothing 82.1
man 73.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 99.1%
Calm 93.8%
Sad 2.3%
Happy 1.3%
Angry 0.9%
Surprised 0.7%
Fear 0.5%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 99.5%
Calm 68.1%
Angry 13.9%
Happy 8.7%
Surprised 6.3%
Confused 1%
Disgusted 1%
Fear 0.7%
Sad 0.4%

AWS Rekognition

Age 13-25
Gender Female, 94.4%
Calm 55.5%
Happy 33.8%
Sad 4%
Angry 2.1%
Surprised 1.5%
Fear 1.1%
Confused 1%
Disgusted 1%

AWS Rekognition

Age 20-32
Gender Female, 65.6%
Happy 96%
Calm 3%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 26-40
Gender Female, 87.8%
Sad 51.3%
Calm 47.8%
Surprised 0.3%
Confused 0.2%
Happy 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 23-35
Gender Male, 87.1%
Calm 92.9%
Sad 2.9%
Happy 1.6%
Surprised 0.9%
Confused 0.6%
Angry 0.5%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 21-33
Gender Male, 67.5%
Calm 33.9%
Fear 23.6%
Surprised 14.8%
Sad 9.9%
Confused 8.2%
Angry 5.6%
Happy 3.3%
Disgusted 0.6%

AWS Rekognition

Age 25-39
Gender Male, 97.3%
Calm 78.1%
Angry 17.5%
Sad 2.8%
Happy 0.7%
Fear 0.6%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 39-57
Gender Male, 54%
Calm 34.5%
Surprised 25.9%
Happy 13%
Angry 10.7%
Sad 6.4%
Fear 3.9%
Disgusted 3.3%
Confused 2.2%

AWS Rekognition

Age 26-40
Gender Male, 69.9%
Surprised 47.7%
Angry 21.8%
Calm 16.5%
Disgusted 3.7%
Confused 3.6%
Fear 3.4%
Happy 2.2%
Sad 1%

AWS Rekognition

Age 13-25
Gender Female, 77%
Calm 48.7%
Disgusted 21.8%
Sad 11.1%
Happy 8.3%
Confused 3.4%
Angry 2.7%
Surprised 2.1%
Fear 1.8%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.9%

Captions

Microsoft

a group of people posing for a photo 87.6%
a group of people posing for the camera 87.5%
a group of people posing for a picture 87.4%

Text analysis

Amazon

26

Google

26
26