Human Generated Data

Title

Untitled (young adults in uniforms with flags and guns)

Date

c. 1975

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1372

Human Generated Data

Title

Untitled (young adults in uniforms with flags and guns)

People

Artist: Ken Whitmire Associates, American

Date

c. 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.6
Person 99.6
Person 99.5
Person 99.3
Person 99.1
Apparel 94.9
Clothing 94.9
Symbol 92.2
Costume 88.4
People 87.5
Military 85.4
Military Uniform 85.4
Door 83.5
Shorts 81.2
Person 73.8
Soldier 72.3
Interior Design 71.8
Indoors 71.8
Flag 66.7
Shoe 65.7
Footwear 65.7
Officer 64.6
Brick 63.7
American Flag 63.6
Face 61.1
Person 61
Shoe 58.4
Plant 57.7
Potted Plant 57.7
Jar 57.7
Vase 57.7
Pottery 57.7
Portrait 57.3
Photography 57.3
Photo 57.3
Room 57.2

Imagga
created on 2022-01-22

nurse 45.2
man 28.9
male 24.6
person 22.1
people 21.7
hospital 18.8
happy 18.8
family 16
clothing 14.9
portrait 14.9
home 14.3
adult 14.3
child 14
standing 13.9
group 13.7
boy 13
smiling 13
smile 12.8
helmet 12.8
uniform 12.4
business 12.1
shop 11.8
mother 11.5
black 11.4
couple 11.3
men 11.2
football helmet 10.8
style 10.4
room 9.8
interior 9.7
together 9.6
professional 9.5
happiness 9.4
city 9.1
girls 9.1
dress 9
team 9
weapon 8.9
urban 8.7
life 8.7
women 8.7
retail 8.5
store 8.5
casual 8.5
inside 8.3
occupation 8.2
fun 8.2
children 8.2
handsome 8
to 8
lifestyle 7.9
indoors 7.9
school 7.8
husband 7.6
two 7.6
wife 7.6
fashion 7.5
human 7.5
care 7.4
office 7.2
kin 7.2
childhood 7.2
love 7.1
kid 7.1
window 7

Microsoft
created on 2022-01-22

person 99.2
clothing 96.2
text 95.3
posing 91.8
standing 83.4
black and white 83.1
clothes 16.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 94.3%
Happy 3.8%
Surprised 0.6%
Disgusted 0.4%
Angry 0.4%
Sad 0.2%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 80.2%
Calm 99.9%
Surprised 0.1%
Confused 0%
Sad 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 97.2%
Happy 1.8%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Confused 48.1%
Calm 24%
Sad 16.3%
Surprised 3%
Angry 2.6%
Disgusted 2.5%
Fear 2.5%
Happy 1%

AWS Rekognition

Age 23-33
Gender Male, 87.3%
Happy 90%
Calm 4.4%
Confused 1.9%
Angry 1.2%
Surprised 0.9%
Disgusted 0.7%
Fear 0.6%
Sad 0.4%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Flag 66.7%
Shoe 65.7%

Captions

Microsoft

a group of people posing for a photo 94.8%
a group of men posing for a photo 91.1%
a group of kids posing for a photo 78.4%