Human Generated Data

Title

Untitled (young boy with rifle in soldier's uniform, mother and sister look on)
Date

c. 1950, printed later
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.134

Human Generated Data

Title

Untitled (young boy with rifle in soldier's uniform, mother and sister look on)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.5
Person 98.5
Military Uniform 83.3
Military 83.3
Weapon 82.8
Weaponry 82.8
Face 72.8
Gun 72.6
People 72.4
Officer 65.3
Army 65.2
Armored 65.2
Soldier 59.9
Furniture 58.6
Couch 58.6
Overcoat 56.1
Clothing 56.1
Coat 56.1
Apparel 56.1

Imagga
created on 2022-01-23

guitar 65.6
musical instrument 57.7
electric guitar 40.8
stringed instrument 36.6
musician 31.7
music 31.6
man 30.9
accordion 27.2
wind instrument 26.9
person 25.1
male 24.8
rock 24.3
adult 22.9
bassoon 22.7
people 22.3
keyboard instrument 21.8
musical 21.1
microphone 20.7
instrument 20.7
performer 20.5
singer 19.8
black 19.8
studio 19
guitarist 18.7
style 18.5
play 18.1
playing 17.3
business 16.4
player 16
electric 15.9
entertainment 15.6
concert 15.5
performance 15.3
bass 15
professional 14.8
attractive 14.7
fashion 14.3
corporate 13.7
band 13.6
portrait 12.9
youth 12.8
stage 12.5
businessman 12.4
office 12.1
hair 11.9
song 11.7
artist 11.6
holding 11.6
jeans 11.5
roll 11.4
metal 11.3
modern 11.2
suit 10.8
pop 10.7
standing 10.4
sound 10.3
expression 10.2
model 10.1
hand 9.9
art 9.8
group 9.7
sexy 9.6
computer 9.6
war 9.6
looking 9.6
men 9.4
lifestyle 9.4
device 9.3
star 9.1
teenager 9.1
pretty 9.1
human 9
handsome 8.9
job 8.8
women 8.7
face 8.5
gun 8.5
executive 8.4
hot 8.4
guy 8.3
occupation 8.2
fun 8.2
weapon 8.2
danger 8.2
rifle 8
rocker 7.9
acoustic 7.9
sing 7.9
melody 7.8
boy 7.8
soldier 7.8
equipment 7.7
serious 7.6
businesspeople 7.6
uniform 7.6
technology 7.4
teen 7.3
confident 7.3
worker 7.1
cool 7.1
indoors 7

Google
created on 2022-01-23

Shirt 94.1
Musical instrument 92.1
Guitar 90.3
Musician 85.8
Black-and-white 83.9
Style 83.8
Music 78.4
String instrument 74.3
Monochrome 72.6
Monochrome photography 72.4
Plucked string instruments 69.5
Event 69.1
Vintage clothing 68.5
Door 66.9
Stock photography 65
Room 63.8
Suit 57.5
Crew 55.7
Electronic instrument 52.9
Folk instrument 52.2

Microsoft
created on 2022-01-23

person 99
text 96.9
musical instrument 90
clothing 89.6
concert 71.4
guitar 63.7
black and white 59.7
posing 55.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 100%
Surprised 48.9%
Happy 35%
Confused 5.9%
Fear 3.8%
Calm 3.2%
Angry 1.9%
Disgusted 0.7%
Sad 0.6%

AWS Rekognition

Age 25-35
Gender Female, 99.1%
Calm 51.9%
Sad 41.9%
Confused 2.5%
Fear 1.3%
Angry 1.1%
Surprised 0.5%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 6-12
Gender Male, 100%
Calm 99.9%
Disgusted 0.1%
Confused 0%
Surprised 0%
Sad 0%
Happy 0%
Angry 0%
Fear 0%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 75.9%
a group of people posing for the camera 75.8%
a man and a woman standing in front of a window 50.2%