Human Generated Data

Title

Untitled (baby in jacket and hat)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17040

Human Generated Data

Title

Untitled (baby in jacket and hat)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Human 97.7
Person 97.7
Coat 95
Footwear 88.9
Shoe 88.9
Overcoat 69
Raincoat 57.1
Shoe 56.5

Imagga
created on 2022-02-26

brass 100
wind instrument 77.1
trombone 70.3
musical instrument 51.4
cornet 40.9
man 22.2
device 21.7
megaphone 17.6
mask 15.7
person 15.4
people 15
protection 14.5
acoustic device 13.9
male 13.5
black 10.8
military 10.6
human 10.5
adult 10.3
danger 10
face 9.9
holding 9.9
bugle 9.8
art 9.8
soldier 9.8
accident 9.8
health 9.7
chemical 9.6
gas 9.6
costume 9.5
work 9.4
action 9.3
occupation 9.2
business 9.1
industrial 9.1
portrait 9.1
dirty 9
active 9
metal 8.8
radioactive 8.8
radiation 8.8
destruction 8.8
toxic 8.8
protective 8.8
nuclear 8.7
helmet 8.7
war 8.6
3d 8.5
dark 8.3
sport 8.2
fun 8.2
body 8
stalker 7.9
gun 7.9
render 7.8
power 7.5
future 7.4
technology 7.4
light 7.3
clothing 7.3
success 7.2
color 7.2
suit 7.2
science 7.1

Google
created on 2022-02-26

Gesture 85.3
Style 83.9
Black-and-white 83
Tints and shades 77.1
Monochrome photography 75.9
Flash photography 75.5
Monochrome 75.2
Vintage clothing 69.4
Room 67.1
Stock photography 65.1
Knee 61.9
Art 61.1
Child 60.6
Rectangle 59.7
Visual arts 58.4
Toddler 57
Fun 52.8

Microsoft
created on 2022-02-26

text 98.4
clothing 93.7
black and white 93.1
woman 91.1
toddler 83.2
footwear 81.8
person 79.6
girl 67.7
human face 67.7
lady 53.4
monochrome 52.6
posing 45.8
female 36.5

Face analysis

Amazon

Google

AWS Rekognition

Age 10-18
Gender Female, 72.6%
Calm 37.5%
Happy 27.8%
Sad 20.3%
Surprised 5.5%
Fear 3.2%
Angry 2.9%
Disgusted 1.5%
Confused 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Coat 95%
Shoe 88.9%

Captions

Microsoft

a woman standing in front of a building 78.6%
a woman posing for a photo 78.5%
a girl posing for a photo 69.6%