Human Generated Data

Title

Untitled (baby in jacket and hat)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17040

Human Generated Data

Title

Untitled (baby in jacket and hat)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17040

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Person 97.7
Human 97.7
Coat 95
Shoe 88.9
Footwear 88.9
Overcoat 69
Raincoat 57.1
Shoe 56.5

Clarifai
created on 2023-10-29

people 99.8
child 99.6
portrait 98.8
monochrome 98.7
one 96.9
street 96.1
girl 95.6
wear 93.8
baby 93
adult 90.2
model 90.2
black and white 88
woman 87.3
fashion 86.8
dress 83.5
art 83.2
wall 82.9
vintage 82.5
retro 81.5
music 81.5

Imagga
created on 2022-02-26

brass 100
wind instrument 77.1
trombone 70.3
musical instrument 51.4
cornet 40.9
man 22.2
device 21.7
megaphone 17.6
mask 15.7
person 15.4
people 15
protection 14.5
acoustic device 13.9
male 13.5
black 10.8
military 10.6
human 10.5
adult 10.3
danger 10
face 9.9
holding 9.9
bugle 9.8
art 9.8
soldier 9.8
accident 9.8
health 9.7
chemical 9.6
gas 9.6
costume 9.5
work 9.4
action 9.3
occupation 9.2
business 9.1
industrial 9.1
portrait 9.1
dirty 9
active 9
metal 8.8
radioactive 8.8
radiation 8.8
destruction 8.8
toxic 8.8
protective 8.8
nuclear 8.7
helmet 8.7
war 8.6
3d 8.5
dark 8.3
sport 8.2
fun 8.2
body 8
stalker 7.9
gun 7.9
render 7.8
power 7.5
future 7.4
technology 7.4
light 7.3
clothing 7.3
success 7.2
color 7.2
suit 7.2
science 7.1

Google
created on 2022-02-26

Gesture 85.3
Style 83.9
Black-and-white 83
Tints and shades 77.1
Monochrome photography 75.9
Flash photography 75.5
Monochrome 75.2
Vintage clothing 69.4
Room 67.1
Stock photography 65.1
Knee 61.9
Art 61.1
Child 60.6
Rectangle 59.7
Visual arts 58.4
Toddler 57
Fun 52.8

Microsoft
created on 2022-02-26

text 98.4
clothing 93.7
black and white 93.1
woman 91.1
toddler 83.2
footwear 81.8
person 79.6
girl 67.7
human face 67.7
lady 53.4
monochrome 52.6
posing 45.8
female 36.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 10-18
Gender Female, 72.6%
Calm 37.5%
Happy 27.8%
Sad 20.3%
Surprised 5.5%
Fear 3.2%
Angry 2.9%
Disgusted 1.5%
Confused 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Coat
Shoe
Person 97.7%
Coat 95%
Shoe 88.9%
Shoe 56.5%

Captions

Microsoft
created on 2022-02-26

a woman standing in front of a building 78.6%
a woman posing for a photo 78.5%
a girl posing for a photo 69.6%