Human Generated Data

Title

Untitled (boy and girl with umbrella)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16909

Human Generated Data

Title

Untitled (boy and girl with umbrella)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.2
Person 99.2
Clothing 99
Apparel 99
Coat 89.9
Umbrella 86.8
Canopy 86.8
Footwear 84.9
Shoe 84.9
Overcoat 62.1
People 58.7
Nature 58.5
Outdoors 58.5
Rural 58.5
Countryside 58.5
Shelter 58.5
Building 58.5

Imagga
created on 2022-02-26

musical instrument 30
violin 21.3
statue 19.6
bowed stringed instrument 19.2
mask 18.9
man 18.9
sculpture 16.6
accordion 15.8
wind instrument 15.7
world 15.3
person 15.3
art 15.1
stringed instrument 15.1
portrait 14.9
clothing 14.3
protection 13.6
holding 13.2
male 12.8
keyboard instrument 12.6
adult 12.5
style 11.9
old 11.8
danger 11.8
dirty 11.8
radiation 11.7
toxic 11.7
chemical 11.6
gas 11.6
monument 11.2
industrial 10.9
suit 10.8
radioactive 10.8
destruction 10.8
protective 10.7
nuclear 10.7
stalker 9.9
religion 9.9
accident 9.8
military 9.7
culture 9.4
architecture 9.4
face 9.2
historic 9.2
black 9.1
dress 9
people 8.9
soldier 8.8
disaster 8.8
steam 8.7
marble 8.7
ancient 8.6
doll 8.6
child 8.4
city 8.3
makeup 8.2
gun 8.1
plaything 8
smog 7.9
camouflage 7.9
robe 7.8
kimono 7.8
protect 7.7
fashion 7.5
historical 7.5
dark 7.5
religious 7.5
traditional 7.5
musician 7.5
smoke 7.4
safety 7.4
decoration 7.3
history 7.2
building 7.1
look 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 68.6%
Calm 97.7%
Sad 1.2%
Confused 0.5%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 90%
Calm 89.7%
Surprised 2.9%
Confused 2.6%
Sad 1.9%
Angry 1%
Disgusted 0.7%
Happy 0.6%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Shoe 84.9%

Captions

Microsoft

a girl holding an umbrella 41.2%
an old photo of a girl 41.1%
a person holding an umbrella 41%

Text analysis

Amazon

73
4
(MJ17--YT37A°--X

Google

XAGOX
73
MJI7--YT3RA°2--
MJI7--YT3RA°2-- XAGOX 73