Human Generated Data

Title

Untitled (boy and girl with umbrella)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16909

Human Generated Data

Title

Untitled (boy and girl with umbrella)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16909

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.2
Human 99.2
Clothing 99
Apparel 99
Coat 89.9
Umbrella 86.8
Canopy 86.8
Shoe 84.9
Footwear 84.9
Overcoat 62.1
People 58.7
Shelter 58.5
Nature 58.5
Outdoors 58.5
Countryside 58.5
Building 58.5
Rural 58.5

Clarifai
created on 2023-10-28

umbrella 99.9
people 99.7
monochrome 99.5
rain 99.5
raincoat 98.1
man 96.2
adult 95.3
black and white 95
street 94.3
wear 94.2
portrait 93
child 92.8
two 92.6
coat 92.4
weather 92.4
storm 89.3
one 88.9
woman 88.4
protection 88.2
wedding 85.5

Imagga
created on 2022-02-26

musical instrument 30
violin 21.3
statue 19.6
bowed stringed instrument 19.2
mask 18.9
man 18.9
sculpture 16.6
accordion 15.8
wind instrument 15.7
world 15.3
person 15.3
art 15.1
stringed instrument 15.1
portrait 14.9
clothing 14.3
protection 13.6
holding 13.2
male 12.8
keyboard instrument 12.6
adult 12.5
style 11.9
old 11.8
danger 11.8
dirty 11.8
radiation 11.7
toxic 11.7
chemical 11.6
gas 11.6
monument 11.2
industrial 10.9
suit 10.8
radioactive 10.8
destruction 10.8
protective 10.7
nuclear 10.7
stalker 9.9
religion 9.9
accident 9.8
military 9.7
culture 9.4
architecture 9.4
face 9.2
historic 9.2
black 9.1
dress 9
people 8.9
soldier 8.8
disaster 8.8
steam 8.7
marble 8.7
ancient 8.6
doll 8.6
child 8.4
city 8.3
makeup 8.2
gun 8.1
plaything 8
smog 7.9
camouflage 7.9
robe 7.8
kimono 7.8
protect 7.7
fashion 7.5
historical 7.5
dark 7.5
religious 7.5
traditional 7.5
musician 7.5
smoke 7.4
safety 7.4
decoration 7.3
history 7.2
building 7.1
look 7

Google
created on 2022-02-26

Black 89.6
Flash photography 87.9
Sleeve 86.6
Gesture 85.3
Black-and-white 84.2
Style 84
Tree 80.3
Tints and shades 77.4
Plant 76.6
Art 74.4
Monochrome photography 73.3
Vintage clothing 72.6
Monochrome 72
Visual arts 68.5
Room 66.3
Fashion accessory 65.5
Stock photography 64.5
Font 63.4
Photo caption 58
History 56.4

Microsoft
created on 2022-02-26

outdoor 97.2
text 95.1
black and white 89.1
monochrome 52.2
clothing 50

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 68.6%
Calm 97.7%
Sad 1.2%
Confused 0.5%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 90%
Calm 89.7%
Surprised 2.9%
Confused 2.6%
Sad 1.9%
Angry 1%
Disgusted 0.7%
Happy 0.6%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.2%
Shoe 84.9%

Categories

Imagga

paintings art 91.5%
streetview architecture 8.3%

Captions

Microsoft
created on 2022-02-26

a girl holding an umbrella 41.2%
an old photo of a girl 41.1%
a person holding an umbrella 41%

Text analysis

Amazon

73
4
(MJ17--YT37A°--X

Google

MJI7--YT3RA°2-- XAGOX 73
MJI7--YT3RA°2--
XAGOX
73