Human Generated Data

Title

Untitled (man crouched next to two young girls eating ice cream; one girl has ice cream dripping down her stomach)

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5381

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man crouched next to two young girls eating ice cream; one girl has ice cream dripping down her stomach)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.5
Person 99.5
Person 99.5
Person 99.4
Person 99.3
Person 97.9
Footwear 97.6
Clothing 97.6
Shoe 97.6
Apparel 97.6
Person 96.7
Person 96.5
Shorts 94.2
Person 84.6
Shoe 82.1
Finger 69
Face 68.1
Nature 65.3
Paper 65.1
Text 64.4
People 63.6
Photo 62.1
Photography 62.1
Hand 60.8
Female 59.4
Girl 59
Poster 58.5
Advertisement 58.5
Flyer 58
Brochure 58
Outdoors 57.6

Imagga
created on 2022-01-23

kin 32.1
clothing 31.3
people 31.2
maillot 29.6
swimsuit 26.5
beach 26.3
garment 22.1
man 21.5
person 20.8
portrait 20.7
male 20.6
lifestyle 20.2
sibling 18.5
adult 17.7
happy 16.9
silhouette 16.6
couple 16.5
attractive 16.1
body 16
covering 15.7
model 15.6
sea 14.8
sexy 14.5
family 14.2
love 14.2
summer 14.1
happiness 14.1
fashion 13.6
sport 13.3
ocean 13.3
black 13.2
sand 13.2
vacation 13.1
child 12.8
active 12.7
fun 12.7
exercise 12.7
outdoors 12.7
fitness 12.6
dress 12.6
sunset 12.6
posing 12.4
men 12
water 12
pose 11.8
mother 11.7
sky 11.5
together 11.4
walking 11.4
pretty 11.2
style 11.1
women 11.1
youth 11.1
outdoor 10.7
run 10.6
lady 10.5
beachwear 10.5
group 10.5
boy 10.4
health 10.4
father 10.3
smiling 10.1
smile 10
consumer goods 9.6
looking 9.6
parent 9.4
holiday 9.3
face 9.2
leisure 9.1
gorgeous 9.1
healthy 8.8
hair 8.7
sitting 8.6
shore 8.4
joy 8.3
art 8.3
human 8.2
figure 8.2
recreation 8.1
sun 8
cute 7.9
brunette 7.8
hands 7.8
bathing cap 7.8
travel 7.7
running 7.7
old 7.7
casual 7.6
relax 7.6
legs 7.5
friendship 7.5
holding 7.4
brother 7.4
slim 7.4
fit 7.4
wellness 7.3
copy space 7.2
bikini 7.2
look 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.9
clothing 94
person 86.2
dress 77.5
footwear 76.4
girl 75.8
woman 75.5
black and white 73.2
posing 61
fog 54

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 75.1%
Surprised 67.8%
Calm 13.2%
Sad 8.8%
Happy 3.9%
Confused 2.2%
Fear 1.7%
Disgusted 1.3%
Angry 1.1%

AWS Rekognition

Age 13-21
Gender Female, 87%
Calm 44.8%
Sad 38.6%
Happy 6.3%
Fear 4%
Confused 2.1%
Surprised 1.8%
Angry 1.7%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Female, 69.1%
Calm 98.4%
Angry 0.4%
Sad 0.3%
Happy 0.2%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 97.6%

Captions

Microsoft

a little girl posing for a photo 65.9%
a group of people posing for a photo 65.8%
a boy and girl posing for a photo 44.4%

Text analysis

Amazon

FLORIDA
SARASOTA,
STEINMETZ,
STEINMETZ, SARASOTA, FLORIDA 26929.
26929.
26927
EVEELA
Four

Google

STEINMETZ,
STEINMETZ, SARASOTA, FLORIDA 26927.
SARASOTA,
FLORIDA
26927.