Human Generated Data

Title

Untitled (girl with jack-o-lantern man, Pennsylvania)
Date

1938, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.249
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (girl with jack-o-lantern man, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Clothing 96.9
Apparel 96.9
Person 94.4
Toy 66.8
Shoe 60.5
Footwear 60.5
Chair 58.5
Furniture 58.5

Imagga
created on 2022-01-08

musical instrument 32.7
adult 29.1
person 28.6
people 26.2
accordion 23.2
shop 23.1
home 23.1
happy 21.9
salon 21
fashion 20.4
keyboard instrument 18.9
smiling 18.8
cheerful 18.7
interior 17.7
portrait 17.5
women 17.4
happiness 17.2
wind instrument 16.7
indoors 16.7
family 16
child 16
cute 15.8
smile 15.7
clothing 15.2
one 14.9
blond 14.9
mother 14.7
lady 14.6
sexy 14.5
man 14.1
attractive 14
youth 13.6
casual 13.6
style 13.4
black 13.3
holding 13.2
room 13.1
lifestyle 13
dress 12.6
kid 12.4
barbershop 12.4
chair 12.2
clothes 12.2
looking 12
indoor 11.9
joy 11.7
kitchen 11.6
urban 11.4
hair 11.1
shopping 11
model 10.9
male 10.7
human 10.5
boy 10.4
device 10.3
mercantile establishment 10.2
parent 10.1
house 10
girls 10
face 9.9
posing 9.8
fun 9.7
brunette 9.6
standing 9.6
store 9.4
inside 9.2
pretty 9.1
little 8.8
outfit 8.7
sitting 8.6
barber chair 8.5
sale 8.3
stylish 8.1
childhood 8.1
bag 8
shopper 7.9
together 7.9
son 7.8
mall 7.8
two 7.6
retail 7.6
elegance 7.6
teenager 7.3
domestic 7.3
life 7.2
modern 7

Google
created on 2022-01-08

Table 88.5
Hat 86.4
Picture frame 84
Chair 81.3
Sun hat 77.7
Vintage clothing 75.5
Monochrome 69.4
Room 69.3
Monochrome photography 67.4
Art 67.1
Classic 64.8
Stock photography 63.6
Sitting 62.2
Retro style 57.6
Visual arts 53.3
Toddler 52.9
House 52.4
Child 52
Curtain 51.9
Rectangle 51.6

Microsoft
created on 2022-01-08

wall 97.3
text 97.1
indoor 91.8
furniture 81
clothing 79.4
person 68.1
piano 67.7
old 65
child 57.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 99.7%
Happy 99.8%
Fear 0%
Surprised 0%
Calm 0%
Sad 0%
Confused 0%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 60.5%

Captions

Microsoft

a vintage photo of a person 90.8%
a vintage photo of a person in a room 90.7%
an old photo of a person 89%