Human Generated Data

Title

Untitled (two young children playing with Halloween Jack O' Lantern)
Date

1938
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8233
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two young children playing with Halloween Jack O' Lantern)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.7
Apparel 99.7
Person 99
Human 99
Person 96.9
Person 91.7
Home Decor 75
Shorts 71.1
Helmet 70.1
Hat 68.7
Indoors 64
Room 63.2
Shop 58.4
Sun Hat 57.9
Screen 56.9
Electronics 56.9
Stage 56.4
Overcoat 55.8
Coat 55.8

Imagga
created on 2022-01-08

man 19.5
people 17.3
clothing 17
musical instrument 16.7
brass 14.5
person 13.5
business 13.4
trombone 13.2
case 12.8
protection 12.7
black 12.7
adult 12.6
window 12
crutch 11.4
mask 11.4
male 11.3
clothes 11.2
city 10.8
percussion instrument 10.7
statue 10.7
helmet 10.6
wind instrument 10.3
suit 9.9
soldier 9.8
old 9.7
group 9.7
military 9.7
uniform 9.5
men 9.4
travel 9.1
stick 9.1
fashion 9
staff 8.8
warrior 8.8
urban 8.7
women 8.7
war 8.7
walk 8.6
industry 8.5
inside 8.3
occupation 8.2
weapon 8.2
industrial 8.2
sword 8.2
equipment 8.1
life 8.1
interior 8
mall 7.8
store 7.6
holding 7.4
shop 7.4
cleaner 7.3
danger 7.3
tourist 7.2
metal 7.2
world 7.1
building 7.1
steel 7.1
work 7.1
indoors 7

Google
created on 2022-01-08

Hat 88.7
Black-and-white 84.6
Style 83.8
Line 82
Monochrome photography 73.7
Sun hat 72.4
Monochrome 71.7
Curtain 68.9
Vintage clothing 66.9
Window 65.9
Stock photography 64.9
Room 64.6
Chair 64.5
Pattern 62.7
Tartan 61.8
Photo caption 53.1
Font 53
Still life photography 50.6
House 50.4

Microsoft
created on 2022-01-08

text 98.8
clothing 94.1
person 87.8
black and white 85.8
footwear 57
street 50

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 55.9%
Calm 84.9%
Happy 5.1%
Sad 4.4%
Disgusted 2%
Surprised 1.7%
Fear 0.7%
Confused 0.7%
Angry 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Helmet 70.1%

Captions

Microsoft

a person sitting in front of a building 54.9%
a person sitting in front of a building 54.8%
a person sitting on top of a building 48.5%

Text analysis

Amazon

8585
YT37A2
M 113 YT37A2
M 113

Google

8585 8885
8585
8885