Human Generated Data

Title

Untitled ("Creamette" employee handing ice cream cone to boy through window)
Date

1949
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5389
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled ("Creamette" employee handing ice cream cone to boy through window)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5389

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.3
Person 99.2
Room 94.4
Indoors 94.4
Door 93.5
Interior Design 92.4
Person 89.6
Text 63.3
Bedroom 57.3
Dorm Room 56.3
Dressing Room 55.7

Clarifai
created on 2023-10-26

monochrome 99.3
people 99.2
indoors 97.7
window 97.7
adult 96.1
man 95
woman 94.1
vehicle window 93
two 90.1
couple 82.2
mirror 82.1
door 80.5
family 79.5
technology 78.9
child 78.2
glass 77.6
chair 77.4
room 77.2
one 77.1
refrigerator 76.9

Imagga
created on 2022-01-23

sliding door 41.9
door 37
laptop 31.5
computer 31.4
window 28.7
people 28.4
office 28
home 25.5
movable barrier 25.1
business 24.9
adult 24.7
man 24.2
case 23.1
indoors 22.8
male 22
happy 21.9
interior 21.2
person 21
room 21
businessman 19.4
corporate 18.9
work 18.8
lifestyle 18.8
attractive 18.2
smile 17.8
professional 17.1
working 16.8
looking 16.8
house 16.7
barrier 16.6
indoor 16.4
businesswoman 16.4
modern 16.1
pretty 16.1
notebook 16
executive 15.8
portrait 15.5
casual 15.2
windowsill 14.6
smiling 14.5
women 14.2
job 14.2
meeting 14.1
sitting 13.7
men 13.7
confident 13.6
technology 13.4
businesspeople 13.3
together 13.1
table 13.1
face 12.8
communication 12.6
desk 12.5
success 12.1
alone 11.9
sill 11.8
furniture 11.4
framework 11.2
support 11.2
screen 10.8
passenger 10.7
living 10.4
structural member 10.2
teamwork 10.2
occupation 10.1
successful 10.1
light 10
worker 10
education 9.5
smart 9.4
happiness 9.4
inside 9.2
cheerful 8.9
lady 8.9
handsome 8.9
consultant 8.8
standing 8.7
windows 8.6
bright 8.6
supporting structure 8.5
keyboard 8.4
manager 8.4
obstruction 8.4
color 8.3
20s 8.2
team 8.1
group 8.1
refrigerator 8
to 8
protective covering 7.9
day 7.8
couple 7.8
building 7.8
architecture 7.8
1 7.7
sofa 7.7
two 7.6
talking 7.6
career 7.6
horizontal 7.5
contemporary 7.5
window screen 7.5
mature 7.4
life 7.3
student 7.2
suit 7.2
window shade 7.2
hair 7.1

Google
created on 2022-01-23

Hat 86.3
Black-and-white 85.8
Style 84
Baseball cap 83.3
Fedora 81.6
Cap 80.5
Art 79.4
Monochrome photography 75.7
Monochrome 75.7
T-shirt 73.2
Glass 68
Room 67.4
Visual arts 66.9
Stock photography 63.5
Sun hat 62.5
Street 57.6
Font 56.2
Sitting 55.8
Machine 54.6
Hoodie 53.5

Microsoft
created on 2022-01-23

text 97.9
man 95.3
person 92.8
window 89.5
clothing 88.4
black and white 87.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 99%
Calm 66.3%
Surprised 10.7%
Sad 9.3%
Confused 7.3%
Disgusted 2.1%
Angry 1.7%
Happy 1.6%
Fear 1%

AWS Rekognition

Age 24-34
Gender Female, 96.9%
Calm 89.8%
Sad 5.1%
Surprised 1.5%
Happy 1%
Confused 1%
Disgusted 0.7%
Fear 0.5%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Categories

Imagga

interior objects 90%
paintings art 9.7%

Captions

Microsoft
created on 2022-01-23

a man standing in front of a window 89.2%
a man standing next to a window 85.8%
a man standing by a window 85.2%

Text analysis

Amazon

FLORIDA
STEINMETZ, SARASOTA, FLORIDA
SARASOTA,
STEINMETZ,
26930.
Cacamette
KODAK-SL

Google

26930. STEINMETZ, SARASOTA, FLORIDA
26930.
STEINMETZ,
SARASOTA,
FLORIDA