Human Generated Data

Title

Untitled (couple seated next to baby with toys)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5011
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated next to baby with toys)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.4
Human 99.4
Furniture 96.4
Person 95.2
Clothing 95.2
Apparel 95.2
Person 95.1
Chair 94.4
Person 85.9
Face 79.8
Table 69.9
Chess 68.3
Game 68.3
Kid 66.1
Child 66.1
Female 65.8
Indoors 65.8
Dish 65.3
Food 65.3
Meal 65.3
Portrait 64.2
Photography 64.2
Photo 64.2
People 63
Dining Table 60.9
Room 59.1
Girl 58.4
Baby 58.4
Bed 57.5

Imagga
created on 2022-01-22

negative 45.9
film 37.2
photographic paper 28
person 25.3
people 21.7
man 20.1
photographic equipment 18.7
portrait 16.8
black 16.2
male 15.7
adult 14.7
face 14.2
art 13.6
human 13.5
kin 12
professional 11.9
fashion 11.3
sexy 11.2
medical 10.6
instrument 10.4
dress 9.9
team 9.9
science 9.8
bride 9.7
working 9.7
medicine 9.7
costume 9.5
women 9.5
sitting 9.4
decoration 9.4
work 9
health 9
happy 8.8
laboratory 8.7
love 8.7
happiness 8.6
men 8.6
elegant 8.6
grunge 8.5
studio 8.4
salon 8.2
student 8.1
music 8.1
lady 8.1
mask 8
look 7.9
bright 7.9
model 7.8
lab 7.8
play 7.8
sibling 7.7
equipment 7.7
luxury 7.7
grandfather 7.7
pretty 7.7
test 7.7
chair 7.6
doctor 7.5
one 7.5
silhouette 7.4
clothing 7.4
technology 7.4
symbol 7.4
wedding 7.4
worker 7.2
romantic 7.1
family 7.1
interior 7.1
day 7.1
modern 7

Google
created on 2022-01-22

Photograph 94.2
Hat 90.1
Style 84
Black-and-white 83.7
Tableware 81.3
Monochrome 75.9
Monochrome photography 75.9
Snapshot 74.3
Cooking 74.2
Vintage clothing 70.6
Sitting 68.1
Serveware 66.3
Art 66.2
Plate 64.5
Stock photography 64.2
Table 64.1
Room 61.4
Illustration 59.1
Service 56.7
History 55.3

Microsoft
created on 2022-01-22

person 97.8
text 95.4
clothing 91.4
human face 75.6
black and white 69.8
old 67.1
people 66.1
posing 57.4
smile 55.7

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 97.2%
Happy 66.9%
Sad 14.2%
Calm 6%
Disgusted 3.3%
Confused 2.8%
Surprised 2.8%
Angry 2.1%
Fear 1.9%

AWS Rekognition

Age 39-47
Gender Female, 99.8%
Happy 96.8%
Calm 1.1%
Angry 0.6%
Sad 0.6%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chess 68.3%

Captions

Microsoft

a group of people posing for a photo 96.5%
a group of people sitting posing for the camera 96.4%
a group of people sitting at a table posing for a photo 94.7%

Text analysis

Amazon

11425.
as

Google

11425.
11425.