Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Philadelphia)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12075
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.2
Human 99.2
Clothing 99.1
Apparel 99.1
Person 98.7
Person 98.7
Furniture 97.7
Footwear 76
Female 74.5
Bed 72.8
Shoe 70.1
Person 66.4
Indoors 65.3
Couch 64.2
Portrait 63.6
Photography 63.6
Face 63.6
Photo 63.6
Room 60.2
Woman 58.9
Door 58
Home Decor 55.8
Flooring 55.5
Hair 55.3

Imagga
created on 2022-01-15

chair 23.5
man 22.2
people 21.2
adult 21
wheelchair 20.4
person 20.1
groom 19.9
seat 15.7
male 15.2
fashion 15.1
portrait 14.2
sitting 12.9
dress 12.6
love 12.6
smiling 12.3
happy 11.9
women 11.9
building 11.8
business 11.5
bride 11.5
interior 11.5
hairdresser 11.5
indoors 11.4
window 11.3
men 11.2
happiness 11
salon 10.9
room 10.9
furniture 10.8
patient 10.7
lady 10.5
old 10.4
ancient 10.4
architecture 10.1
wedding 10.1
smile 10
outdoors 9.8
kin 9.7
sexy 9.6
looking 9.6
couple 9.6
home 9.6
model 9.3
holding 9.1
black 9
one 9
mother 8.7
lifestyle 8.7
professional 8.6
two 8.5
clothes 8.4
pretty 8.4
human 8.2
teacher 8.2
door 8.2
indoor 8.2
cheerful 8.1
posing 8
sick person 8
life 7.9
case 7.8
luxury 7.7
barber chair 7.7
attractive 7.7
elegance 7.6
bouquet 7.5
vintage 7.4
style 7.4
family 7.1
face 7.1
businessman 7.1

Google
created on 2022-01-15

Black 89.7
Black-and-white 85.7
Style 84
Monochrome 78.2
Monochrome photography 77.7
Room 72.4
Event 70.9
Performing arts 70.1
Entertainment 68.9
Stock photography 64.6
Art 64.2
Building 63.2
Dance 62.3
Suit 60.7
Choreography 53.3
Sitting 53
Still life photography 52.4
Vintage clothing 51.1
Visual arts 50.6
Street 50.4

Microsoft
created on 2022-01-15

text 98.3
person 94.2
black and white 89.7
clothing 88.2
monochrome 68
woman 56.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 74%
Calm 37.5%
Happy 21.9%
Sad 21%
Fear 7.4%
Surprised 5.6%
Disgusted 2.6%
Angry 2.3%
Confused 1.6%

AWS Rekognition

Age 18-24
Gender Male, 89.7%
Calm 99.8%
Sad 0.1%
Disgusted 0%
Happy 0%
Fear 0%
Surprised 0%
Confused 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people standing in front of a building 66%
a group of people standing on top of a building 59%
a group of people standing outside of a building 58.9%

Text analysis

Amazon

MJIR
U
MJIR YT37A2 ARDA
67212
YT37A2
ARDA

Google

MJIR YT37A2 A73A 6922
MJIR
YT37A2
A73A
6922