Human Generated Data

Title

Untitled (elderly couple on porch, Sarasota, Florida)
Date

1948, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.28
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (elderly couple on porch, Sarasota, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1948, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Chair 100
Furniture 100
Person 98.1
Human 98.1
Person 97.4
Sitting 94.5
Wood 85.2
Clothing 77.3
Apparel 77.3
Couch 66.9
Porch 65.9
Face 59.8
Finger 56.5
Senior Citizen 56
LCD Screen 55.4
Electronics 55.4
Screen 55.4
Monitor 55.4
Display 55.4

Imagga
created on 2022-01-08

senior 39.4
barbershop 37.3
grandma 34.1
shop 31
hairdresser 29.5
person 28.2
retirement 27.9
elderly 27.8
old 27.2
man 26.9
people 26.8
retired 26.2
mature 25.1
home 24.7
happy 23.8
portrait 23.3
mercantile establishment 23.1
adult 22.7
family 22.2
male 22.1
lifestyle 20.2
aged 19.9
mother 18.7
smiling 15.9
place of business 15.4
casual 15.3
looking 15.2
smile 15
couple 14.8
human 14.2
together 14
grandfather 13.9
parent 13.9
grandmother 13.7
hair 13.5
happiness 13.3
health 13.2
gray 12.6
pensioner 12.5
lady 12.2
sitting 12
husband 11.5
wife 11.4
face 11.4
fun 11.2
one 11.2
outdoors 11.2
expression 11.1
love 11.1
child 11
call 10.8
older 10.7
age 10.5
head 10.1
alone 10
house 10
citizen 9.9
father 9.7
chair 9.1
care 9.1
daughter 9.1
blond 8.8
two 8.5
black 8.4
modern 8.4
park 8.2
women 7.9
grandparent 7.9
seniors 7.9
wrinkled 7.8
architecture 7.8
room 7.8
men 7.7
affection 7.7
lonely 7.7
establishment 7.7
married 7.7
joy 7.5
life 7.5
cheerful 7.3
indoors 7
look 7

Google
created on 2022-01-08

Black 89.6
Window 87
Black-and-white 85
Style 84.1
Comfort 78.7
Tints and shades 77
Snapshot 74.3
Vintage clothing 73.4
Monochrome 73.4
Monochrome photography 73
Sitting 71.2
Eyewear 67.8
Wrinkle 66.4
Stock photography 65.6
Room 64
Moustache 61.7
Art 59.3
Chair 58
Portrait 57.5
Facial hair 54.7

Microsoft
created on 2022-01-08

person 98.4
clothing 97.1
text 96.5
human face 95.6
man 92.9
black and white 91.7
old 75.9
street 73.3
monochrome 72.5
smile 65.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Confused 59.5%
Sad 13.9%
Angry 12.2%
Calm 8.7%
Disgusted 2.9%
Surprised 1.6%
Fear 0.7%
Happy 0.6%

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%

Captions

Microsoft

a person sitting in a chair talking on a cell phone 66.2%
a person sitting in a chair talking on the phone 66.1%
a person sitting in a chair talking on a phone 66%