Human Generated Data

Title

Untitled (couple seated on porch, Key Largo, Florida)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10585

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated on porch, Key Largo, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.7
Person 99.7
Person 99.2
Apparel 98.9
Clothing 98.9
Footwear 97.7
Shoe 97.7
Shoe 97.4
Furniture 94.1
Chair 94.1
Shorts 82.1
Sitting 76.7
Text 68.9
Overcoat 65.7
Coat 65.7
Sleeve 56.7
Long Sleeve 55.9

Imagga
created on 2022-01-09

barbershop 79.8
shop 66.7
hairdresser 57.9
mercantile establishment 48.9
people 34
place of business 32.6
man 29.6
male 26.2
couple 24.4
happy 23.2
adult 22
smiling 21.7
family 20.5
person 19.8
men 19.7
chair 19.1
barber chair 18.3
home 17.5
portrait 16.8
establishment 16.2
senior 15.9
indoors 15.8
love 15.8
patient 15.5
health 15.3
women 15
medical 15
smile 15
hospital 14.4
mother 13.6
dress 12.6
husband 12.4
sitting 12
inside 12
room 11.8
happiness 11.7
child 11.7
nurse 11.7
illness 11.4
together 11.4
two 11
seat 11
lifestyle 10.8
care 10.7
medicine 10.6
bride 10.5
wife 10.4
mature 10.2
old 9.8
cheerful 9.7
sick 9.7
bed 9.5
work 9.4
two people 8.7
father 8.7
salon 8.6
face 8.5
doctor 8.5
wedding 8.3
occupation 8.2
fun 8.2
furniture 8.2
life 7.9
boy 7.8
standing 7.8
attractive 7.7
professional 7.7
elderly 7.7
daughter 7.6
loving 7.6
human 7.5
relationship 7.5
leisure 7.5
back 7.3
indoor 7.3
girls 7.3
clinic 7.3
looking 7.2
holiday 7.2
kid 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.2
text 98.9
outdoor 96.8
clothing 95.4
human face 79.8
smile 58.8
woman 53.3
posing 48.2

Face analysis

Amazon

Google

AWS Rekognition

Age 53-61
Gender Male, 99.5%
Sad 46.2%
Happy 34.5%
Calm 9.9%
Angry 2.9%
Confused 2.8%
Surprised 1.7%
Disgusted 1.3%
Fear 0.8%

AWS Rekognition

Age 28-38
Gender Female, 84.3%
Calm 46.6%
Sad 44.6%
Happy 2.5%
Angry 1.7%
Surprised 1.5%
Disgusted 1.5%
Fear 0.8%
Confused 0.7%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 91%
Happy 3.6%
Sad 2.8%
Disgusted 1%
Confused 0.8%
Surprised 0.4%
Angry 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 97.7%

Captions

Microsoft

a group of people posing for a photo 89.3%
a group of people standing in front of a building 89.2%
a group of people posing for the camera 89.1%

Text analysis

Amazon

SARASOTA,
STEINMETZ,
FLORIDA
STEINMETZ, SARASOTA, FLORIDA 26006.
26006.
YТЭAX
199

Google

YT3A2
26006.
SARASOTA,
YT3A2 AGON 26००6. STEINMETZ, SARASOTA, FLORIDA 26006.
26००6.
FLORIDA
AGON
STEINMETZ,