Human Generated Data

Title

Untitled (couple sharing piano stool, Biddle home, Pennsylvania)
Date

1938, printed later
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.301
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple sharing piano stool, Biddle home, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.301

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.4
Human 98.4
Sitting 98.3
Person 96.8
Musician 89.1
Musical Instrument 89.1
Tie 87
Accessories 87
Accessory 87
Furniture 82.7
Clothing 75.4
Apparel 75.4
Table 65.4
Leisure Activities 61.8
Suit 59.6
Overcoat 59.6
Coat 59.6
Drum 55.7
Percussion 55.7
Person 42.5

Clarifai
created on 2023-10-25

people 99.9
portrait 98.8
adult 98.3
group 98.3
monochrome 98.2
man 97.9
two 97.1
three 96.9
room 96.5
group together 96.1
woman 93.8
chair 93.3
furniture 89.5
indoors 89.4
four 88.6
music 86.4
actor 84
sit 83.5
boy 76.6
facial expression 75.8

Imagga
created on 2022-01-08

person 42.6
man 37
people 31.8
male 29.8
computer 23.4
adult 23
home 22.3
work 21.2
sitting 20.6
indoors 20.2
happy 20.1
lifestyle 19.5
room 19.3
men 18.9
working 18.6
laptop 17.7
business 17.6
smiling 17.4
patient 17.3
office 17.1
portrait 16.8
desk 16.1
musical instrument 15.7
attractive 15.4
handsome 15.2
smile 15
worker 14.8
indoor 14.6
face 14.2
chair 14
looking 13.6
casual 13.6
case 13.5
table 13
two 12.7
one 12.7
sick person 12.6
happiness 12.5
kitchen 12.5
couple 12.2
cheerful 12.2
job 11.5
women 11.1
equipment 10.6
businessman 10.6
device 10.6
professional 10.3
senior 10.3
black 10.2
suit 10.2
confident 10
shop 9.9
pretty 9.8
interior 9.7
corporate 9.5
percussion instrument 9.4
teacher 9.4
house 9.2
clothing 9.2
alone 9.1
group 8.9
together 8.8
cooking 8.7
hairdresser 8.7
standing 8.7
meeting 8.5
mature 8.4
student 8.3
aged 8.1
lady 8.1
family 8
look 7.9
food 7.9
notebook 7.8
barbershop 7.7
modern 7.7
life 7.6
communication 7.6
fashion 7.5
fun 7.5
furniture 7.4
phone 7.4
light 7.4
occupation 7.3
meal 7.3
businesswoman 7.3
team 7.2

Google
created on 2022-01-08

Furniture 93.2
Table 90.9
Chair 90.8
Coat 86.4
Style 83.8
Vintage clothing 75.3
Snapshot 74.3
Suit 72.8
Blazer 72.7
Monochrome 71.8
Room 70.5
Classic 69.2
Monochrome photography 68.7
White-collar worker 67.9
Event 67.4
Sitting 66.8
Stock photography 64.5
Retro style 55.9
Photo caption 54.2
Employment 53.9

Microsoft
created on 2022-01-08

text 99.6
person 96.6
indoor 89.9
clothing 88.9
furniture 88
piano 87.5
music 78.4
table 74.1
black and white 68.5
chair 65.4
jazz 59.9
musical instrument 59.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-40
Gender Male, 99.2%
Calm 97.3%
Surprised 1.3%
Happy 0.5%
Angry 0.3%
Sad 0.3%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 20-28
Gender Female, 80.7%
Happy 99.4%
Confused 0.2%
Calm 0.2%
Sad 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Tie 87%
Suit 59.6%