Human Generated Data

Title

Untitled (couple seated on couch)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8385
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated on couch)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8385

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Apparel 99.9
Clothing 99.9
Human 99.5
Person 99.5
Person 99.3
Furniture 98.3
Suit 98.1
Coat 98.1
Overcoat 98.1
Chair 93.2
Couch 91.1
Pillow 88.3
Cushion 88.3
Robe 88
Fashion 88
Gown 87.7
Female 82
Shirt 81.6
Food 81
Meal 81
Wedding 79.9
Tuxedo 79.8
Plant 77.8
Bridegroom 74.9
Bookcase 73.5
Wedding Gown 72.9
Shelf 71.5
Dish 71
Table 70.5
Face 70.5
Woman 68.6
Indoors 68.1
Dress 65.9
Man 65.8
Flower 63.3
Blossom 63.3
Photography 60.5
Photo 60.5
Living Room 60.2
Room 60.2
Bride 59.6
Flower Arrangement 58.1
Long Sleeve 58
Sleeve 58
Tie 56.5
Accessories 56.5
Accessory 56.5

Clarifai
created on 2023-10-25

people 99.8
adult 99.1
group 98.4
monochrome 96.4
man 95.6
wear 92.2
two 90.7
leader 89.6
portrait 89.2
several 88.3
scientist 88
woman 87.9
administration 87.8
one 86.5
music 86.2
facial expression 85.6
group together 85.2
furniture 85.1
many 84.5
boxer 84.2

Imagga
created on 2022-01-09

man 46.4
person 38.3
people 34
senior 33.8
male 32.7
coat 29
adult 27.6
professional 26.6
lab coat 24.8
bow tie 24.7
doctor 24.5
medical 23.9
patient 23.3
specialist 23.3
necktie 22.6
mature 21.4
indoors 21.1
elderly 21.1
hospital 20.2
portrait 20.1
happy 20.1
couple 19.2
nurse 19.2
smiling 18.8
old 18.1
garment 17.7
home 17.6
room 16.6
lifestyle 16.6
work 16.5
care 15.6
retired 15.5
men 15.5
health 15.3
clothing 15.2
looking 15.2
businessman 15
sitting 14.6
office 14.6
worker 14.5
husband 14.3
medicine 14.1
occupation 13.8
pensioner 13.8
computer 13.6
wife 13.3
face 12.8
business 12.8
lab 12.6
team 12.6
laboratory 12.5
retirement 12.5
family 12.5
illness 12.4
clinic 12.4
together 12.3
hand 12.2
table 12.1
student 12
women 11.9
aged 11.8
60s 11.7
older 11.7
working 11.5
bed 11.4
education 11.3
casual 11
holding 10.7
to 10.6
test 10.6
exam 10.5
teacher 10.5
color 10
modern 9.8
two people 9.7
talking 9.5
love 9.5
desk 9.5
togetherness 9.4
happiness 9.4
grandfather 9.1
hairdresser 9.1
science 8.9
group 8.9
job 8.9
scientist 8.8
sick 8.7
serious 8.6
bright 8.6
research 8.6
smile 8.6
biology 8.5
meeting 8.5
glasses 8.3
indoor 8.2
practitioner 8.2
laptop 8.2
confident 8.2
newspaper 8.2
technology 8.2
romantic 8
stethoscope 8
scholar 7.9
day 7.9
expertise 7.8
chemistry 7.7
notes 7.7
profession 7.7
uniform 7.6
horizontal 7.5
learning 7.5
human 7.5
study 7.5
help 7.5
teamwork 7.4
suit 7.2
salon 7.1
look 7

Google
created on 2022-01-09

Smile 95.6
Black 89.6
Shelf 86.2
Picture frame 86
Black-and-white 85.3
Style 83.8
Font 80.7
Art 79.9
Adaptation 79.4
Bookcase 78.1
Monochrome photography 73.4
Hat 73.3
Monochrome 72.3
Vintage clothing 71.4
Event 70.8
Room 70.1
Publication 66.9
Photo caption 66
Tie 65.2
Sitting 64.8

Microsoft
created on 2022-01-09

text 99.9
person 89.7
human face 87.8
black and white 86.2
drawing 83.7
clothing 81.2
book 80.3
cartoon 77.3
sketch 57.9
shelf 52

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 92.9%
Happy 97.3%
Surprised 1.4%
Sad 0.5%
Calm 0.4%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 27-37
Gender Female, 99.4%
Happy 90%
Surprised 3.3%
Calm 3.3%
Confused 1.3%
Fear 0.9%
Disgusted 0.7%
Sad 0.3%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 56.5%

Categories

Imagga

streetview architecture 84%
paintings art 13.9%

Captions

Microsoft
created on 2022-01-09

a person holding a book 47.3%
a man and a woman in a library 47.2%
a man and a woman sitting in a library 37.7%

Text analysis

Amazon

12222
12222.
12222 SAN
CILBERT
Suremia
SAN

Google

2222.
2222.