Human Generated Data

Title

Untitled (formally dressed seated man and woman)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5640
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (formally dressed seated man and woman)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.9
Apparel 99.9
Person 99.7
Human 99.7
Person 99.5
Coat 99.5
Suit 99.5
Overcoat 99.5
Furniture 99
Sunglasses 97.1
Accessories 97.1
Accessory 97.1
Person 95.8
Female 93.6
Tuxedo 93.3
Person 93.3
Robe 92.1
Fashion 92.1
Dress 92
Bridegroom 90.1
Wedding 90.1
Gown 89.6
Face 83.1
Woman 81.7
Girl 75.1
Child 75.1
Blonde 75.1
Teen 75.1
Kid 75.1
Wedding Gown 73.2
Man 69.6
Mammal 67.3
Dog 67.3
Animal 67.3
Canine 67.3
Pet 67.3
Photography 67.1
Portrait 67.1
Photo 67.1
Chair 64.9
Indoors 64.5
Bride 61.7
Dining Table 60
Table 60
Food 59.3
Meal 59.3
Chair 52.3

Imagga
created on 2021-12-15

man 38.3
patient 37.9
person 36.5
people 34
male 32.7
nurse 24.9
adult 23.2
brass 22.6
senior 22.5
doctor 20.7
couple 20
work 19
case 18.8
medical 18.5
home 18.3
happy 18.2
hospital 18
sitting 17.2
room 17.2
sick person 16.8
working 16.8
wind instrument 16.7
men 16.3
professional 16.3
indoors 15.8
together 15.8
health 15.3
smiling 15.2
business 15.2
meeting 15.1
office 14.5
job 14.1
businessman 14.1
medicine 14.1
care 14
restaurant 14
businesswoman 13.6
worker 13.5
team 13.4
illness 13.3
table 13
occupation 12.8
clinic 12.6
businesspeople 12.3
cornet 12.2
teamwork 12
kin 11.9
women 11.9
surgeon 11.7
lifestyle 11.6
talking 11.4
cheerful 11.4
adults 11.3
musical instrument 11.3
mature 11.1
colleagues 10.7
elderly 10.5
group 10.5
clothing 10.4
chair 10.1
horizontal 10
holding 9.9
family 9.8
surgery 9.8
40s 9.7
retired 9.7
education 9.5
uniform 9.5
corporate 9.4
day 9.4
smile 9.3
communication 9.2
drink 9.2
old 9.1
color 8.9
computer 8.8
60s 8.8
love 8.7
busy 8.7
30s 8.7
retirement 8.6
grandfather 8.5
desk 8.5
casual 8.5
clothes 8.4
portrait 8.4
wine 8.3
equipment 8.2
indoor 8.2
looking 8
interior 8
specialist 7.9
two people 7.8
executive 7.7
modern 7.7
profession 7.7
two 7.6
enjoying 7.6
human 7.5
help 7.4
presentation 7.4
technology 7.4
coat 7.4
camera 7.4
treatment 7.3
father 7.2
suit 7.2
face 7.1
happiness 7

Google
created on 2021-12-15

Shirt 93.8
White 92.2
Black 89.6
Motor vehicle 88.7
Black-and-white 86.8
Eyewear 86.5
Style 84.1
Hat 81.5
T-shirt 79.2
Window 78.9
Automotive design 76.4
Monochrome photography 76.4
Monochrome 75.3
Snapshot 74.3
Cameras & optics 72.7
Sunglasses 72
Event 71.3
Font 70.4
Vintage clothing 67.1
Classic 65.6

Microsoft
created on 2021-12-15

wedding 98.6
person 97.7
text 96.5
clothing 94
outdoor 91.6
human face 89.8
wedding dress 88.9
smile 81.4
man 81.2
bride 81
woman 75.6
marriage 75.1
groom 57.4

Face analysis

Amazon

Google

AWS Rekognition

Age 34-50
Gender Female, 56.7%
Calm 54.5%
Happy 19%
Sad 17.9%
Confused 2.7%
Fear 2.2%
Angry 1.4%
Surprised 1.4%
Disgusted 0.8%

AWS Rekognition

Age 23-35
Gender Female, 90.2%
Happy 60.2%
Calm 23.8%
Surprised 9.5%
Confused 3.9%
Sad 1.2%
Angry 0.8%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 27-43
Gender Male, 85.2%
Sad 91.7%
Calm 4.6%
Happy 2%
Confused 0.8%
Fear 0.4%
Angry 0.3%
Surprised 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%
Sunglasses 97.1%
Dog 67.3%
Chair 64.9%

Captions

Microsoft

a couple of people that are standing in the street 76.2%
a couple of people that are standing in a room 76.1%
a group of people around each other 76%

Text analysis

Amazon

13943.
3

Google

13943.
13943. 13943.