Human Generated Data

Title

Untitled (four men at a desk with hats)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8277
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men at a desk with hats)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97.4
Human 97.4
Interior Design 95.8
Indoors 95.8
Person 93.7
Person 91
Room 75.2
Flooring 74.1
Person 69.2
People 68.9
Living Room 61.7
Furniture 58.7
Urban 56.9

Imagga
created on 2022-01-08

iron lung 70
respirator 55.9
breathing device 42
device 28.7
interior 24.7
room 24.6
home 23.9
person 20.7
people 20.6
man 20.4
hospital 18.5
table 18
indoors 17.5
shop 16.6
house 15.9
adult 15.6
work 14.2
male 14.2
indoor 13.7
chair 13.7
nurse 13.5
glass 13.3
decoration 13.1
lifestyle 13
men 12.9
happy 12.5
portrait 12.3
sitting 12
modern 11.9
happiness 11.7
kitchen 11.6
medical 11.5
cheerful 10.6
mercantile establishment 10.4
women 10.3
smiling 10.1
inside 10.1
furniture 10
color 10
worker 9.8
decor 9.7
health 9.7
light 9.3
elegance 9.2
bakery 9.2
business 9.1
holding 9.1
family 8.9
desk 8.6
horizontal 8.4
equipment 8.3
patient 8.3
office 8.2
new 8.1
working 7.9
clothing 7.9
smile 7.8
luxury 7.7
window 7.7
old 7.7
casual 7.6
two 7.6
fashion 7.5
fun 7.5
style 7.4
team 7.2
job 7.1
medicine 7

Google
created on 2022-01-08

Table 93.4
Black 89.6
Black-and-white 83.1
Fruit 82.6
Window 82.4
Plant 80.8
Tableware 77.1
Monochrome 72
Monochrome photography 71.5
Food 70.6
Machine 70.4
Flowerpot 69.9
Room 69.9
Cabinetry 65.3
Art 63.8
Stock photography 63.5
Still life photography 63.1
Chair 61.1
Glass 59
Toy 58.6

Microsoft
created on 2022-01-08

text 95.9
indoor 85.2
person 84.3
clothing 61.6

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 99.6%
Calm 99.3%
Surprised 0.3%
Confused 0.2%
Sad 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 45-51
Gender Female, 57.6%
Calm 98.1%
Sad 1.2%
Surprised 0.4%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%

Captions

Microsoft

a group of people in a room 84.8%
a group of people in a kitchen 68.2%
a group of people standing in a room 68.1%

Text analysis

Amazon

9326
9326.
MJIR
YT33A2
MJIR YT33A2 ARDA
ARDA

Google

9326. 9326 MJIE YT33A2 A3OA
9326.
9326
MJIE
YT33A2
A3OA