Human Generated Data

Title

Untitled (two women and a man seated at table; two men playing darts)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5165
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two women and a man seated at table; two men playing darts)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99
Human 99
Person 98.7
Person 98.7
Person 96
Person 95
Person 85.3
Ceiling Fan 85.1
Appliance 85.1
Clothing 84.1
Apparel 84.1
Tie 77.9
Accessories 77.9
Accessory 77.9
Meal 69.1
Food 69.1
People 68.9
Room 59.3
Indoors 59.3
Photography 59
Photo 59
Face 58.5
Clinic 57.5
Coat 57.3
Suit 56.7
Overcoat 56.7

Imagga
created on 2022-01-23

senior 42.2
person 34.6
people 34
man 33.6
mature 29.7
elderly 29.7
old 29.3
couple 28.7
adult 28
male 27.7
home 27.1
retirement 25.9
happy 24.4
teacher 23.5
retired 21.3
portrait 20.7
smiling 19.5
room 19.2
aged 19
sitting 18
indoors 17.6
men 16.3
patient 16.2
pensioner 16
executive 15.6
older 15.5
husband 15.3
women 15
together 14.9
educator 14.5
lifestyle 14.5
looking 14.4
grandfather 13.6
smile 13.5
face 13.5
happiness 13.3
hand 12.9
indoor 12.8
groom 12.8
60s 12.7
professional 12.7
lady 12.2
grandmother 11.7
family 11.6
life 11.5
age 11.4
wife 11.4
cheerful 11.4
group 10.5
enjoying 10.4
love 10.3
casual 10.2
case 9.8
health 9.7
businessman 9.7
hair 9.5
grandma 9.5
friends 9.4
two 9.3
classroom 9.3
alone 9.1
modern 9.1
to 8.8
seniors 8.8
computer 8.8
chair 8.8
table 8.7
day 8.6
married 8.6
sick person 8.5
business 8.5
friendship 8.4
horizontal 8.4
camera 8.3
human 8.2
care 8.2
clothing 8.2
blackboard 8
medical 7.9
70s 7.9
work 7.8
sixties 7.8
hands 7.8
education 7.8
hospital 7.7
aging 7.7
drinking 7.7
businesspeople 7.6
relaxed 7.5
office 7.4
holding 7.4
laptop 7.3
wind instrument 7.1
brass 7
look 7

Google
created on 2022-01-23

Photograph 94.2
Black 89.8
Style 83.9
Black-and-white 83.5
Font 81
Adaptation 79.2
Suit 77.5
Snapshot 74.3
Monochrome photography 73.3
Vintage clothing 72.7
Monochrome 71.1
Room 70.7
Event 69.1
Table 68.4
Classic 63.9
Stock photography 63.3
Art 62.4
History 62.2
Photo caption 61.4
Hat 59.5

Microsoft
created on 2022-01-23

text 99.2
person 93.2
table 89.7
clothing 75
old 45.6

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 72.7%
Calm 86.5%
Sad 12.8%
Happy 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Male, 81.3%
Calm 100%
Sad 0%
Happy 0%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Ceiling Fan 85.1%
Tie 77.9%

Captions

Microsoft

a group of people sitting at a table 82.4%
a group of people standing around a table 82.3%
a group of people posing for a photo 82.2%

Text analysis

Amazon

9.
20
1505 9.
1505
12
15059.
MJ17
A70A
MJ17 YT37AY A70A
YT37AY
is

Google

15 059. 15059. 15059 MJ17 YT37A2 A7JA
15
059.
15059.
15059
MJ17
YT37A2
A7JA