Human Generated Data

Title

Untitled (man and woman at table wearing nametags)
Date

c. 1950
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21562

Human Generated Data

Title

Untitled (man and woman at table wearing nametags)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.6
Person 99.6
Person 99.4
Person 99.1
Apparel 98.8
Clothing 98.8
Glass 92
Beverage 75.5
Drink 75.5
Alcohol 70.8
Female 69.7
Suit 60
Overcoat 60
Coat 60
Wine 59.6
Wine Glass 59.6
Face 59.1
Goblet 58.2
Flower 57.9
Plant 57.9
Blossom 57.9
Hat 56.3
Furniture 55.7

Imagga
created on 2022-03-05

man 43.7
shower cap 40.4
person 38.3
nurse 35.7
cap 33
male 31.3
people 31.2
lab coat 30.8
clothing 28.3
senior 28.1
doctor 27.3
patient 26.9
coat 26.5
medical 25.6
adult 24.9
headdress 24.2
hospital 24
professional 21.7
couple 20.9
home 20.7
worker 19.5
happy 19.4
medicine 19.4
health 18.8
indoors 18.4
smiling 18.1
sitting 18
elderly 17.2
work 16.5
surgeon 16.5
illness 15.2
uniform 15.2
portrait 14.9
surgery 14.7
men 14.6
clinic 14.5
profession 14.4
together 14
room 13.8
occupation 13.7
women 13.4
mask 13.4
two people 12.6
retired 12.6
team 12.5
looking camera 12.5
job 12.4
care 12.3
lifestyle 12.3
garment 12.1
mature 12.1
camera 12
sick person 11.8
casual clothing 11.7
half length 11.7
mid adult 11.6
science 11.6
case 11.6
30s 11.5
retirement 11.5
working 11.5
restaurant 11.4
old 11.1
happiness 11
business 10.3
horizontal 10
60s 9.8
cheerful 9.7
laboratory 9.6
emergency 9.6
husband 9.5
enjoying 9.5
day 9.4
face 9.2
20s 9.2
holding 9.1
equipment 9
kitchen 8.9
senior adult 8.9
surgical 8.9
70s 8.9
50s 8.8
scientist 8.8
40s 8.8
middle aged 8.8
lab 8.7
older 8.7
chef 8.7
sick 8.7
casual 8.5
food 8.5
drink 8.4
inside 8.3
covering 8.2
specialist 8.2
waiter 8.2
consumer goods 8.1
group 8.1
looking 8
businessman 7.9
scrubs 7.9
sixties 7.8
smile 7.8
stethoscope 7.8
color 7.8
exam 7.7
research 7.6
living 7.6
adults 7.6
human 7.5
leisure 7.5
teamwork 7.4
emotion 7.4
student 7.2
handsome 7.1

Google
created on 2022-03-05

Smile 95.9
Black 89.8
Black-and-white 86.6
Hat 86.6
Style 84.1
Monochrome 79.2
Monochrome photography 78.1
Snapshot 74.3
Event 73.4
Vintage clothing 73.4
Tableware 72
Happy 70.3
Cooking 69.9
T-shirt 69.9
Sitting 67.8
Table 67.6
Room 66.2
Curtain 64.6
Stock photography 64.2
History 61.5

Microsoft
created on 2022-03-05

person 98.8
human face 96.6
text 94.4
sitting 94.2
outdoor 92.5
clothing 90.3
smile 86.6
man 78
bottle 76.9
drink 65
black and white 64

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 57.9%
Happy 50.7%
Surprised 40.9%
Calm 7.3%
Disgusted 0.7%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 54-64
Gender Male, 99.9%
Surprised 33.5%
Happy 32.4%
Sad 20.1%
Fear 5.2%
Confused 2.6%
Calm 2.1%
Disgusted 2.1%
Angry 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a man and a woman sitting at a table 90.9%
a man and a woman sitting on a table 83.5%
a man and woman sitting at a table 83.4%

Text analysis

Amazon

Hello!
PETITTI
DOMENICK
Hello
|
| a
a
YOURST

Google

Hella!
Helle Hella! PETIT
Helle
PETIT