Human Generated Data

Title

Untitled (domestic servants)
Date

c. 1950
People

Artist: John Howell, American active 1930s-1960s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.786

Human Generated Data

Title

Untitled (domestic servants)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.9
Human 99.9
Tie 99.4
Accessories 99.4
Accessory 99.4
Person 99
Glass 94.5
Person 92.9
Furniture 88.9
Table 82.9
Dining Table 81.2
Goblet 77.7
Meal 71
Food 71
Bar Counter 69.7
Pub 69.7
Pottery 65.5
Alcohol 64.5
Beverage 64.5
Drink 64.5
Dish 60
Liquor 58.4
Dining Room 58.2
Indoors 58.2
Room 58.2
Tablecloth 57.4
Person 56.8
Wine Glass 56.7
Wine 56.7

Imagga
created on 2022-01-22

waiter 100
dining-room attendant 90.7
employee 69.6
worker 49.7
man 43
person 39.4
male 34.1
people 33.5
business 30.4
businessman 30
adult 28.3
happy 27.6
businesswoman 25.5
meeting 23.6
smiling 22.4
professional 22.1
office 21.7
colleagues 21.4
job 21.2
businesspeople 20.9
working 19.5
portrait 19.4
domestic 19.4
20s 19.3
team 18.8
cheerful 18.7
group 18.6
talking 18.1
corporate 18.1
doctor 16.9
medical 16.8
home 16.8
lifestyle 16.6
30s 16.4
attractive 16.1
together 15.8
couple 15.7
smile 15
work 14.9
teamwork 14.8
indoors 14.1
holding 14
table 13.9
occupation 13.8
success 13.7
suit 13.7
standing 13
sitting 12.9
indoor 12.8
successful 11.9
drink 11.7
men 11.2
women 11.1
coworkers 10.8
care 10.7
medicine 10.6
four 10.6
staff 10.5
health 10.4
computer 10.4
desk 10.4
hospital 10.3
mature 10.2
happiness 10.2
camera 10.2
nurse 10.1
friendly 10.1
handsome 9.8
coat 9.8
40s 9.7
discussion 9.7
mid adult 9.7
lab coat 9.6
executive 9.5
casual 9.3
manager 9.3
coffee 9.3
kitchen 9
boardroom 8.9
four people 8.9
discussing 8.8
busy 8.7
stethoscope 8.7
clinic 8.6
ethnic 8.6
tie 8.5
career 8.5
two 8.5
patient 8.5
color 8.4
laptop 8.2
confident 8.2
life 8.1
associates 7.9
diverse 7.8
boy 7.8
thirties 7.8
expertise 7.8
corporation 7.7
partnership 7.7
expression 7.7
drinking 7.7
child 7.5
wine 7.4
looking 7.2
building 7.1
face 7.1
love 7.1
day 7.1
planner 7
pretty 7

Google
created on 2022-01-22

Photograph 94.3
Black 89.9
Human 88.9
Fashion 87.8
Black-and-white 86.4
Style 84
Tie 83.3
Drinkware 83.2
Smile 82.9
Stemware 81.3
Plate 80.8
Tableware 80.4
Curtain 80
Monochrome 79.7
People 79.5
Monochrome photography 79
Wine glass 76.6
Snapshot 74.3
Happy 73.4
Event 73.1

Microsoft
created on 2022-01-22

person 99.3
clothing 91
smile 64.7
human face 55.5
man 55.1
birthday cake 53.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Female, 100%
Sad 62.9%
Calm 34.4%
Surprised 0.9%
Confused 0.5%
Fear 0.4%
Disgusted 0.4%
Happy 0.4%
Angry 0.3%

AWS Rekognition

Age 48-54
Gender Male, 100%
Sad 65%
Confused 15.3%
Calm 7%
Disgusted 3.4%
Happy 3.1%
Fear 2.2%
Surprised 2.1%
Angry 1.9%

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Tie 99.4%

Captions

Microsoft

a couple of people that are standing in front of a cake 86.8%
a man and a woman standing in front of a cake 86.7%
a group of people standing in front of a cake 86.6%