Human Generated Data

Title

Untitled (man and woman in front of buffet table)

Date

1940

People

Artist: Samuel Cooper, American active 1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19504

Human Generated Data

Title

Untitled (man and woman in front of buffet table)

People

Artist: Samuel Cooper, American active 1950s

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Meal 99.8
Food 99.8
Dish 99.7
Person 99.7
Human 99.7
Furniture 99.5
Chair 99.5
Accessory 99.5
Tie 99.5
Accessories 99.5
Cream 99.4
Creme 99.4
Dessert 99.4
Cake 99.4
Icing 99.4
Tabletop 98.4
Person 98.4
Table 97.2
Dining Table 96.8
Clothing 95.2
Apparel 95.2
Indoors 91.7
Room 91.7
Dining Room 91.7
Home Decor 91.5
Sweets 84.3
Confectionery 84.3
Face 79.2
Female 72.7
Supper 72.3
Dinner 72.3
Overcoat 71.7
Coat 71.7
Suit 71.7
Beverage 65.2
Drink 65.2
Restaurant 63.9
Dress 61.8
Platter 59.5
Cafeteria 59
Blossom 57.2
Plant 57.2
Flower 57.2
Woman 56.7
Photo 56.3
Photography 56.3
Man 56.3
Buffet 55.6
Waiter 55

Clarifai
created on 2019-10-29

people 99.7
adult 98.5
man 97.1
leader 96
facial expression 93.4
portrait 92.8
administration 92.4
monochrome 91.5
group 90.7
wear 90.5
indoors 89.9
military 88.8
two 88.5
furniture 88.1
home 87.8
outfit 87.1
one 86.6
sit 86.2
chair 86.1
group together 83.3

Imagga
created on 2019-10-29

man 52.4
person 42.3
male 41.2
people 35.7
businessman 35.3
adult 29.5
business 29.2
office 27.3
happy 25.7
groom 23.9
smiling 22.4
couple 21.8
suit 21.4
portrait 20.1
indoors 19.3
men 18.9
cheerful 18.7
professional 18.5
standing 18.3
worker 18.1
handsome 17.8
senior 17.8
job 17.7
mature 17.7
executive 17
waiter 16.6
colleagues 16.5
businesspeople 16.1
home 16
indoor 15.5
corporate 15.5
sitting 15.5
team 15.2
lifestyle 15.2
laptop 14.7
group 14.5
smile 14.3
tie 14.2
desk 14.2
meeting 14.1
employee 13.9
20s 13.7
computer 13.7
businesswoman 13.6
30s 13.5
necktie 13.4
doctor 13.2
looking 12.8
casual 12.7
women 12.7
dining-room attendant 12.6
mid adult 12.5
happiness 12.5
clothing 12.3
bow tie 12
love 11.8
work 11.8
medical 11.5
together 11.4
teamwork 11.1
coworkers 10.8
face 10.7
working 10.6
attractive 10.5
table 10.4
room 10
confident 10
kin 10
associates 9.8
health 9.7
busy 9.6
elderly 9.6
stethoscope 9.5
hospital 9.4
two 9.3
manager 9.3
nurse 9.3
occupation 9.2
modern 9.1
care 9.1
life 8.9
family 8.9
day 8.6
bright 8.6
wife 8.5
career 8.5
mother 8.5
pretty 8.4
horizontal 8.4
old 8.4
color 8.3
camera 8.3
patient 8.3
holding 8.3
garment 7.9
medicine 7.9
guy 7.9
40s 7.8
middle aged 7.8
corporation 7.7
husband 7.6
one person 7.5
alone 7.3
fan 7.1

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

wall 95.4
person 93.4
clothing 90.1
man 90.1
standing 86.6
text 84.2
birthday cake 82.6
food 73.5
old 72
posing 68.5
white 66.9
smile 53.8
candle 51.6

Face analysis

Amazon

AWS Rekognition

Age 32-48
Gender Female, 52.8%
Calm 0.3%
Confused 0.5%
Surprised 92.4%
Happy 0.1%
Angry 0.4%
Disgusted 0.1%
Sad 0.7%
Fear 5.5%

AWS Rekognition

Age 23-35
Gender Male, 97.2%
Disgusted 4%
Happy 7.9%
Angry 7.3%
Confused 7.9%
Calm 31.2%
Fear 4.8%
Sad 5.6%
Surprised 31.3%

Feature analysis

Amazon

Person 99.7%
Tie 99.5%

Captions

Microsoft

a person standing in front of a window posing for the camera 87%
a black and white photo of a person 86.9%
a man and a woman posing for a photo 86.8%

Text analysis

Amazon

179710