Human Generated Data

Title

Untitled (family gathered around table for baby's birthday)
Date

c. 1945
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1850

Human Generated Data

Title

Untitled (family gathered around table for baby's birthday)

People

Artist: John Deusing, American active 1940s

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.5
Person 98
Person 97.6
Person 97.4
Person 97.3
Dining Table 97.2
Furniture 97.2
Table 97.2
Person 96.6
Person 95.9
Person 95.8
Person 95.5
Room 94.3
Indoors 94.3
Dining Room 85.1
Chair 81.3
Chair 80.6
People 78.4
Sitting 73.1
Tablecloth 73
Meal 70.4
Food 70.4
Drawing 70.4
Art 70.4
Crowd 70.2
Person 65.8
Face 64.2
Female 59.6
Glass 58.5
Sketch 56.4
Linen 56.2
Home Decor 56.2
Plant 55.9
Dressing Room 55.3

Imagga
created on 2021-12-14

table 35.6
glass 34.6
wineglass 34.5
wine 28.7
restaurant 28.1
drink 26.7
man 26.1
dinner 25.5
party 24.9
people 24.5
meal 21.7
happy 20.7
celebration 19.9
indoors 19.3
person 18.9
alcohol 17.6
dining 17.1
male 17
business 17
smiling 16.6
food 16.5
sitting 16.3
men 16.3
home 15.9
room 15.7
meeting 15.1
interior 15
women 15
couple 14.8
wedding 14.7
lunch 14.6
lifestyle 14.4
businessman 14.1
banquet 14
adult 14
glasses 13.9
cheerful 13.8
20s 13.7
elegant 13.7
setting 13.5
drinking 13.4
enjoying 13.2
champagne 13.2
together 13.1
eating 12.6
decoration 12.6
chemistry 12.6
laboratory 12.5
businesspeople 12.3
service 12
catering 11.7
colleagues 11.7
team 11.6
worker 11.2
businesswoman 10.9
reception 10.8
group 10.5
friends 10.3
perfume 9.8
science 9.8
decor 9.7
working 9.7
lab 9.7
special 9.7
beverage 9.6
talking 9.5
biology 9.5
luxury 9.4
day 9.4
friendship 9.4
mature 9.3
event 9.2
indoor 9.1
holding 9.1
portrait 9.1
work 8.8
60s 8.8
middle aged 8.8
having 8.7
30s 8.7
formal 8.6
research 8.6
container 8.5
hall 8.5
plate 8.5
bottle 8.2
breakfast 8.1
medical 7.9
socializing 7.9
entertaining 7.9
senior adult 7.9
four people 7.9
sixties 7.8
casual clothing 7.8
experiment 7.8
color 7.8
toast 7.7
four 7.7
hotel 7.6
senior 7.5
leisure 7.5
furniture 7.4
office 7.4
toiletry 7.1
chemical 7.1
modern 7

Google
created on 2021-12-14

Table 93
Plant 89.8
Chair 88.1
Black-and-white 85.5
Interior design 85.4
Tablecloth 84
Style 83.9
Tableware 82.4
Snapshot 74.3
Monochrome 73.5
Monochrome photography 73.3
Event 73.2
Vintage clothing 72.6
Kitchen & dining room table 70.6
Houseplant 69.6
Room 68.1
Sitting 67.3
Dining room 65.2
History 64.6
Stock photography 61.9

Microsoft
created on 2021-12-14

table 95.2
person 94.6
text 94
indoor 93.7
candle 91.8
wedding 78.7
tableware 71.4
old 70.3
wedding cake 61.7
vase 52.3
posing 44.6

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 96%
Calm 64.2%
Sad 21.5%
Confused 6%
Happy 5.3%
Angry 1.8%
Surprised 0.7%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 47-65
Gender Male, 96.8%
Calm 90.1%
Sad 4.2%
Happy 3.4%
Confused 1.9%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 28-44
Gender Female, 61.2%
Calm 93.9%
Surprised 2.1%
Sad 1.8%
Happy 1.2%
Angry 0.6%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 14-26
Gender Female, 96.1%
Calm 77.4%
Happy 7.2%
Sad 4%
Angry 4%
Surprised 3.7%
Fear 1.9%
Confused 1.4%
Disgusted 0.4%

AWS Rekognition

Age 27-43
Gender Female, 67.3%
Sad 73%
Calm 18.8%
Confused 4.2%
Angry 1.5%
Fear 1.5%
Surprised 0.4%
Happy 0.4%
Disgusted 0.1%

AWS Rekognition

Age 19-31
Gender Female, 75.8%
Sad 37.7%
Calm 30.1%
Happy 28.2%
Angry 1.6%
Confused 0.9%
Fear 0.9%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 16-28
Gender Female, 71.1%
Calm 49.4%
Happy 20%
Angry 14.4%
Sad 9.8%
Fear 3.5%
Confused 1.9%
Surprised 0.6%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Male, 85.2%
Calm 48.1%
Sad 28.5%
Happy 18.8%
Confused 1.9%
Angry 0.9%
Surprised 0.8%
Fear 0.5%
Disgusted 0.5%

AWS Rekognition

Age 0-4
Gender Female, 70.1%
Happy 55.2%
Sad 25.4%
Calm 11%
Confused 2.4%
Angry 2.1%
Surprised 1.8%
Fear 1.8%
Disgusted 0.3%

AWS Rekognition

Age 1-7
Gender Female, 74.5%
Calm 88.4%
Happy 4%
Sad 3.4%
Surprised 1.7%
Confused 1.6%
Angry 0.3%
Disgusted 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Dining Table 97.2%
Chair 81.3%

Captions

Microsoft

a group of people posing for a photo 92.6%
an old photo of a group of people posing for the camera 90.7%
a group of people posing for the camera 90.6%

Text analysis

Amazon

CAC