Human Generated Data

Title

Untitled (family around table eating cake)

Date

1944

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1612

Human Generated Data

Title

Untitled (family around table eating cake)

People

Artist: John Deusing, American active 1940s

Date

1944

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.6
Human 99.6
Person 99.4
Person 98.3
Dining Table 94.8
Furniture 94.8
Table 94.8
Person 94.8
Food 89
Meal 89
People 88.8
Dish 74.3
Face 71.5
Plant 67.2
Photography 65.3
Portrait 65.3
Photo 65.3
Art 63
Drawing 63
Female 60.8
Overcoat 59.5
Clothing 59.5
Apparel 59.5
Suit 59.5
Coat 59.5
Family 59.2
Girl 55.7
Indoors 55.1
Dining Room 55.1
Room 55.1

Imagga
created on 2021-12-14

person 49.9
patient 41.4
case 34.6
people 34
man 33.6
sick person 33.2
couple 30.5
adult 30
happy 29.4
home 28.7
male 28.3
smiling 28.2
happiness 26.6
together 26.3
love 22.9
senior 21.5
kin 20.7
sitting 19.7
portrait 19.4
smile 18.5
cheerful 17.9
lifestyle 17.3
fun 17.2
negative 16.6
women 16.6
indoors 14.9
film 14.3
men 13.7
grandfather 13.5
sofa 13.5
leisure 13.3
mother 13.1
casual 12.7
dress 12.6
family 12.4
elderly 12.4
sexy 12
husband 11.9
old 11.8
relaxing 11.8
house 11.7
married 11.5
room 11.3
fashion 11.3
human 11.2
relationship 11.2
looking 11.2
attractive 11.2
mature 11.1
two 11
model 10.9
lady 10.5
loving 10.5
togetherness 10.4
photographic paper 10.3
romantic 9.8
interior 9.7
one 9.7
couch 9.7
world 9.5
wife 9.5
relaxed 9.4
face 9.2
business 9.1
romance 8.9
older 8.7
retired 8.7
water 8.7
retirement 8.6
bride 8.6
holiday 8.6
nurse 8.6
talking 8.5
life 8.5
enjoying 8.5
friends 8.4
grandma 8.4
camera 8.3
wedding 8.3
care 8.2
outdoors 8.2
girls 8.2
aged 8.1
professional 8.1
group 8.1
living room 7.8
pretty 7.7
marriage 7.6
father 7.6
bed 7.6
living 7.6
groom 7.5
car 7.4
child 7.3
wet 7.1
hair 7.1
summer 7.1
working 7.1
work 7.1
day 7.1
businessman 7.1
modern 7

Google
created on 2021-12-14

Table 94.3
Tableware 92
Chair 85.5
Black-and-white 84.1
Style 83.9
Plate 80.2
Monochrome 76.9
Monochrome photography 76.4
Suit 73.6
Food 72.6
Serveware 72.6
Vintage clothing 71.9
Event 71
Room 68.1
Sitting 66.7
Classic 65.9
Desk 65.4
Art 65.2
History 65
Visual arts 62.7

Microsoft
created on 2021-12-14

text 99.1
person 97.3
posing 85.1
table 84.9
clothing 84.4
window 84.3
old 82
drawing 80.6
man 78.4
human face 76.5
group 67.3
people 60.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Female, 70.2%
Sad 48.4%
Calm 31.5%
Surprised 11.3%
Fear 4%
Angry 2.4%
Confused 1.6%
Happy 0.5%
Disgusted 0.1%

AWS Rekognition

Age 27-43
Gender Female, 53.5%
Happy 69.5%
Calm 29%
Angry 0.4%
Sad 0.4%
Surprised 0.3%
Confused 0.3%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 10-20
Gender Female, 62.6%
Happy 44.8%
Sad 19.8%
Calm 15.4%
Surprised 8%
Confused 6.3%
Disgusted 2.3%
Fear 1.7%
Angry 1.6%

AWS Rekognition

Age 41-59
Gender Female, 58.7%
Sad 78.7%
Calm 9.7%
Happy 7%
Confused 1.9%
Fear 1%
Angry 0.9%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 29-45
Gender Male, 63.3%
Happy 40.7%
Sad 40.3%
Calm 16.9%
Confused 0.8%
Surprised 0.5%
Fear 0.4%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 2-8
Gender Female, 78.2%
Calm 70.2%
Happy 25.6%
Sad 3.9%
Confused 0.2%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a vintage photo of a group of people sitting posing for the camera 97.5%
a group of people sitting at a table posing for a photo 97.4%
a group of people sitting posing for the camera 97.3%

Text analysis

Amazon

TU
SUBERBAM
РИССО SUBERBAM ЬВЕГГ
ЬВЕГГ
РИССО