Human Generated Data

Title

Untitled (children seated around birthday party table with woman standing in doorway of room)

Date

1942

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10181

Human Generated Data

Title

Untitled (children seated around birthday party table with woman standing in doorway of room)

People

Artist: Martin Schweig, American 20th century

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Chair 99.9
Furniture 99.9
Room 97.2
Indoors 97.2
Person 95.8
Human 95.8
Person 95.4
Person 93.3
Person 90.8
Interior Design 90.3
Person 89.1
Person 88.5
Person 87.3
Person 84.3
Classroom 84.2
School 84.2
Person 83.4
Person 83
Person 79.4
Person 78.5
Table 74.3
Painting 72.9
Art 72.9
Person 71
Chair 70.6
Kindergarten 69.5
People 67.4
Dining Table 63.1
Person 62.5
Food 61.8
Reception 60.7
Meal 59.7
Dining Room 59.4
Waiting Room 57.9
Reception Room 57.9
Couch 57.8
Person 51.7
Person 41.9

Imagga
created on 2022-01-22

room 40.9
interior 38.9
table 32.6
chair 29.1
restaurant 21.7
home 21.5
dinner 18.4
decor 17.7
indoors 17.6
dining 17.1
furniture 17.1
brass 16.9
inside 15.6
people 15.1
house 15
party 14.6
indoor 14.6
wind instrument 14.3
drink 14.2
wedding 13.8
design 13.6
person 13.5
glass 13.4
decoration 13.4
life 13
elegant 12.8
tables 12.8
chairs 12.7
style 12.6
musical instrument 12.3
celebration 12
window 11.9
modern 11.9
wood 11.7
service 11.1
food 11.1
banquet 10.7
lunch 10.4
luxury 10.3
love 10.3
floor 10.2
wine 10.2
man 10.1
eat 10.1
family 9.8
setting 9.6
comfortable 9.5
meal 9.5
lifestyle 9.4
seat 9.3
holiday 9.3
bouquet 9.1
domestic 9
dress 9
catering 8.8
bride 8.6
residential 8.6
hall 8.6
wall 8.5
male 8.5
blackboard 8.4
classroom 8.4
place 8.4
old 8.4
event 8.3
fashion 8.3
happy 8.1
night 8
black 7.9
women 7.9
stool 7.9
flowers 7.8
flower 7.7
fork 7.7
hotel 7.6
elegance 7.6
vintage 7.4
happiness 7

Google
created on 2022-01-22

Chair 83.9
Table 80.9
Snapshot 74.3
Event 73.7
Vintage clothing 72.3
Room 71.1
Art 66.5
Monochrome 63
Classic 62.8
History 62.3
Stock photography 62.2
Child 61.6
Class 57.4
Suit 56.8
Photo caption 52.2
Collection 51.9
Monochrome photography 50.6

Microsoft
created on 2022-01-22

text 94.5
indoor 93.6
old 88.4
clothing 86.4
person 85.3
black 85.2
white 73.3
furniture 73.2
woman 68.1
chair 64.1
human face 58
retro 54.3
vintage 49.4
table 27.1
family 20.9
dining table 19.1
dining room 7.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 83%
Calm 86%
Angry 5.6%
Sad 5.4%
Fear 1.5%
Happy 0.4%
Surprised 0.4%
Disgusted 0.3%
Confused 0.3%

AWS Rekognition

Age 1-7
Gender Female, 95.3%
Calm 99.2%
Sad 0.3%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 1-7
Gender Male, 94.1%
Calm 95.7%
Sad 1.8%
Confused 1%
Angry 0.9%
Surprised 0.2%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 92.7%
Sad 6.7%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 0-4
Gender Female, 88.7%
Calm 98.9%
Sad 0.3%
Happy 0.2%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 0-4
Gender Male, 100%
Calm 98.4%
Sad 0.5%
Surprised 0.5%
Angry 0.3%
Confused 0.2%
Fear 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Angry 28.8%
Confused 22.6%
Sad 22.1%
Calm 16.7%
Disgusted 3.5%
Surprised 3.2%
Fear 2.6%
Happy 0.5%

AWS Rekognition

Age 0-6
Gender Female, 98.8%
Calm 98.1%
Angry 0.6%
Sad 0.3%
Happy 0.3%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 0-6
Gender Female, 100%
Calm 91.8%
Surprised 2.3%
Confused 2.3%
Disgusted 0.9%
Angry 0.8%
Sad 0.7%
Happy 0.6%
Fear 0.5%

AWS Rekognition

Age 0-4
Gender Female, 79%
Calm 76.5%
Fear 9.1%
Sad 6%
Confused 3.4%
Surprised 3%
Disgusted 0.9%
Angry 0.6%
Happy 0.5%

AWS Rekognition

Age 2-8
Gender Male, 73.5%
Calm 86%
Sad 7.7%
Disgusted 1.3%
Angry 1.3%
Fear 1.2%
Surprised 1.2%
Happy 0.7%
Confused 0.6%

AWS Rekognition

Age 1-7
Gender Male, 89.4%
Calm 90.9%
Sad 5%
Surprised 1.6%
Angry 0.7%
Disgusted 0.5%
Happy 0.5%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 0-4
Gender Male, 54.8%
Calm 44.9%
Fear 19.8%
Confused 11.6%
Surprised 11%
Angry 5%
Sad 3.5%
Disgusted 2.5%
Happy 1.7%

AWS Rekognition

Age 2-10
Gender Female, 100%
Calm 64.9%
Surprised 10.9%
Fear 9.2%
Angry 6%
Sad 5%
Confused 1.4%
Happy 1.3%
Disgusted 1.2%

AWS Rekognition

Age 0-6
Gender Female, 99.9%
Fear 97.4%
Surprised 2.2%
Calm 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0%
Happy 0%

AWS Rekognition

Age 0-4
Gender Male, 99.7%
Calm 94.5%
Happy 3%
Angry 0.8%
Disgusted 0.8%
Confused 0.3%
Sad 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Female, 61.8%
Angry 97.5%
Calm 1.2%
Sad 0.4%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Female, 85.5%
Sad 61.3%
Angry 16.2%
Calm 9.7%
Fear 8.5%
Disgusted 1.7%
Surprised 1.3%
Happy 0.7%
Confused 0.6%

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.9%
Person 95.8%
Painting 72.9%

Captions

Microsoft

a vintage photo of a group of people sitting at a table 96%
a vintage photo of a group of people sitting around a table 95.8%
a vintage photo of a group of people sitting on a table 93.9%

Text analysis

Amazon

I
overla
س

Google

ose
ose