Human Generated Data

Title

Untitled (four children dressed for Halloween seated at table with food)
Date

1942
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4856
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four children dressed for Halloween seated at table with food)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4856

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-03-12

Person 99.7
Human 99.7
Person 99.6
Person 99.3
Person 99.3
Candle 97.8
Clothing 97.2
Apparel 97.2
Furniture 96.2
Meal 95.2
Food 95.2
Dish 92.8
Sunglasses 91.4
Accessories 91.4
Accessory 91.4
Table 87.6
Dining Table 85.7
Person 84.6
Face 82.4
People 64.3
Chair 62.6
Hat 61.8
Dinner 59.2
Supper 59.2
Restaurant 58.5
Portrait 58.1
Photography 58.1
Photo 58.1
Couch 56.1

Clarifai
created on 2025-01-09

people 99.7
child 98.8
woman 98.5
group 98.5
group together 97.7
adult 96.5
son 96.4
monochrome 96.3
family 95.3
man 94.7
sit 93.7
four 92
furniture 91.9
indoors 90.5
offspring 89.1
three 87.8
portrait 85.9
elderly 85.5
facial expression 84.9
room 84.4

Imagga
created on 2022-03-12

kin 36
happy 28.8
male 26.7
child 24.4
adult 24
people 24
couple 23.5
man 21.5
person 20.4
happiness 20.4
fun 20.2
together 20.1
love 19.7
smiling 19.5
group 17.7
smile 17.1
party 16.3
friends 16
sibling 15.8
home 15.1
women 15
attractive 14.7
cheerful 14.6
sitting 14.6
black 14.5
celebration 14.4
family 14.2
mother 13.4
holiday 12.9
hat 11.9
children 11.8
dark 11.7
portrait 11.6
husband 11.6
kid 11.5
cute 11.5
face 11.4
fashion 11.3
boy 11.3
looking 11.2
entertainment 11
clothing 11
girls 10.9
dress 10.8
handsome 10.7
romantic 10.7
loving 10.5
two 10.2
father 10.1
holding 9.9
studio 9.9
pretty 9.8
nightclub 9.8
buddy 9.7
four 9.6
wife 9.5
men 9.4
kids 9.4
lifestyle 9.4
suit 9
room 8.9
color 8.9
night 8.9
nightlife 8.8
indoors 8.8
brunette 8.7
jeans 8.6
laughing 8.5
clothes 8.4
teenager 8.2
gift 7.7
30s 7.7
expression 7.7
hand 7.6
club 7.5
horizontal 7.5
style 7.4
glasses 7.4
camera 7.4
emotion 7.4
joyful 7.3
20s 7.3
indoor 7.3
decoration 7.3
childhood 7.2
hair 7.1
dinner 7.1
parent 7.1

Google
created on 2022-03-12

Smile 97.5
Tableware 95
Photograph 94.3
White 92.2
Black 90
Table 88.8
Black-and-white 86.6
Plate 85.9
Style 84.1
People 79.3
Monochrome 77.4
Picture frame 77.1
Monochrome photography 76.4
Drinkware 76.3
Curtain 76
Hat 75.3
Snapshot 74.3
Cup 74.3
Event 73.4
Vintage clothing 71.6

Microsoft
created on 2022-03-12

human face 98
clothing 94.4
person 94.1
black and white 88.2
smile 87
text 78.3
posing 72.6
man 66.5
group 64.9
baby 60.3
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 98.3%
Surprised 0.6%
Angry 0.3%
Disgusted 0.2%
Fear 0.2%
Calm 0.2%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 6-12
Gender Female, 69.5%
Happy 76.3%
Calm 6.4%
Sad 4.4%
Angry 3.8%
Fear 3.4%
Disgusted 3.2%
Confused 1.9%
Surprised 0.7%

AWS Rekognition

Age 10-18
Gender Female, 100%
Happy 88.7%
Fear 3.2%
Disgusted 1.9%
Sad 1.9%
Angry 1.7%
Confused 1%
Surprised 0.9%
Calm 0.6%

AWS Rekognition

Age 2-10
Gender Female, 99.9%
Happy 59.8%
Angry 13.7%
Sad 7.7%
Fear 6.2%
Surprised 5.4%
Disgusted 3.5%
Confused 1.9%
Calm 1.8%

AWS Rekognition

Age 6-16
Gender Male, 86.8%
Calm 39.7%
Confused 26.5%
Surprised 11.7%
Happy 7.6%
Sad 5.2%
Angry 4%
Fear 3.8%
Disgusted 1.4%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Candle
Sunglasses
Person 99.7%
Person 99.6%
Person 99.3%
Person 99.3%
Person 84.6%
Candle 97.8%
Sunglasses 91.4%

Categories

Imagga

people portraits 99.5%

Text analysis

Amazon

6
88
209 88
209
3

Google

209 88 • ih 88.
209
88
•
ih
88.