Human Generated Data

Title

School youngsters, Red House, West Virginia

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3088

Human Generated Data

Title

School youngsters, Red House, West Virginia

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.6
Human 99.6
Person 99.5
Person 99.5
Person 99.3
Person 98.5
People 98.2
Person 98.2
Family 96
Person 94.8
Person 94
Person 93.7
Person 86.2
Clothing 74.5
Apparel 74.5
Person 74.3
Female 69.5
Girl 68.7
Crowd 63.1
Face 60.3
Linen 58.7
Home Decor 58.7
Hair 57.7
Workshop 57.5

Imagga
created on 2021-12-15

kin 100
family 49.8
happy 45.8
mother 40.6
male 39.9
together 39.4
smiling 39.1
couple 35.7
people 35.7
man 34.3
child 31.1
love 30.8
father 28.8
portrait 27.8
daughter 27.5
happiness 27.4
home 27.1
senior 24.4
husband 22.9
adult 22.7
group 22.6
fun 21.7
lifestyle 21.7
boy 20.9
wife 19.9
person 19.7
smile 17.8
son 17.5
children 17.3
parent 17.2
casual 17
women 16.6
togetherness 16.1
kid 16
men 15.5
sitting 15.5
cheerful 15.4
30s 15.4
elderly 15.3
room 14.8
loving 14.3
horizontal 14.2
laughing 14.2
park 14
mature 13.9
camera 13.9
married 13.4
joy 13.4
dad 12.9
parents 12.7
two 12.7
thirties 12.7
mom 12.6
generation 12.5
friends 12.2
friendship 12.2
sixties 11.8
grandmother 11.8
60s 11.7
grandfather 11.4
enjoying 11.4
relationship 11.2
sibling 11.1
relaxing 10.9
childhood 10.7
hug 10.7
affectionate 10.6
couch 10.6
attractive 10.5
outdoors 10.5
cute 10
old 9.8
hugging 9.8
interior 9.7
retired 9.7
clothing 9.7
indoors 9.7
affection 9.7
baby 9.5
life 9.5
relaxed 9.4
girls 9.1
grandparents 8.9
mum 8.8
retirement 8.6
day 8.6
adults 8.5
youth 8.5
kids 8.5
playing 8.2
team 8.1
seniors 7.9
standing 7.8
parenthood 7.8
face 7.8
embracing 7.8
half length 7.8
looking camera 7.7
laugh 7.7
sofa 7.7
females 7.6
brother 7.5
leisure 7.5
blond 7.2

Google
created on 2021-12-15

Black 89.6
Smile 89.1
Fashion 87.9
Sleeve 85.8
Adaptation 79.3
Happy 76.1
Vintage clothing 75.9
Room 73.3
Monochrome 72.9
Event 71.9
Sharing 71.9
Child 70.6
Photo caption 68.7
Art 68
Fun 67.1
Monochrome photography 66.4
Stock photography 63.6
Pattern 63
History 62.8
Photographic paper 61.8

Microsoft
created on 2021-12-15

person 100
clothing 99
human face 98.6
smile 97.2
text 96.1
posing 94
group 93.3
outdoor 90
child 84.4
woman 78.3
people 73.7
baby 72
white 60.7
boy 60.6
toddler 60.2
old 51.6
family 15.1
crowd 0.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 96.2%
Calm 91%
Sad 5.9%
Angry 0.9%
Happy 0.8%
Disgusted 0.6%
Confused 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 4-12
Gender Male, 99.7%
Sad 56%
Angry 27.8%
Calm 10.3%
Confused 2.7%
Happy 1.9%
Surprised 0.6%
Fear 0.5%
Disgusted 0.2%

AWS Rekognition

Age 5-15
Gender Female, 96.3%
Calm 92.1%
Happy 5.4%
Disgusted 0.7%
Sad 0.6%
Surprised 0.5%
Confused 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 12-22
Gender Female, 91.5%
Calm 76.9%
Sad 13%
Angry 8.1%
Confused 1%
Fear 0.3%
Happy 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 8-18
Gender Female, 97.1%
Calm 80.8%
Fear 9.3%
Sad 3.6%
Surprised 2.6%
Happy 1.4%
Confused 1%
Angry 0.9%
Disgusted 0.4%

AWS Rekognition

Age 31-47
Gender Female, 98.2%
Happy 99.9%
Calm 0%
Surprised 0%
Confused 0%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 6-16
Gender Female, 99.9%
Happy 99.9%
Calm 0%
Surprised 0%
Sad 0%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 6-16
Gender Female, 91.9%
Fear 70.9%
Sad 11.7%
Calm 9.9%
Surprised 4.3%
Angry 1.4%
Confused 1.2%
Happy 0.5%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Female, 77.5%
Calm 97.5%
Sad 1.9%
Angry 0.2%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 25-39
Gender Female, 98.3%
Calm 69.7%
Sad 9.4%
Fear 9.2%
Surprised 4%
Confused 2.9%
Happy 2.7%
Disgusted 1.4%
Angry 0.7%

AWS Rekognition

Age 22-34
Gender Female, 53.4%
Calm 82.9%
Sad 9%
Confused 4.3%
Happy 1.6%
Angry 1%
Fear 0.5%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 15-27
Gender Female, 50.1%
Fear 81.8%
Calm 8%
Sad 6.8%
Angry 1.8%
Happy 0.6%
Surprised 0.4%
Confused 0.4%
Disgusted 0.2%

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 17
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 99%
a group of people posing for the camera 98.9%
a group of people posing for a picture 98.8%

Text analysis

Amazon

RS
RS Z
Z
RALE