Human Generated Data

Title

Untitled (family of Virgil Thaxton, near Mechanicsburg, Ohio)

Date

July 1938-August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.119

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (family of Virgil Thaxton, near Mechanicsburg, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.119

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 99.9
Building 99.9
House 99.9
Housing 99.9
Porch 99.9
Clothing 99.5
Dress 99.5
Photography 99.5
Portrait 99.5
Face 99.5
Head 99.5
Child 99.1
Female 99.1
Girl 99.1
Person 99.1
Child 98.9
Female 98.9
Girl 98.9
Person 98.9
Child 98.8
Boy 98.8
Male 98.8
Person 98.8
Child 98.6
Boy 98.6
Male 98.6
Person 98.6
Pants 98.5
People 98.4
Hat 98.2
Male 97.6
Adult 97.6
Man 97.6
Person 97.6
Person 97.6
Male 97.6
Adult 97.6
Man 97.6
Door 91.1
Potted Plant 89.5
Footwear 84.2
Shoe 84.2
Formal Wear 81.4
Plant 77.2
Outdoors 76.3
Shoe 69.7
Flower 65.4
Skirt 56.7
Lady 56.6
Blouse 56.4
Fashion 56.2
Gown 56.2
Jeans 56.2
Brick 55.4

Clarifai
created on 2018-05-11

people 99.9
group 99.5
child 99.2
group together 96.4
many 96.1
offspring 94.5
adult 94.3
home 94.1
several 94
administration 93.9
family 93.8
wear 93.1
sibling 92.4
five 89.1
leader 88.5
four 88.2
three 88
facial expression 86.5
woman 85.5
man 85.4

Imagga
created on 2023-10-06

kin 100
people 23.4
man 20.8
portrait 20.1
mother 16.6
male 16.4
outdoors 15.7
park 15.6
happy 15
couple 14.8
child 13.6
person 13.6
family 13.3
parent 13.2
smiling 13
dress 12.6
old 12.5
happiness 12.5
smile 12.1
together 11.4
adult 11
street 11
outdoor 10.7
home 10.4
women 10.3
bride 9.6
boy 9.6
love 9.5
day 9.4
two 9.3
face 9.2
tree 9.2
traditional 9.1
girls 9.1
children 9.1
lifestyle 8.7
holiday 8.6
walk 8.6
walking 8.5
business 8.5
relationship 8.4
historic 8.2
father 8
decoration 8
antique 7.8
ancient 7.8
summer 7.7
attractive 7.7
culture 7.7
married 7.7
costume 7.6
room 7.6
wife 7.6
human 7.5
senior 7.5
city 7.5
tradition 7.4
wedding 7.4
lady 7.3
new 7.3
aged 7.2
groom 7.2
romantic 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

building 99.7
person 99.3
outdoor 99.1
posing 93.2
standing 89.9
old 48

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-62
Gender Female, 99.2%
Calm 83.7%
Surprised 6.8%
Confused 6.5%
Fear 6.3%
Sad 5.1%
Angry 0.6%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 6-16
Gender Female, 100%
Calm 87.3%
Surprised 7%
Fear 6.3%
Sad 3.7%
Angry 3.5%
Confused 1.6%
Disgusted 0.7%
Happy 0.6%

AWS Rekognition

Age 12-20
Gender Female, 93.2%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 72%
Angry 22.1%
Surprised 6.4%
Fear 6%
Sad 3.9%
Disgusted 0.5%
Confused 0.4%
Happy 0.1%

AWS Rekognition

Age 41-49
Gender Male, 100%
Calm 98.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.5%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 9-17
Gender Female, 100%
Calm 79.8%
Angry 10.6%
Surprised 6.6%
Fear 6.1%
Sad 3.7%
Disgusted 3.1%
Confused 0.7%
Happy 0.4%

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 64
Gender Male

Microsoft Cognitive Services

Age 14
Gender Male

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 16
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Child 99.1%
Female 99.1%
Girl 99.1%
Person 99.1%
Boy 98.8%
Male 98.8%
Adult 97.6%
Man 97.6%
Shoe 84.2%
Plant 77.2%

Categories