Human Generated Data

Title

Children of Fortuna family, Hammond, Louisiana

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3098

Human Generated Data

Title

Children of Fortuna family, Hammond, Louisiana

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.7
Person 99.7
Person 99.6
Person 99.3
Person 95.6
Building 94.2
Home Decor 85
Housing 83.1
Outdoors 83.1
Countryside 81.2
Nature 81.2
Furniture 79.7
Apparel 76.1
Clothing 76.1
Shelter 74.2
Rural 74.2
Urban 72.6
People 64.6
House 63.2
Hut 61.7
Linen 57.9
Bed 57.3
Shack 55.2

Imagga
created on 2021-12-15

adolescent 25.8
person 22.2
juvenile 21
man 20.9
step 19.4
black 17.9
people 17.8
old 16
male 14.4
adult 14.2
support 13.7
happy 12.5
portrait 11.6
silhouette 11.6
business 11.5
wall 11.3
device 11.3
vintage 10.7
building 10.4
couple 9.6
love 9.5
smiling 9.4
groom 9.1
grandfather 9.1
fashion 9
dress 9
prison 9
home 8.8
light 8.7
antique 8.6
outside 8.6
expression 8.5
face 8.5
world 8.5
art 8.5
attractive 8.4
office 8.3
human 8.2
lady 8.1
family 8
hair 7.9
child 7.8
ancient 7.8
outdoor 7.6
stone 7.6
window 7.6
city 7.5
architecture 7.4
street 7.4
alone 7.3
lifestyle 7.2
smile 7.1
fence 7.1
businessman 7.1
happiness 7
together 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

clothing 98.4
toddler 97.4
baby 96.9
text 96.8
human face 94.4
window 92.4
person 86.7
child 80.7
boy 78
smile 77.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 97.6%
Calm 98.6%
Happy 0.4%
Sad 0.3%
Surprised 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 1-5
Gender Male, 98.2%
Sad 91.4%
Angry 4.3%
Calm 3.3%
Confused 0.4%
Fear 0.3%
Surprised 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 9-19
Gender Female, 91.4%
Calm 97.8%
Surprised 1.3%
Sad 0.3%
Happy 0.3%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 25-39
Gender Male, 97.7%
Sad 91.9%
Calm 6.4%
Fear 0.6%
Confused 0.6%
Angry 0.3%
Surprised 0.1%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 18
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a person standing in front of a window 89.9%
a person standing next to a window 86.7%
a person posing for a photo in front of a window 86.6%