Human Generated Data

Title

Children of Fortuna family, Hammond, Louisiana
Date

1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3098

Human Generated Data

Title

Children of Fortuna family, Hammond, Louisiana

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3098

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.7
Human 99.7
Person 99.6
Person 99.3
Person 95.6
Building 94.2
Home Decor 85
Housing 83.1
Outdoors 83.1
Countryside 81.2
Nature 81.2
Furniture 79.7
Clothing 76.1
Apparel 76.1
Shelter 74.2
Rural 74.2
Urban 72.6
People 64.6
House 63.2
Hut 61.7
Linen 57.9
Bed 57.3
Shack 55.2

Clarifai
created on 2023-10-15

people 100
child 99.7
portrait 99.4
two 98.9
adult 98
son 97.7
woman 96.3
family 95.9
offspring 95.2
baby 94.2
monochrome 93.6
three 92
group 92
boy 91.8
man 91.2
girl 90.9
vintage 89.4
four 89.3
one 87.9
sibling 86.8

Imagga
created on 2021-12-15

adolescent 25.8
person 22.2
juvenile 21
man 20.9
step 19.4
black 17.9
people 17.8
old 16
male 14.4
adult 14.2
support 13.7
happy 12.5
portrait 11.6
silhouette 11.6
business 11.5
wall 11.3
device 11.3
vintage 10.7
building 10.4
couple 9.6
love 9.5
smiling 9.4
groom 9.1
grandfather 9.1
fashion 9
dress 9
prison 9
home 8.8
light 8.7
antique 8.6
outside 8.6
expression 8.5
face 8.5
world 8.5
art 8.5
attractive 8.4
office 8.3
human 8.2
lady 8.1
family 8
hair 7.9
child 7.8
ancient 7.8
outdoor 7.6
stone 7.6
window 7.6
city 7.5
architecture 7.4
street 7.4
alone 7.3
lifestyle 7.2
smile 7.1
fence 7.1
businessman 7.1
happiness 7
together 7

Google
created on 2021-12-15

Standing 86.4
Sleeve 82.4
Shorts 81.2
Adaptation 79.2
Vintage clothing 72.9
Chair 69.7
Collar 69.4
Monochrome 68.9
Toddler 67.8
Art 67.8
Room 67.7
Stock photography 64.3
Monochrome photography 64
Child 58.7
Pattern 58.7
Photographic paper 55.1
Visual arts 54.7
Door 54.2
Suit 54
History 53

Microsoft
created on 2021-12-15

clothing 98.4
toddler 97.4
baby 96.9
text 96.8
human face 94.4
window 92.4
person 86.7
child 80.7
boy 78
smile 77.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 97.6%
Calm 98.6%
Happy 0.4%
Sad 0.3%
Surprised 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 1-5
Gender Male, 98.2%
Sad 91.4%
Angry 4.3%
Calm 3.3%
Confused 0.4%
Fear 0.3%
Surprised 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 9-19
Gender Female, 91.4%
Calm 97.8%
Surprised 1.3%
Sad 0.3%
Happy 0.3%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0%

AWS Rekognition

Age 25-39
Gender Male, 97.7%
Sad 91.9%
Calm 6.4%
Fear 0.6%
Confused 0.6%
Angry 0.3%
Surprised 0.1%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

paintings art 84.6%
streetview architecture 11.5%
people portraits 3.1%