Human Generated Data

Title

Untitled (three girls wearing party dresses)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17453

Human Generated Data

Title

Untitled (three girls wearing party dresses)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17453

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Home Decor 99.5
Person 98.7
Human 98.7
Person 97.8
Furniture 95.8
Helmet 93.2
Clothing 93.2
Apparel 93.2
Room 91
Indoors 91
Person 90.5
Chair 89.4
Female 87.8
Dress 81.1
Woman 76.6
People 75
Meal 74.3
Food 74.3
Table 66.5
Flooring 66.2
Dish 64.3
Curtain 64.2
Window 64.1
Portrait 60.7
Photography 60.7
Face 60.7
Photo 60.7
Dining Table 57.8
Living Room 57.8
Dining Room 55.5

Clarifai
created on 2023-10-28

people 99.9
group 98.7
two 97.7
adult 97.5
woman 97.1
child 97.1
room 97
three 93.8
monochrome 93.8
furniture 93.7
man 93
indoors 92.3
family 92.1
four 90.4
chair 89.7
home 87.8
wear 87.4
several 86.5
offspring 86.5
sit 85.8

Imagga
created on 2022-02-26

architecture 25.9
building 24.1
house 22.6
old 18.1
sculpture 17.5
home 16.1
window 15.6
column 15.1
monument 14.9
art 14
chair 13.7
interior 13.3
wall 13
statue 12.9
room 12.6
tourism 12.4
historical 12.2
church 12
style 11.9
religion 11.6
fountain 11.6
dress 10.8
marble 10.3
design 10.1
people 10
history 9.8
palace 9.8
windows 9.6
decoration 9.6
furniture 9.5
famous 9.3
wedding 9.2
structure 9.2
historic 9.2
travel 9.1
columns 8.8
stone 8.8
women 8.7
flowers 8.7
balcony 8.7
ancient 8.6
bride 8.6
culture 8.5
two 8.5
wood 8.3
antique 8.3
vintage 8.3
man 8.1
couple 7.8
male 7.8
person 7.8
luxury 7.7
tourist 7.6
city 7.5
exterior 7.4
new 7.3
stucco 7.3
landmark 7.2
love 7.1
seat 7.1
cleaner 7
support 7
modern 7

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

window 93.7
dress 92.7
text 91.3
clothing 73.8
woman 62.2
person 56.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 12-20
Gender Male, 50.3%
Surprised 39.4%
Calm 31.4%
Sad 11.2%
Happy 4.8%
Angry 4.6%
Disgusted 4.3%
Confused 3.3%
Fear 0.9%

AWS Rekognition

Age 21-29
Gender Male, 98.8%
Calm 45.7%
Fear 37.5%
Sad 5.2%
Happy 4.1%
Surprised 2.6%
Angry 2.3%
Confused 1.4%
Disgusted 1.2%

AWS Rekognition

Age 20-28
Gender Female, 60.1%
Happy 35%
Fear 28.9%
Calm 12.2%
Sad 7.2%
Confused 6.5%
Angry 5.3%
Surprised 2.7%
Disgusted 2.2%

AWS Rekognition

Age 6-14
Gender Female, 89.7%
Calm 31.6%
Happy 21.9%
Fear 20.8%
Angry 11.8%
Sad 10.1%
Confused 1.5%
Disgusted 1.1%
Surprised 1%

AWS Rekognition

Age 25-35
Gender Female, 85.8%
Calm 57.6%
Happy 13.6%
Sad 9%
Disgusted 5.1%
Angry 4.9%
Fear 4.6%
Confused 2.9%
Surprised 2.2%

AWS Rekognition

Age 16-22
Gender Male, 83.5%
Calm 86.1%
Sad 6.4%
Angry 2.6%
Happy 1.9%
Fear 1.1%
Confused 0.8%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 20-28
Gender Female, 89.4%
Calm 93.9%
Sad 2.3%
Happy 1.6%
Angry 0.6%
Confused 0.6%
Fear 0.5%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 13-21
Gender Female, 65.7%
Calm 88.3%
Sad 3.7%
Happy 2.9%
Angry 1.8%
Fear 1.8%
Disgusted 0.7%
Confused 0.5%
Surprised 0.3%

AWS Rekognition

Age 11-19
Gender Female, 89.4%
Calm 57.1%
Happy 21%
Fear 12%
Sad 5.5%
Angry 1.3%
Surprised 1.1%
Confused 1.1%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Male, 88.5%
Calm 80.1%
Angry 7.1%
Happy 5%
Sad 4.7%
Confused 1%
Fear 0.9%
Disgusted 0.6%
Surprised 0.6%

AWS Rekognition

Age 21-29
Gender Female, 72.6%
Happy 86.8%
Calm 5.2%
Angry 3.2%
Sad 1.6%
Confused 1.1%
Disgusted 1.1%
Surprised 0.8%
Fear 0.3%

AWS Rekognition

Age 14-22
Gender Female, 82.9%
Calm 79.4%
Happy 8.5%
Sad 5.3%
Angry 2.3%
Fear 1.4%
Disgusted 1.1%
Surprised 0.9%
Confused 0.9%

AWS Rekognition

Age 21-29
Gender Female, 54%
Calm 94.6%
Sad 1.9%
Happy 1.8%
Angry 1%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Male, 73.1%
Calm 83.2%
Angry 7%
Sad 4.7%
Disgusted 1.3%
Happy 1.1%
Surprised 1%
Fear 0.9%
Confused 0.8%

AWS Rekognition

Age 18-26
Gender Female, 64.5%
Calm 91.2%
Sad 2.4%
Angry 1.9%
Happy 1.4%
Confused 1.3%
Fear 0.8%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 18-24
Gender Female, 90.1%
Calm 58.7%
Fear 18.4%
Sad 13.4%
Happy 4.8%
Confused 1.4%
Disgusted 1.2%
Angry 1.2%
Surprised 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helmet
Chair
Person 98.7%
Person 97.8%
Person 90.5%
Helmet 93.2%
Chair 89.4%

Categories

Text analysis

Amazon

21
BSS

Google

21
21