Human Generated Data

Title

Untitled (three children, baby covering ears)

Date

1965

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16779

Human Generated Data

Title

Untitled (three children, baby covering ears)

People

Artist: Lucian and Mary Brown, American

Date

1965

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16779

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 100
Apparel 100
Person 99.2
Human 99.2
Person 98.7
Face 98.5
Chair 97.6
Furniture 97.6
Shoe 97.5
Footwear 97.5
Person 96.9
Shoe 96.5
Female 92.4
Shorts 87.8
Dress 82
Smile 81.6
Kid 80.9
Child 80.9
Portrait 79.6
Photography 79.6
Photo 79.6
Girl 78
Street 74.6
Building 74.6
City 74.6
Urban 74.6
Road 74.6
Town 74.6
Woman 72.6
Hat 70.1
Helmet 68.7
Head 68.6
Door 67.9
People 65.3
Housing 63.4
Costume 62.6
Glasses 62.2
Accessories 62.2
Accessory 62.2
Baby 62.1
Coat 61.4
Suit 57.2
Overcoat 57.2
Pants 56.9
Boy 56

Clarifai
created on 2023-10-29

people 99.8
child 99.5
group 98.9
man 96.8
group together 96.8
boy 96.7
monochrome 96.1
son 95.8
three 94.6
family 93.8
wear 93.7
adult 92.4
woman 90.7
two 90.6
girl 89.5
indoors 88.4
outfit 86.9
portrait 86.5
four 85.9
education 85.8

Imagga
created on 2022-02-26

negative 31.7
people 27.9
film 27.1
kin 26.8
man 20.8
male 20.6
person 19.1
photographic paper 18.7
couple 18.3
adult 16.2
men 14.6
bride 14.5
smiling 14.5
women 14.2
love 13.4
black 13.2
happy 13.1
happiness 12.5
photographic equipment 12.5
world 12.4
indoors 12.3
wedding 11.9
dress 11.7
portrait 11.6
old 11.1
two 11
groom 10.4
senior 10.3
family 9.8
musical instrument 9.6
sitting 9.4
fashion 9
teacher 8.9
cheerful 8.9
group 8.9
home 8.8
smile 8.5
bouquet 8.5
spectator 8.4
modern 8.4
child 8.1
history 8
mother 8
gown 7.9
holiday 7.9
room 7.8
married 7.7
youth 7.7
human 7.5
fun 7.5
inside 7.4
brass 7.3
lifestyle 7.2
suit 7.2
night 7.1
architecture 7

Google
created on 2022-02-26

Shorts 95.4
Black 89.8
Black-and-white 86.2
Style 84
Monochrome 75.8
Smile 75.3
Eyewear 75.2
T-shirt 74.6
Monochrome photography 73.7
Vintage clothing 72.1
Event 71
Fun 66.9
Font 66.3
Hat 65.2
Room 64.9
Sitting 63.9
Pattern 61.5
Chair 61.4
Crew 60.3
Photo caption 59.8

Microsoft
created on 2022-02-26

person 98.7
clothing 92.9
human face 86.6
smile 80.4
text 65.8
posing 45.5
net 19.4
bowed instrument 6.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 14-22
Gender Male, 96.6%
Surprised 54.1%
Calm 24.8%
Happy 14.8%
Confused 2.4%
Disgusted 2.1%
Angry 0.8%
Sad 0.7%
Fear 0.3%

AWS Rekognition

Age 22-30
Gender Female, 98.7%
Happy 49.6%
Calm 23.5%
Surprised 8.1%
Fear 7.6%
Sad 3.4%
Disgusted 3.3%
Angry 2.6%
Confused 1.7%

AWS Rekognition

Age 36-44
Gender Male, 99.4%
Calm 61.2%
Surprised 13.9%
Happy 13.5%
Sad 4.2%
Angry 2.4%
Disgusted 2.1%
Fear 1.8%
Confused 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.2%
Person 98.7%
Person 96.9%
Shoe 97.5%
Shoe 96.5%

Categories

Text analysis

Amazon

3
6

Google

MJI7--YTERA2--Aa 3.
MJI7--YTERA2--Aa
3.