Human Generated Data

Title

Untitled (family portrait outside house)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16895

Human Generated Data

Title

Untitled (family portrait outside house)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.6
Apparel 99.6
Person 99.4
Human 99.4
Person 99.2
Person 98.6
Person 98.5
People 98.3
Outdoors 96.6
Yard 96.6
Nature 96.6
Dress 95.7
Face 95
Family 94.4
Female 92.1
Countryside 88.8
Building 88.8
Shelter 88.8
Rural 88.8
Costume 82.2
Overcoat 80.2
Suit 80.2
Coat 80.2
Plant 80.1
Grass 78.8
Woman 78.6
Housing 78.6
Child 76.8
Kid 76.8
Photo 74
Photography 74
Portrait 74
Girl 72.7
Door 72
Street 67.4
Urban 67.4
Road 67.4
City 67.4
Town 67.4
Tree 65.3
Food 65.1
Meal 65.1
Man 63.8
Mammal 62.7
Animal 62.7
Canine 62.7
Pet 61.7
Baby 59.3
Porch 59
Long Sleeve 58.7
Sleeve 58.7
Robe 58.1
Fashion 58.1
Villa 56.2
House 56.2
Gown 55.8

Imagga
created on 2022-02-26

kin 61.1
man 30.2
father 25.3
dad 25.2
child 24
male 23.8
couple 22.6
people 22.3
family 22.2
outdoors 20.1
parent 18.3
portrait 18.1
happiness 18
love 17.4
smiling 16.6
happy 16.3
together 15.8
park 15.6
adult 15.6
sibling 14.8
men 12.9
daughter 12.5
mother 12.4
black 12
dress 11.7
person 11.6
bride 11.5
smile 11.4
romantic 10.7
married 10.5
world 10.2
day 10.2
cricket equipment 10.2
two 10.2
wedding 10.1
lifestyle 10.1
house 10
holding 9.9
fun 9.7
summer 9.6
home 9.6
boy 9.6
husband 9.5
youth 9.4
outdoor 9.2
playing 9.1
girls 9.1
attractive 9.1
old 9.1
equipment 8.9
sports equipment 8.7
wife 8.5
face 8.5
building 8.5
new 8.1
to 8
sepia 7.8
outside 7.7
life 7.7
culture 7.7
statue 7.6
cricket bat 7.5
human 7.5
traditional 7.5
sexy 7.2
women 7.1

Google
created on 2022-02-26

Window 90.9
Black 89.5
Style 83.8
Black-and-white 83
People 79.1
Building 77.6
Vintage clothing 76.7
Monochrome photography 75.4
Monochrome 75.2
Suit 73.9
House 72.8
Room 70.1
Classic 70.1
History 67.6
Picture frame 67.3
Art 66.8
Event 65.5
Smile 64.8
Photo caption 62.9
Fun 62.9

Microsoft
created on 2022-02-26

building 99.5
outdoor 99
person 96.4
clothing 94.5
house 78.4
smile 74.6
man 70.5
posing 61.8
human face 50.3

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 98.1%
Calm 66.7%
Happy 25%
Sad 3.2%
Surprised 2.1%
Confused 1.5%
Disgusted 0.8%
Angry 0.5%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Female, 51.4%
Calm 85.2%
Happy 11.8%
Angry 1%
Surprised 0.7%
Confused 0.6%
Disgusted 0.4%
Sad 0.3%
Fear 0%

AWS Rekognition

Age 6-12
Gender Female, 59.8%
Sad 75%
Calm 10.6%
Disgusted 3.6%
Happy 3.1%
Confused 2.6%
Angry 2%
Fear 1.6%
Surprised 1.5%

AWS Rekognition

Age 6-14
Gender Male, 97.5%
Happy 82.2%
Calm 12.9%
Surprised 2.9%
Disgusted 0.6%
Sad 0.5%
Confused 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 6-16
Gender Female, 98.9%
Sad 48.5%
Happy 26.9%
Calm 21.7%
Disgusted 0.9%
Angry 0.7%
Confused 0.7%
Surprised 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a man and a woman standing in front of a building 90%
a man and a woman posing in front of a building 88.6%
a man and woman standing in front of a building 85.5%

Text analysis

Google

MJI7--YTE
MJI7--YTE 2--Ag
2--Ag