Human Generated Data

Title

Untitled (portrait of three boys)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16887

Human Generated Data

Title

Untitled (portrait of three boys)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.6
Person 99.6
Person 99
Person 98.5
Furniture 91
Chair 91
Clothing 87.2
Apparel 87.2
People 78
Leisure Activities 74.5
Sport 68.9
Sports 68.9
Dance Pose 66.5
Flooring 65.2
Face 61.8
Photo 61.8
Photography 61.8
Portrait 61.8
Martial Arts 56.2
Dance 55.2

Imagga
created on 2022-02-26

male 36.9
man 35.6
people 31.2
couple 29.6
kin 25.2
grandfather 25.2
happy 24.4
adult 24.1
family 24
smiling 22.4
child 22.2
mother 21.8
father 20.1
person 19.8
happiness 19.6
parent 19.3
love 18.1
portrait 18.1
smile 16.4
husband 16.2
home 15.9
senior 15.9
together 15.8
wife 15.2
domestic 14.8
sitting 13.7
dress 13.6
joy 13.4
dad 13.1
nurse 13
room 12.9
two 12.7
bow tie 12.5
lifestyle 12.3
black 12
fun 12
women 11.9
face 11.4
looking 11.2
old 11.1
daughter 11
suit 10.8
childhood 10.7
interior 10.6
cheerful 10.6
indoors 10.5
elderly 10.5
professional 10.4
men 10.3
casual 10.2
necktie 9.9
world 9.8
kid 9.7
human 9.7
bride 9.6
clothing 9.4
wedding 9.2
leisure 9.1
holding 9.1
health 9
look 8.8
hospital 8.8
retired 8.7
married 8.6
expression 8.5
groom 8.5
relationship 8.4
attractive 8.4
romantic 8
brunette 7.8
life 7.8
pretty 7.7
youth 7.7
traditional 7.5
mature 7.4
patient 7.3
girls 7.3
active 7.2
blond 7.2
celebration 7.2
baby 7.2
posing 7.1

Google
created on 2022-02-26

Black 89.5
Gesture 85.3
Black-and-white 84
Style 83.9
Smile 82.8
Shorts 80.8
Adaptation 79.3
Font 79.3
Monochrome photography 76.1
Toddler 75.6
Snapshot 74.3
Monochrome 73.8
Photo caption 72.2
Art 65.9
Room 65.4
Stock photography 63.6
Screenshot 62.2
Sitting 60.9
Visual arts 57.1
Child 57

Microsoft
created on 2022-02-26

person 97
posing 93.5
text 89
human face 87.4
clothing 84.2
black and white 67.5

Face analysis

Amazon

AWS Rekognition

Age 18-24
Gender Male, 99.9%
Calm 45%
Surprised 29.6%
Happy 9.9%
Disgusted 5.8%
Angry 3.8%
Fear 2.5%
Sad 2%
Confused 1.4%

AWS Rekognition

Age 18-24
Gender Male, 93.6%
Happy 64.8%
Fear 11.3%
Surprised 11.1%
Calm 5.3%
Angry 2.6%
Disgusted 2.2%
Sad 2.1%
Confused 0.5%

AWS Rekognition

Age 12-20
Gender Male, 94.9%
Happy 84.8%
Surprised 12.1%
Fear 1.5%
Calm 0.9%
Disgusted 0.2%
Sad 0.2%
Angry 0.2%
Confused 0.1%

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 93.2%
a group of people posing for the camera 93.1%
a group of people posing for a picture 93%

Text analysis

Amazon

"

Google

MJI3--YTEAA2--A
MJI3--YTEAA2--A