Human Generated Data

Title

Untitled (family portrait on couch)

Date

1946

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17517

Human Generated Data

Title

Untitled (family portrait on couch)

People

Artist: Lucian and Mary Brown, American

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.4
Person 99.4
Person 99.3
Person 97.7
Person 96.8
Musical Instrument 93.5
Musician 93.5
Person 90.7
Leisure Activities 90.2
Guitar 88.3
Apparel 87.2
Clothing 87.2
Indoors 84.7
Face 82.7
Furniture 81.9
Chair 81.7
Room 78.3
Performer 73.8
Guitarist 73
People 68.5
Photography 67
Portrait 67
Photo 67
Living Room 65.1
Female 64.6
Girl 64.6
Kid 62.6
Child 62.6
Footwear 60.6
Shoe 60.6
Sitting 58.6
Couch 58.5
Baby 56.8
Coat 55.6
Overcoat 55.6
Suit 55.6
Dress 55.2

Imagga
created on 2022-02-26

bathing cap 49.4
cap 40.5
headdress 33.2
people 29.5
person 29.1
clothing 28
man 26.9
male 22
adult 18.5
group 17.7
brass 17.2
happy 15.6
team 15.2
couple 14.8
men 14.6
women 14.2
portrait 13.6
dress 13.5
black 13.2
covering 13
wind instrument 12.8
love 12.6
bride 12.5
friendship 12.2
human 12
fun 12
consumer goods 11.9
smiling 11.6
lifestyle 11.6
together 11.4
world 11.2
cheerful 10.6
teamwork 10.2
happiness 10.2
wedding 10.1
teacher 10.1
holding 9.9
suit 9.9
performer 9.7
musical instrument 9.6
married 9.6
friends 9.4
groom 9.3
event 9.2
attractive 9.1
exercise 9.1
active 9
sexy 8.8
celebration 8.8
dancer 8.7
patient 8.6
holiday 8.6
party 8.6
model 8.5
two 8.5
ball 8.4
sport 8.4
planner 8.4
elegance 8.4
hand 8.3
equipment 7.9
business 7.9
sitting 7.7
child 7.7
health 7.6
life 7.5
togetherness 7.5
fashion 7.5
meeting 7.5
professional 7.5
silhouette 7.4
art 7.2
work 7.1
smile 7.1
worker 7.1
working 7.1
businessman 7.1
chair 7
modern 7

Google
created on 2022-02-26

Photograph 94.2
White 92.2
Black 89.7
Hat 85.7
Black-and-white 85.3
Style 84
Music 75.6
Snapshot 74.3
Monochrome photography 74.1
Monochrome 73.8
Vintage clothing 72.9
Event 72.1
Art 71.5
Curtain 70.1
Font 69.4
Room 66.4
Fashion design 64.8
Stock photography 64.3
Sitting 64.3
Entertainment 58.6

Microsoft
created on 2022-02-26

text 98.9
wall 97.7
clothing 83.2
person 75

Face analysis

Amazon

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Surprised 52.6%
Calm 31.9%
Angry 8%
Disgusted 2.6%
Sad 1.9%
Fear 1.6%
Confused 1%
Happy 0.5%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Surprised 64.3%
Calm 34.8%
Fear 0.4%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Calm 91.3%
Surprised 2.3%
Disgusted 2.1%
Confused 1.5%
Sad 1.1%
Happy 0.6%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 35-43
Gender Male, 75.6%
Calm 73.3%
Surprised 23.3%
Fear 1.2%
Happy 0.9%
Disgusted 0.6%
Sad 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 7-17
Gender Male, 99.9%
Surprised 99.2%
Calm 0.4%
Fear 0.1%
Sad 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%

Feature analysis

Amazon

Person 99.4%
Shoe 60.6%

Captions

Microsoft

a group of people posing for a photo 92.2%
a group of people posing for the camera 92.1%
a group of people posing for a picture 92%

Text analysis

Amazon

9
rap
KODAK-E.VEELA

Google

19
rap
19 rap YT3RA°2-XAGO
YT3RA°2-XAGO