Human Generated Data

Title

Untitled (portrait of parents, children, and dog on couch)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16378

Human Generated Data

Title

Untitled (portrait of parents, children, and dog on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.6
Human 99.6
Person 98.6
Person 98.4
Furniture 97.8
Person 96.5
Person 95.1
Person 91.5
Sitting 84.7
Lamp 84.6
Clothing 84
Apparel 84
Table Lamp 78.3
Table 73
People 72.9
Accessory 68.8
Tie 68.8
Accessories 68.8
Tie 65.7
Couch 64.1
Suit 64
Coat 64
Overcoat 64
Person 63.4
Reading 59.6
Chair 58.9
Photography 55.6
Photo 55.6

Imagga
created on 2022-02-11

brass 97.6
wind instrument 74.1
musical instrument 49.9
people 29
person 24
male 23.4
man 21.5
men 21.4
bugle 19.8
adult 18.6
sport 18.1
happy 16.3
lifestyle 15.9
fun 15.7
couple 15.7
cornet 15.5
black 15
portrait 13.6
happiness 13.3
silhouette 13.2
group 12.9
youth 11.9
love 11.8
player 11.8
exercise 11.8
team 11.6
leisure 11.6
human 11.2
attractive 11.2
women 11.1
active 10.8
sexy 10.4
smiling 10.1
bride 9.8
crowd 9.6
party 9.4
casual 9.3
smile 9.3
event 9.2
joy 9.2
competition 9.1
fashion 9
dress 9
hands 8.7
sitting 8.6
friendship 8.4
training 8.3
entertainment 8.3
athlete 8.2
dance 8.2
style 8.2
fitness 8.1
music 8.1
handsome 8
family 8
body 8
together 7.9
child 7.8
play 7.7
kin 7.7
device 7.6
togetherness 7.5
legs 7.5
trombone 7.5
art 7.5
outdoors 7.5
holding 7.4
teamwork 7.4
symbol 7.4
wedding 7.4
cheerful 7.3
lady 7.3
girls 7.3
sibling 7.2
celebration 7.2

Google
created on 2022-02-11

White 92.2
Musical instrument 88.5
Chair 87.6
Hat 86.6
Style 83.9
Black-and-white 83
Musician 81.9
Suit 77.3
Music 75
Font 74.5
Art 74.5
Drum 74
Event 72.8
Curtain 71
Monochrome photography 70.1
Monochrome 70.1
Guitar 68.9
Sitting 68.3
Vintage clothing 67.1
Room 64.1

Microsoft
created on 2022-02-11

person 85.5
text 81.9
posing 72.4
clothing 71.3
old 41.3

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 94.9%
Surprised 69%
Sad 12.8%
Confused 5.1%
Calm 4.5%
Fear 3.5%
Happy 2.1%
Disgusted 1.8%
Angry 1.1%

AWS Rekognition

Age 23-31
Gender Male, 94.7%
Surprised 71.7%
Calm 8.5%
Disgusted 7.3%
Confused 5.4%
Sad 2.4%
Angry 2.1%
Fear 1.6%
Happy 1.1%

AWS Rekognition

Age 20-28
Gender Male, 87.2%
Sad 52.7%
Happy 27.6%
Calm 6%
Angry 4.3%
Disgusted 3.2%
Confused 2.9%
Fear 2%
Surprised 1.2%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Surprised 89.5%
Calm 10.2%
Fear 0.1%
Angry 0.1%
Disgusted 0%
Confused 0%
Sad 0%
Happy 0%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Sad 92.9%
Happy 2.7%
Confused 1.2%
Calm 1.2%
Surprised 0.8%
Angry 0.7%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 42-50
Gender Male, 99.6%
Confused 29.9%
Calm 28.1%
Sad 13.7%
Happy 11.1%
Angry 8.1%
Disgusted 4.2%
Fear 3.5%
Surprised 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Lamp 84.6%
Tie 68.8%
Chair 58.9%

Captions

Microsoft

a group of people posing for a photo 94%
a group of people posing for the camera 93.9%
a group of people posing for a picture 93.8%

Text analysis

Amazon

24
M113--YT37AS- -

Google

24 --YT3RA 2 --XAGO
2
--XAGO
24
--YT3RA