Human Generated Data

Title

Untitled (four children in formal attire on stone wall, one boy with guitar)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16990

Human Generated Data

Title

Untitled (four children in formal attire on stone wall, one boy with guitar)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Leisure Activities 99.6
Musical Instrument 99.6
Guitar 99.6
Person 99.5
Person 99.4
Musician 98.1
Clothing 95.6
Apparel 95.6
Dress 95.1
Helmet 90.3
Female 89.6
Person 88.7
Performer 88.6
Guitarist 88.6
Accessories 84.9
Sunglasses 84.9
Accessory 84.9
Face 74.9
Plant 72.9
Grass 72.9
Music Band 71.9
Woman 71.3
Girl 69.6
Shorts 68.4
Fiddle 64.7
Violin 64.7
Viola 64.7
Portrait 63.8
Photo 63.8
Photography 63.8
People 59.1
Outdoors 58.3

Imagga
created on 2022-02-26

musical instrument 39.3
wind instrument 35.4
brass 34.1
man 32.9
bowed stringed instrument 28.5
people 26.2
violin 25
stringed instrument 23.7
male 22.1
cornet 20.1
adult 19.6
person 19.6
couple 15.7
black 15
men 14.6
portrait 13.6
dress 12.6
love 12.6
family 12.4
lifestyle 12.3
music 11.8
happiness 11.7
holding 11.6
child 11.5
women 11.1
mother 10.9
cello 10.8
smile 10
trombone 9.9
old 9.7
business 9.7
summer 9.6
happy 9.4
two 9.3
musician 9.1
sport 9.1
outdoors 9
romantic 8.9
kin 8.8
businessman 8.8
hair 8.7
play 8.6
model 8.6
device 8.5
face 8.5
youth 8.5
woodwind 8.4
hand 8.4
joy 8.4
city 8.3
fashion 8.3
vintage 8.3
park 8.2
one 8.2
playing 8.2
guitar 8.2
style 8.2
art 7.9
work 7.8
day 7.8
sitting 7.7
attractive 7.7
outdoor 7.6
flute 7.6
traditional 7.5
silhouette 7.4
danger 7.3
smiling 7.2
sexy 7.2
suit 7.2
daughter 7.1
together 7

Microsoft
created on 2022-02-26

outdoor 98.5
person 96
text 92.3
musical instrument 90.4
clothing 89.7
smile 62.9
posing 55.5
black and white 54.7

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 53.1%
Calm 54.4%
Happy 36.2%
Sad 3.3%
Surprised 3.1%
Angry 1.2%
Disgusted 0.9%
Fear 0.8%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Female, 98.7%
Happy 94%
Surprised 2.3%
Calm 1.3%
Sad 0.7%
Fear 0.6%
Angry 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 23-33
Gender Male, 57.1%
Happy 81.7%
Surprised 8.1%
Calm 5%
Sad 2%
Fear 1.5%
Disgusted 0.6%
Angry 0.6%
Confused 0.6%

AWS Rekognition

Age 16-22
Gender Female, 55.7%
Happy 40.8%
Calm 32.3%
Confused 8.9%
Sad 8.2%
Fear 3.9%
Angry 3.3%
Disgusted 1.5%
Surprised 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Guitar 99.6%
Helmet 90.3%
Sunglasses 84.9%

Captions

Microsoft

a man and woman posing for a photo 61.5%
a man and a woman posing for a photo 61.4%
a group of people posing for a photo 61.3%

Text analysis

Amazon

5