Human Generated Data

Title

Untitled (boy wearing cowboy costume, with toy gun)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16358

Human Generated Data

Title

Untitled (boy wearing cowboy costume, with toy gun)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Clothing 99.9
Apparel 99.9
Bonnet 99.5
Hat 99.5
Person 99.4
Human 99.4
Table Lamp 85.4
Musical Instrument 76.8
Guitar 76.8
Leisure Activities 76.8
Photography 60.5
Portrait 60.5
Face 60.5
Photo 60.5
Lamp 51

Imagga
created on 2022-02-11

person 31.1
man 28.2
people 25.1
hat 24.9
adult 22.8
clothing 20.2
male 18.5
cowboy hat 18.1
portrait 16.2
headdress 16.1
attractive 16.1
smile 15.7
fashion 15.1
model 14.8
smiling 14.5
happy 14.4
sport 14.1
casual 13.5
business 13.4
art 12.4
standing 12.2
expression 11.9
occupation 11.9
active 11.8
action 11.1
style 11.1
health 11.1
brass 11.1
exercise 10.9
musical instrument 10.9
lifestyle 10.8
handsome 10.7
face 10.6
professional 10.5
sexy 10.4
body 10.4
nurse 10.4
work 10.3
guy 10.3
wind instrument 10
fitness 9.9
posing 9.8
human 9.7
studio 9.1
worker 9.1
stylish 9
suit 9
lady 8.9
healthy 8.8
looking 8.8
happiness 8.6
corporate 8.6
energy 8.4
pretty 8.4
consumer goods 8.4
leisure 8.3
covering 8.3
teen 8.3
fun 8.2
one 8.2
sombrero 8.2
job 8
hair 7.9
child 7.9
women 7.9
uniform 7.9
brunette 7.8
men 7.7
motion 7.7
jeans 7.6
joy 7.5
silhouette 7.4
patient 7.3
alone 7.3
confident 7.3
grandfather 7.3
cute 7.2
equipment 7.1
cool 7.1
modern 7

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 96.5
cartoon 83.4
drawing 69.9
clothing 69.7
human face 63.3
black and white 59.1
sketch 56.5
person 50

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 97.5%
Happy 99.2%
Sad 0.4%
Calm 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Guitar 76.8%
Lamp 51%

Captions

Microsoft

a person wearing a costume 33.4%
a person wearing a costume 33.3%
a person sitting in a room 33.2%

Text analysis

Amazon

15

Google

15
15