Human Generated Data

Title

Untitled (three boys on floor reading comics)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17621

Human Generated Data

Title

Untitled (three boys on floor reading comics)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.3
Human 99.3
Clothing 99.2
Apparel 99.2
Person 98.9
Person 98.7
Tie 94.8
Accessories 94.8
Accessory 94.8
Face 94.2
Dress 84.6
Door 81.6
Baby 80.7
Furniture 78.1
Child 78
Kid 78
Pants 77
Portrait 76.1
Photo 76.1
Photography 76.1
Play 75.5
Sleeve 74.3
Plant 72.1
Boy 70.8
Floor 70.7
Female 69.2
Grass 69.1
Girl 66.6
Road 66.5
Outdoors 65.4
Table 62.8
Standing 61
Tree 59.3
Sitting 59.2
Long Sleeve 58
Shorts 57.4
Finger 57.4
Denim 56.1
Jeans 56.1
Hat 55.6

Imagga
created on 2022-02-26

kin 68.5
man 30.9
home 27.1
people 26.2
male 25.3
adult 24.9
happy 21.9
mother 20.8
sitting 20.6
indoors 20.2
person 18.8
newspaper 18.8
businessman 17.6
family 16.9
portrait 16.8
lifestyle 16.6
20s 16.5
indoor 16.4
business 16.4
parent 16.3
casual 16.1
senior 15.9
couple 15.7
smiling 15.2
room 15.1
child 15.1
face 14.2
office 13.8
interior 13.3
old 13.2
product 13
cheerful 13
looking 12.8
care 12.3
together 12.3
attractive 11.9
businesswoman 11.8
color 11.7
smile 11.4
businesspeople 11.4
men 11.2
floor 11.1
health 11.1
camera 11.1
work 11
love 11
happiness 11
elderly 10.5
talking 10.4
meeting 10.4
creation 10.3
children 10
nurse 9.9
spa 9.9
pretty 9.8
colleagues 9.7
group 9.7
computer 9.6
women 9.5
cute 9.3
two 9.3
relaxation 9.2
clothing 9.2
professional 9
grandfather 8.9
job 8.8
working 8.8
casual clothing 8.8
day 8.6
sofa 8.6
corporate 8.6
enjoying 8.5
horizontal 8.4
mature 8.4
classroom 8.4
leisure 8.3
healthy 8.2
blond 8.1
worker 8.1
team 8.1
body 8
living room 7.8
25 30 years 7.8
boy 7.8
architecture 7.8
father 7.8
table 7.8
designer 7.7
modern 7.7
30s 7.7
life 7.7
sibling 7.7
relax 7.6
adults 7.6
females 7.6
house 7.5
human 7.5
retro 7.4
treatment 7.3
occupation 7.3
design 7.3
lady 7.3
girls 7.3
relaxing 7.3
aged 7.2
handsome 7.1

Google
created on 2022-02-26

Black 89.9
Window 88
Black-and-white 86.5
Style 84.1
Table 81.1
Monochrome 78.6
Building 77.8
Monochrome photography 77.2
Art 75.3
Child 74.5
Snapshot 74.3
Font 69.2
T-shirt 68.1
Room 67.8
Toddler 67.7
Visual arts 67.7
Stock photography 65.8
Sitting 63.8
Vintage clothing 62.9
House 61.9

Microsoft
created on 2022-02-26

text 94.5
person 85.4
human face 77.5
clothing 75.1
black and white 69.7

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 66.3%
Happy 57.2%
Surprised 28.6%
Calm 9.8%
Sad 1.1%
Disgusted 0.9%
Angry 0.9%
Confused 0.9%
Fear 0.6%

AWS Rekognition

Age 23-33
Gender Male, 66.1%
Happy 97.5%
Calm 1.4%
Surprised 0.6%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Sad 0%

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Happy 91.1%
Surprised 5.3%
Calm 1.2%
Sad 0.8%
Fear 0.7%
Disgusted 0.4%
Angry 0.3%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 94.8%

Captions

Microsoft

a group of people sitting in front of a laptop 70.1%
a group of people sitting at a table 70%
a person sitting in front of a laptop 63.5%