Human Generated Data

Title

Untitled (man and boys playing at boxing)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16516

Human Generated Data

Title

Untitled (man and boys playing at boxing)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Furniture 100
Person 99.4
Human 99.4
Person 99
Cushion 98.2
Pillow 97.8
Person 97
Living Room 94.5
Room 94.5
Indoors 94.5
Person 93.3
Chair 83.4
Couch 79.8
Female 76
Apparel 75.3
Clothing 75.3
Home Decor 74.9
Bed 74.8
People 66.6
Kid 64.3
Child 64.3
Face 63.4
Girl 62.9
Baby 62.6
Person 60.5

Imagga
created on 2022-02-11

person 43.3
newspaper 42.3
people 40.7
adult 38.7
man 31.6
product 31.4
home 29.5
indoors 27.2
room 26.7
creation 24.7
working 23.9
business 23.7
portrait 22.6
happy 22.6
male 22.1
businessman 22.1
lifestyle 21.7
computer 21.7
patient 21.4
smiling 21
office 20.9
nurse 20.8
work 20.5
women 19.8
laptop 19.3
indoor 19.2
businesswoman 19.1
sitting 18.9
hospital 18.6
smile 18.5
face 18.5
professional 17
house 16.7
cheerful 16.3
businesspeople 16.1
interior 15.9
casual 15.3
team 14.3
happiness 14.1
health 13.9
group 13.7
looking 13.6
teamwork 13
corporate 12.9
20s 12.8
case 12.8
technology 12.6
desk 12.5
together 12.3
doctor 12.2
couple 12.2
sick person 12
men 12
alone 11.9
worker 11.8
meeting 11.3
human 11.2
attractive 11.2
day 11
life 10.9
bright 10.7
care 10.7
sofa 10.7
color 10.6
medicine 10.6
modern 10.5
talking 10.5
executive 10.2
child 10.2
window 10.1
horizontal 10
family 9.8
new 9.7
comfortable 9.6
bed 9.5
manager 9.3
specialist 9.3
clothing 9.2
confident 9.1
holding 9.1
one 9
job 8.8
table 8.8
medical 8.8
couch 8.7
laboratory 8.7
30s 8.7
chair 8.6
apartment 8.6
keyboard 8.4
clinic 8.4
fun 8.2
single 8.2
mother 8.1
love 7.9
conference 7.8
education 7.8
two people 7.8
colleagues 7.8
mid adult 7.7
1 7.7
pretty 7.7
loving 7.6
females 7.6
communication 7.6
leisure 7.5
domestic 7.4
successful 7.3
sibling 7.2
student 7.2
success 7.2
baby 7.1

Google
created on 2022-02-11

Microsoft
created on 2022-02-11

text 99
drawing 95.5
person 93.4
sketch 88.5
window 84.3
clothing 76.2

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 89.9%
Sad 46%
Calm 42.3%
Confused 7.7%
Happy 1.9%
Angry 0.7%
Disgusted 0.6%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Female, 99%
Calm 85.6%
Happy 11.3%
Surprised 1%
Fear 0.7%
Sad 0.5%
Angry 0.5%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 43-51
Gender Female, 98.3%
Calm 41.4%
Angry 19.4%
Sad 10.8%
Happy 9.9%
Fear 8.9%
Disgusted 4%
Surprised 3.9%
Confused 1.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Couch 79.8%

Captions

Microsoft

a man standing in front of a window 78%
a man sitting in front of a window 69.3%
a man standing next to a window 69.2%

Text analysis

Amazon

I

Google

-YT3RA°2-
-XAGON
MJI9-
MJI9- -YT3RA°2- -XAGON