Human Generated Data

Title

Untitled (boys gathered around baby on changing table)

Date

1951

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17794

Human Generated Data

Title

Untitled (boys gathered around baby on changing table)

People

Artist: Lucian and Mary Brown, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.7
Person 99.7
Person 99.1
Person 98.6
Person 94.4
Apparel 93.6
Clothing 93.6
Person 90.8
Furniture 87.9
Face 82.9
Female 77.5
Person 77.3
Chair 76.2
Person 75.5
Indoors 74.9
People 72.6
Portrait 70.5
Photo 70.5
Photography 70.5
Kid 70.4
Child 70.4
Baby 69.6
Room 69.4
Dress 67.9
Girl 66.7
Plant 65.5
Table 62.9
Person 60.1
Dining Table 60.1
Tablecloth 58.1
Screen 56.3
Electronics 56.3
Woman 55.5
Sleeve 55.3

Imagga
created on 2022-02-26

kin 53.4
man 33.6
people 33.4
male 31.2
person 30.6
senior 28.1
executive 25
sitting 24
adult 23.4
business 22.5
businessman 22.1
men 21.5
office 20.9
room 18.8
couple 18.3
happy 18.2
indoors 17.6
elderly 17.2
computer 16.9
home 16.7
mature 16.7
grandfather 16.6
old 16
together 15.8
portrait 15.5
group 15.3
meeting 15.1
professional 14.1
table 13.8
smiling 13.7
retired 13.6
women 13.4
work 13.3
teacher 13.3
team 12.5
businesspeople 12.3
lifestyle 12.3
older 11.6
retirement 11.5
smile 11.4
casual 11
indoor 11
laptop 10.9
job 10.6
working 10.6
looking 10.4
teamwork 10.2
happiness 10.2
businesswoman 10
aged 9.9
worker 9.8
love 9.5
relaxed 9.4
family 8.9
60s 8.8
seated 8.8
couch 8.7
corporate 8.6
desk 8.5
modern 8.4
musical instrument 8.3
human 8.2
cheerful 8.1
entrepreneur 8
pensioner 7.8
education 7.8
monitor 7.8
colleagues 7.8
chair 7.6
career 7.6
keyboard 7.5
screen 7.5
leisure 7.5
grandma 7.5
confident 7.3
handsome 7.1

Google
created on 2022-02-26

Black-and-white 84.7
Style 83.9
Table 79.3
Monochrome 76.5
Monochrome photography 76.3
Chair 73.9
Vintage clothing 71.2
Art 69.5
Event 69.1
Classic 66.5
T-shirt 65.8
Sitting 65
Room 63.5
Font 63.5
Stock photography 63.3
History 61.7
Visual arts 54.2
Family 51.8

Microsoft
created on 2022-02-26

clothing 98
person 97.5
text 95
human face 89.4
man 85.4
old 66
black and white 59.9

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 93.2%
Happy 55.7%
Calm 21.2%
Surprised 20.5%
Sad 0.8%
Fear 0.6%
Angry 0.6%
Disgusted 0.4%
Confused 0.1%

AWS Rekognition

Age 11-19
Gender Male, 93.9%
Calm 91.3%
Happy 3.8%
Sad 3.6%
Surprised 0.4%
Fear 0.3%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man and a woman standing in front of a window 69.4%
a group of people standing in front of a window 69.3%
an old photo of a person 69.2%

Text analysis

Amazon

OF