Human Generated Data

Title

Untitled (two babies on bed after bath)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16983

Human Generated Data

Title

Untitled (two babies on bed after bath)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.1
Human 99.1
Person 98.4
Furniture 98.1
Bed 88.6
Bedroom 86.2
Indoors 86.2
Room 86.2
Clothing 61.7
Apparel 61.7
Head 55.2
Shorts 55.1

Imagga
created on 2022-02-26

man 38.3
people 34
person 29.8
male 29.8
adult 24.7
happy 23.8
senior 22.5
sitting 21.5
smiling 19.5
business 19.4
lifestyle 18.8
computer 18.6
group 17.7
together 17.5
laptop 17.5
office 17.3
men 17.2
women 16.6
world 16.6
two 16.1
businessman 15.9
mature 14.9
casual 14.4
couple 13.9
teacher 13.7
businesswoman 13.6
portrait 13.6
team 13.4
professional 13.4
work 13.3
indoor 12.8
chair 12.5
job 12.4
working 12.4
training 12
looking 12
television 11.8
family 11.6
equipment 11.5
indoors 11.4
businesspeople 11.4
corporate 11.2
home 11.2
happiness 11
sport 11
school 10.9
table 10.9
executive 10.7
room 10.6
cheerful 10.6
boy 10.4
20s 10.1
smile 10
holding 9.9
patient 9.8
handsome 9.8
outdoors 9.7
retirement 9.6
elderly 9.6
standing 9.6
child 9.4
meeting 9.4
friends 9.4
teamwork 9.3
active 9.2
clothing 9.2
modern 9.1
worker 8.9
kid 8.9
classroom 8.6
club 8.5
communication 8.4
board 8.4
old 8.4
back 8.3
successful 8.2
alone 8.2
to 8
day 7.8
face 7.8
train 7.8
40s 7.8
retired 7.8
telecommunication system 7.7
30s 7.7
studying 7.7
talking 7.6
house 7.5
learning 7.5
enjoyment 7.5
strength 7.5
leisure 7.5
one 7.5
student 7.3
children 7.3
confident 7.3
color 7.2
love 7.1
vehicle 7.1
interior 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 98.5
toddler 93.4
black and white 85.4
person 85.3
baby 79.3
boy 74.3
clothing 72.1
child 61.5

Face analysis

Amazon

AWS Rekognition

Age 18-26
Gender Female, 54.5%
Happy 93.9%
Surprised 4.7%
Fear 0.6%
Sad 0.3%
Angry 0.2%
Disgusted 0.2%
Confused 0.1%
Calm 0.1%

AWS Rekognition

Age 6-14
Gender Male, 97.5%
Surprised 47%
Fear 32.9%
Calm 11.3%
Sad 3.4%
Happy 3.1%
Angry 0.9%
Disgusted 0.9%
Confused 0.4%

Feature analysis

Amazon

Person 99.1%
Bed 88.6%

Captions

Microsoft

a man sitting on a table 62.6%
an old photo of a man 62.5%
a man sitting at a table with a racket 39.7%

Text analysis

Amazon

21
ac
ODMI

Google

21
21