Human Generated Data

Title

Untitled (three girls in front of fireplace)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16908

Human Generated Data

Title

Untitled (three girls in front of fireplace)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 99.8
Person 98.7
Human 98.7
Person 98.6
Chair 97.8
Indoors 97.8
Room 97.3
Table 97.3
Tabletop 97.1
Person 95.3
Dining Table 94.3
Face 92.1
Meal 90
Food 90
Home Decor 88.3
Apparel 88.3
Clothing 88.3
Dessert 87.8
Creme 87.8
Icing 87.8
Cake 87.8
Cream 87.8
Baby 86.4
Female 85.8
Dish 84.8
Dress 83.1
Kid 81.6
Child 81.6
Photography 73.4
Portrait 73.4
Photo 73.4
Girl 71.7
Dining Room 69.2
Plant 68.4
People 64.3
Living Room 64
Bed 61.6
Floor 61
Play 57.2
Woman 56.9

Imagga
created on 2022-02-26

home 35.9
person 31.4
teacher 31.2
adult 31
people 29
man 27.6
room 26.5
male 25.7
indoors 25.5
sitting 24
senior 21.6
smiling 20.3
professional 19.8
happy 19.4
kin 18.4
men 18
family 17.8
educator 17.7
mother 16.1
portrait 15.5
child 15.1
women 15
couple 14.8
classroom 14.1
mature 13.9
old 13.9
indoor 13.7
chair 13.6
smile 13.5
patient 13.5
elderly 13.4
together 13.1
lifestyle 13
computer 12.9
office 12.8
couch 12.6
looking 12
hospital 11.8
interior 11.5
cheerful 11.4
fun 11.2
happiness 11
working 10.6
retirement 10.6
nurse 10.4
barbershop 10.3
laptop 10.3
work 10.2
daughter 10.1
table 10.1
horizontal 10
house 10
father 10
school 10
worker 9.9
business 9.7
30s 9.6
shop 9.5
talking 9.5
clothing 9.5
casual 9.3
face 9.2
holding 9.1
grandfather 8.9
medical 8.8
two people 8.7
standing 8.7
sofa 8.6
two 8.5
color 8.3
health 8.3
leisure 8.3
20s 8.2
alone 8.2
salon 8.2
son 8
handsome 8
businessman 7.9
living room 7.8
boy 7.8
teaching 7.8
retired 7.8
enjoying 7.6
screen 7.5
desk 7.4
care 7.4
inside 7.4
occupation 7.3
furniture 7.3
aged 7.2
holiday 7.2
to 7.1
job 7.1

Google
created on 2022-02-26

Picture frame 85.7
Black-and-white 85.7
Style 83.9
Toddler 80.4
Monochrome 75.3
Monochrome photography 75
Table 73.2
Baby 71.5
Room 68.7
Child 68.3
Art 67.5
Sitting 65.3
Fun 63.6
Stock photography 63.1
Vintage clothing 62.9
Chair 57.7
Visual arts 54.5
Still life photography 54.4
Classic 53.6
Photography 51.6

Microsoft
created on 2022-02-26

toddler 97.2
baby 95.3
text 94
human face 89.6
indoor 88.3
person 86.6
clothing 77.1
boy 76.4
child 66.1
old 48.9

Face analysis

Amazon

AWS Rekognition

Age 26-36
Gender Female, 99.6%
Happy 99.7%
Fear 0.1%
Calm 0%
Sad 0%
Disgusted 0%
Surprised 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 25-35
Gender Female, 59.9%
Happy 84.4%
Surprised 8.4%
Calm 4.5%
Angry 0.7%
Fear 0.6%
Sad 0.6%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 45-51
Gender Female, 81.4%
Happy 92.8%
Sad 3.9%
Calm 0.9%
Fear 0.8%
Surprised 0.6%
Disgusted 0.4%
Angry 0.3%
Confused 0.3%

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a vintage photo of a boy 74.7%
a vintage photo of a group of people posing for the camera 74.6%
a vintage photo of a group of people posing for a picture 74.5%

Text analysis

Amazon

10
2

Google

MJI7--YT33A°2--XAGO
MJI7--YT33A°2--XAGO