Human Generated Data

Title

Untitled (portrait of woman and children on couch)
Date

1964
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16906

Human Generated Data

Title

Untitled (portrait of woman and children on couch)

People

Artist: Lucian and Mary Brown, American

Date

1964

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 97.8
Person 96.9
Person 96.7
Bench 96.2
Furniture 96.2
Person 96.1
Person 96.1
Person 96
Chair 95.4
Person 93.6
Person 92.6
Baby 90.9
People 89.2
Person 81.7
Indoors 81.4
Room 78.1
Face 69.1
Female 67.5
Child 65.2
Kid 65.2
Girl 63.3
Photography 61.8
Photo 61.8
Floor 61.6
Living Room 61.2
Couch 59.9
Clothing 58.6
Apparel 58.6
Overcoat 58.6
Suit 58.6
Coat 58.6
Table 58.4
Sitting 58.3
Newborn 56.4
Flooring 55.1

Imagga
created on 2022-02-26

classroom 82.1
room 66.2
man 39.7
person 36.7
male 36.2
people 31.2
teacher 28.6
adult 28.2
group 26.6
blackboard 25.8
men 24.9
school 22.1
sitting 21.5
smiling 20.2
business 20
women 19.8
businessman 19.4
education 19
happy 18.8
student 18.4
indoor 18.2
indoors 17.6
lifestyle 17.3
businesspeople 17.1
nurse 17
home 16.7
couple 16.5
cheerful 16.2
professional 16
together 15.8
table 15.7
teaching 15.6
colleagues 15.5
office 15.4
casual 15.2
senior 15
teamwork 14.8
businesswoman 14.5
class 14.5
meeting 14.1
kin 13.6
team 13.4
happiness 13.3
friends 13.1
smile 12.8
studying 12.5
mature 12.1
child 12
board 11.8
portrait 11.6
mid adult 11.6
30s 11.5
looking 11.2
communication 10.9
students 10.7
kid 10.6
job 10.6
color 10.6
talking 10.4
boy 10.4
desk 10.4
study 10.3
work 10.2
holding 9.9
worker 9.8
interior 9.7
working 9.7
chair 9.7
horizontal 9.2
children 9.1
clothing 9.1
family 8.9
explaining 8.9
to 8.8
30 35 years 8.8
discussion 8.8
retired 8.7
love 8.7
day 8.6
four 8.6
elderly 8.6
two 8.5
enjoyment 8.4
modern 8.4
training 8.3
20s 8.2
fun 8.2
handsome 8
coworkers 7.9
diverse 7.8
25 30 years 7.8
black 7.8
lesson 7.8
corporate 7.7
busy 7.7
diversity 7.7
drinking 7.6
workplace 7.6
executive 7.6
sibling 7.6
relaxation 7.5
learning 7.5
human 7.5
inside 7.4
laptop 7.3
blond 7.2

Google
created on 2022-02-26

Picture frame 90.8
Style 83.9
Black-and-white 82.8
Building 82.2
Art 80.9
Monochrome photography 75.6
Monochrome 74.2
Table 73
Painting 72.7
Room 71.8
Vintage clothing 66.7
Child 66.3
Recreation 65.8
Sitting 65.7
Visual arts 64.2
Stock photography 63.8
Illustration 62.8
Chair 62.2
Sports equipment 61.9
Suit 57.3

Microsoft
created on 2022-02-26

person 96.4
clothing 91.9
text 90.3
cartoon 84.6
footwear 53.5

Face analysis

Amazon

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Calm 95.5%
Surprised 1.4%
Sad 0.9%
Fear 0.8%
Angry 0.4%
Disgusted 0.4%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 48-56
Gender Male, 91.1%
Sad 51.2%
Calm 23.4%
Happy 19.7%
Angry 2.1%
Confused 1.4%
Disgusted 0.9%
Surprised 0.7%
Fear 0.6%

AWS Rekognition

Age 49-57
Gender Male, 100%
Happy 98.8%
Calm 0.4%
Surprised 0.3%
Fear 0.2%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Female, 96.4%
Calm 76.3%
Happy 12.3%
Sad 5.9%
Fear 1.9%
Confused 1.3%
Surprised 1.1%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 41-49
Gender Female, 89.9%
Calm 98.3%
Surprised 0.7%
Angry 0.3%
Happy 0.3%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Sad 58.6%
Happy 21.5%
Calm 14.5%
Surprised 1.9%
Confused 1.2%
Disgusted 1%
Angry 0.7%
Fear 0.7%

Feature analysis

Amazon

Person 96.9%
Bench 96.2%
Chair 95.4%

Captions

Microsoft

a group of people sitting on a bench 82.6%
a group of people sitting on a bench in front of a piano 82.5%
a group of people sitting at a bench 82.4%

Text analysis

Amazon

2
8
KODAK-1

Google

MJI3- -YT3R2- -NAGON 2)
MJI3-
2)
-YT3R2-
-NAGON