Human Generated Data

Title

Untitled (adults and children in living room)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16572

Human Generated Data

Title

Untitled (adults and children in living room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Furniture 99.8
Chair 99.8
Chair 99.8
Chair 99.1
Person 98
Human 98
Person 97.1
Person 95.5
Room 95.5
Indoors 95.5
Person 88.6
Clinic 87.1
Table 82.3
Dining Table 82.3
Person 70.2
People 69.7
Person 67.1
Restaurant 59.2
Cafeteria 59
Dining Room 55.6

Imagga
created on 2022-02-12

room 42.2
percussion instrument 37.2
musical instrument 36.7
classroom 33.9
chair 32
table 30.1
people 27.9
marimba 27.6
man 25.5
male 24.8
person 22.6
interior 22.1
business 21.9
sitting 20.6
office 19.4
indoors 19.3
group 18.5
businessman 17.6
women 17.4
teacher 17.2
men 17.2
adult 16.9
home 16.7
smiling 16.6
work 16.6
modern 16.1
happy 15.7
communication 15.1
meeting 14.1
education 13.8
restaurant 13.8
cheerful 13.8
furniture 13.5
house 13.4
together 13.1
study 13
indoor 12.8
desk 12.6
school 12.6
team 12.5
hall 12.5
lifestyle 12.3
learning 12.2
couple 12.2
laptop 11.9
businesswoman 11.8
glass 11.7
worker 11.4
corporate 11.2
floor 11.2
student 11
inside 11
conference 10.7
job 10.6
drinking 10.5
talking 10.4
executive 10.4
sibling 10.4
day 10.2
teamwork 10.2
brass 10.1
students 9.7
outfit 9.7
teaching 9.7
portrait 9.7
boy 9.6
enjoying 9.5
friendship 9.4
casual 9.3
coffee 9.3
smile 9.3
drink 9.2
holding 9.1
professional 9.1
board 9
wind instrument 9
waiter 8.9
chatting 8.8
urban 8.7
full length 8.7
happiness 8.6
seat 8.6
dining 8.6
friends 8.5
design 8.4
manager 8.4
color 8.3
confident 8.2
technology 8.2
computer 8
family 8
food 7.9
employee 7.8
device 7.8
discussion 7.8
two people 7.8
class 7.7
dinner 7.7
attractive 7.7
30s 7.7
studying 7.7
child 7.6
businesspeople 7.6
relaxation 7.5
meal 7.4
phone 7.4
girls 7.3
children 7.3
cafeteria 7.3
suit 7.2
vibraphone 7.2
decor 7.1

Google
created on 2022-02-12

Furniture 94.7
Photograph 94.2
White 92.2
Table 92
Black 89.6
Chair 86.9
Line 82
Art 80.2
Window 79.5
Monochrome 74.8
Snapshot 74.3
Room 70.9
Event 68.7
Monochrome photography 68.1
Vintage clothing 66.4
Illustration 66
Painting 65.6
Curtain 63.8
Stock photography 63.7
History 63.5

Microsoft
created on 2022-02-12

table 99.7
furniture 98.9
text 98.4
chair 95.9
house 83.1
coffee table 80.8
person 73.8
clothing 66.7
white 66.5
kitchen & dining room table 60.3
old 54.9

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Calm 51.3%
Sad 27.2%
Disgusted 9.6%
Confused 6.1%
Angry 2.6%
Happy 1.7%
Fear 0.7%
Surprised 0.7%

AWS Rekognition

Age 52-60
Gender Female, 75.9%
Surprised 76.2%
Calm 17.9%
Sad 4.4%
Confused 0.6%
Happy 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 79%
Calm 65.6%
Sad 26.8%
Happy 3.4%
Confused 2.8%
Disgusted 0.7%
Angry 0.3%
Surprised 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Chair 99.8%
Person 98%
Dining Table 82.3%

Captions

Microsoft

a group of people in a room 88.5%
an old photo of a group of people in a room 86.7%
a group of people sitting in a room 80.5%

Text analysis

Amazon

6

Google

MJI7--YT37A°2
-
XAGOX
MJI7--YT37A°2 - - XAGOX