Human Generated Data

Title

Untitled (family in rec room)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16737

Human Generated Data

Title

Untitled (family in rec room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.3
Person 99.3
Person 99.2
Person 98.9
Tie 94
Accessory 94
Accessories 94
Person 93.6
Restaurant 92.1
Person 84
Food 83.9
Meal 83.9
Person 79.7
Furniture 79.5
Room 75.6
Indoors 75.6
Person 68.9
Cafe 68
Cafeteria 68
Chair 59.7
Leisure Activities 56.7
Guitar 56.7
Musical Instrument 56.7
Floor 55.7
Suit 55.4
Coat 55.4
Clothing 55.4
Overcoat 55.4
Apparel 55.4

Imagga
created on 2022-02-26

waiter 46.1
dining-room attendant 35.5
people 34
employee 30.5
man 28.2
business 26.7
male 26.2
worker 25.7
restaurant 25.4
men 24.9
room 24.5
cafeteria 24
adult 23.6
table 23.4
women 22.9
person 22.8
group 22.6
office 21
meeting 20.7
chair 20.7
businessman 20.3
indoors 20.2
work 19.8
interior 19.5
corporate 18.9
team 18.8
building 18.5
businesswoman 17.3
happy 16.9
modern 16.8
hall 16.5
life 15.7
home 15.1
together 14.9
teamwork 14.8
teacher 14.8
couple 14.8
smiling 14.5
executive 13.1
lifestyle 13
sitting 12.9
classroom 12.8
talking 12.4
businesspeople 12.3
communication 11.8
suit 11.7
kin 11.2
portrait 11
urban 10.5
mature 10.2
happiness 10.2
casual 10.2
inside 10.1
dress 9.9
meal 9.8
family 9.8
conference 9.8
job 9.7
working 9.7
colleagues 9.7
new 9.7
success 9.7
dining 9.5
desk 9.4
dinner 9.4
two 9.3
manager 9.3
structure 9.3
occupation 9.2
professional 9.1
design 9
furniture 9
discussion 8.8
education 8.7
scene 8.7
day 8.6
boss 8.6
enjoying 8.5
clothing 8.4
presentation 8.4
drink 8.3
city 8.3
cheerful 8.1
boy 7.8
40s 7.8
30s 7.7
drinking 7.7
house 7.5
senior 7.5
fun 7.5
floor 7.4
food 7.3
20s 7.3
successful 7.3
indoor 7.3
laptop 7.3
groom 7.3
board 7.2
black 7.2
student 7.2
smile 7.1
love 7.1
glass 7

Google
created on 2022-02-26

Chair 87.5
Black-and-white 84.5
Style 83.8
Monochrome photography 74
Monochrome 74
Suit 70.8
Vintage clothing 70.4
Event 69.3
Sitting 67.9
Art 67.4
Font 66.9
History 63.8
Stock photography 62.8
Room 62.4
Window 61.4
Conversation 56.5
Hat 53.3
Visual arts 53
White-collar worker 52.8
Photo caption 52.1

Microsoft
created on 2022-02-26

person 98.9
clothing 97.2
text 96.2
outdoor 90.5
furniture 82.7
woman 80.7
standing 77.6
chair 67.1
dress 66.4
people 56

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 95.7%
Calm 98.8%
Sad 0.9%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 34-42
Gender Male, 65.4%
Confused 44.6%
Calm 34.5%
Sad 13.2%
Happy 2.3%
Disgusted 1.6%
Surprised 1.5%
Fear 1.4%
Angry 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 94%
Chair 59.7%
Guitar 56.7%

Captions

Microsoft

a group of people standing in front of a store 90.6%
a group of people standing in front of a building 90.5%
a group of people standing in a room 90.4%

Text analysis

Amazon

ers
Kuuvkt